2023-12-04T10:25:20.081 INFO:root:teuthology version: 0.0.1.dev214+gf2de108 2023-12-04T10:25:20.081 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476898 --name vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476898/orig.config.yaml 2023-12-04T10:25:20.131 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-04T10:25:20.220 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476898 branch: wip-vshankar-testing-20231204.063332 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: vshankar@redhat.com first_in_suite: false job_id: '7476898' kernel: client: branch: testing flavor: default kdb: true sha1: 9c0b943f8476b8090f302186b32f5e600b7b0866 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20231204.063332 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: c7b0e682e685ca9c244e731128a4c5dcad3b99eb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: c7b0e682e685ca9c244e731128a4c5dcad3b99eb kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231204.063332 sha1: c7b0e682e685ca9c244e731128a4c5dcad3b99eb owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 1577 sha1: c7b0e682e685ca9c244e731128a4c5dcad3b99eb sleep_before_teardown: 0 subset: 220/1024 suite: fs suite_branch: wip-vshankar-testing-20231204.063332 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_c7b0e682e685ca9c244e731128a4c5dcad3b99eb/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: c7b0e682e685ca9c244e731128a4c5dcad3b99eb syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi063.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5a3499J6ROzU333sxNFjQ2PVyf7nSwc3ss1hgsmDzBE/vVoMRLYJK2u0h61oGIQ0Mhp9/dfomW96AGaJnLNNQ= smithi066.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOdF/Pp4hi1Fk+AQ5D9r59OgmqVwB+gObKn+pIzWmzwdLh44Sm/lquwSnz0RxH7Oo5apBIHoq7S/hFbsrLS9GWw= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: f2de108beb0a6dde7f3e6c96039071828a1f6269 timestamp: 2023-12-04_09:26:31 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-04T10:25:20.220 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_c7b0e682e685ca9c244e731128a4c5dcad3b99eb/qa; will attempt to use it 2023-12-04T10:25:20.221 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_c7b0e682e685ca9c244e731128a4c5dcad3b99eb/qa/tasks 2023-12-04T10:25:20.221 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-04T10:25:20.223 INFO:teuthology.task.internal:Checking packages... 2023-12-04T10:25:20.247 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb' 2023-12-04T10:25:20.247 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-04T10:25:20.247 INFO:teuthology.packaging:ref: None 2023-12-04T10:25:20.247 INFO:teuthology.packaging:tag: None 2023-12-04T10:25:20.247 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231204.063332 2023-12-04T10:25:20.247 INFO:teuthology.packaging:sha1: c7b0e682e685ca9c244e731128a4c5dcad3b99eb 2023-12-04T10:25:20.247 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20231204.063332 2023-12-04T10:25:20.388 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7690.gc7b0e682 2023-12-04T10:25:20.388 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-04T10:25:20.394 INFO:teuthology.task.internal:no buildpackages task found 2023-12-04T10:25:20.395 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-04T10:25:20.439 INFO:teuthology.task.internal:Saving configuration 2023-12-04T10:25:20.466 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-04T10:25:20.472 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-04T10:25:20.498 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi063.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476898', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 10:18:56.694458', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5a3499J6ROzU333sxNFjQ2PVyf7nSwc3ss1hgsmDzBE/vVoMRLYJK2u0h61oGIQ0Mhp9/dfomW96AGaJnLNNQ='} 2023-12-04T10:25:20.522 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi066.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476898', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-04 10:18:56.696008', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOdF/Pp4hi1Fk+AQ5D9r59OgmqVwB+gObKn+pIzWmzwdLh44Sm/lquwSnz0RxH7Oo5apBIHoq7S/hFbsrLS9GWw='} 2023-12-04T10:25:20.522 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-04T10:25:20.528 INFO:teuthology.task.internal:roles: ubuntu@smithi063.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-04T10:25:20.528 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-04T10:25:20.528 INFO:teuthology.run_tasks:Running task console_log... 2023-12-04T10:25:20.609 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa10207ca60>, signals=[15]) 2023-12-04T10:25:20.610 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-04T10:25:20.615 INFO:teuthology.task.internal:Opening connections... 2023-12-04T10:25:20.616 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:25:20.617 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:25:20.715 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T10:25:20.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:25:20.813 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-04T10:25:20.820 DEBUG:teuthology.orchestra.run.smithi063:> uname -m 2023-12-04T10:25:20.838 INFO:teuthology.orchestra.run.smithi063.stdout:x86_64 2023-12-04T10:25:20.838 DEBUG:teuthology.orchestra.run.smithi063:> cat /etc/os-release 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:NAME="CentOS Stream" 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION="9" 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:ID="centos" 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:ID_LIKE="rhel fedora" 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:VERSION_ID="9" 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM_ID="platform:el9" 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:ANSI_COLOR="0;31" 2023-12-04T10:25:20.895 INFO:teuthology.orchestra.run.smithi063.stdout:LOGO="fedora-logo-icon" 2023-12-04T10:25:20.896 INFO:teuthology.orchestra.run.smithi063.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T10:25:20.896 INFO:teuthology.orchestra.run.smithi063.stdout:HOME_URL="https://centos.org/" 2023-12-04T10:25:20.896 INFO:teuthology.orchestra.run.smithi063.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:25:20.896 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T10:25:20.896 INFO:teuthology.orchestra.run.smithi063.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T10:25:20.896 INFO:teuthology.lock.ops:Updating smithi063.front.sepia.ceph.com on lock server 2023-12-04T10:25:20.919 DEBUG:teuthology.orchestra.run.smithi066:> uname -m 2023-12-04T10:25:20.937 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2023-12-04T10:25:20.937 DEBUG:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2023-12-04T10:25:20.994 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="CentOS Stream" 2023-12-04T10:25:20.994 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="9" 2023-12-04T10:25:20.994 INFO:teuthology.orchestra.run.smithi066.stdout:ID="centos" 2023-12-04T10:25:20.994 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="rhel fedora" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="9" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el9" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:LOGO="fedora-logo-icon" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://centos.org/" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-04T10:25:20.995 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-04T10:25:20.995 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2023-12-04T10:25:21.019 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-04T10:25:21.028 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-04T10:25:21.135 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-04T10:25:21.135 DEBUG:teuthology.orchestra.run.smithi063:> test '!' -e /home/ubuntu/cephtest 2023-12-04T10:25:21.137 DEBUG:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2023-12-04T10:25:21.154 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-04T10:25:21.160 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-04T10:25:21.161 DEBUG:teuthology.orchestra.run.smithi063:> test -z $(ls -A /var/lib/ceph) 2023-12-04T10:25:21.195 DEBUG:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2023-12-04T10:25:21.226 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-04T10:25:21.282 INFO:teuthology.run_tasks:Running task kernel... 2023-12-04T10:25:21.297 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '9c0b943f8476b8090f302186b32f5e600b7b0866'} 2023-12-04T10:25:21.298 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-12-04T10:25:21.298 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-04T10:25:21.298 DEBUG:teuthology.orchestra.run.smithi063:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-04T10:25:21.299 DEBUG:teuthology.orchestra.run.smithi066:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-04T10:25:21.315 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T10:25:21.316 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T10:25:21.316 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-04T10:25:21.318 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-04T10:25:21.483 DEBUG:teuthology.task.kernel:sha1 for client.0 is 9c0b943f8476b8090f302186b32f5e600b7b0866 2023-12-04T10:25:21.483 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "9c0b943f8476b8090f302186b32f5e600b7b0866"... 2023-12-04T10:25:21.483 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2023-12-04T10:25:21.501 INFO:teuthology.orchestra.run.smithi063.stdout:5.14.0-361.el9.x86_64 2023-12-04T10:25:21.501 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 9c0b943f8476b8090f302186b32f5e600b7b0866 2023-12-04T10:25:21.502 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-04T10:25:21.502 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum upgrade -y linux-firmware 2023-12-04T10:25:21.565 DEBUG:teuthology.task.kernel:sha1 for client.1 is 9c0b943f8476b8090f302186b32f5e600b7b0866 2023-12-04T10:25:21.565 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "9c0b943f8476b8090f302186b32f5e600b7b0866"... 2023-12-04T10:25:21.565 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2023-12-04T10:25:21.583 INFO:teuthology.orchestra.run.smithi066.stdout:5.14.0-361.el9.x86_64 2023-12-04T10:25:21.583 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 9c0b943f8476b8090f302186b32f5e600b7b0866 2023-12-04T10:25:21.583 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-04T10:25:21.583 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum upgrade -y linux-firmware 2023-12-04T10:25:23.652 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-04T10:25:23.805 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-04T10:25:25.019 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.0 MB 00:00 2023-12-04T10:25:25.306 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2023-12-04T10:25:26.118 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 7.9 MB 00:00 2023-12-04T10:25:26.455 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 9.8 MB/s | 7.9 MB 00:00 2023-12-04T10:25:29.261 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 9.1 MB/s | 18 MB 00:01 2023-12-04T10:25:30.056 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 7.5 MB/s | 18 MB 00:02 2023-12-04T10:25:33.603 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 6.6 MB/s | 5.8 MB 00:00 2023-12-04T10:25:34.740 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 5.8 MB 00:01 2023-12-04T10:25:35.497 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 15 kB 00:00 2023-12-04T10:25:36.341 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 36 kB/s | 15 kB 00:00 2023-12-04T10:25:37.409 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 22 MB/s | 20 MB 00:00 2023-12-04T10:25:37.422 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-04T10:25:42.405 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-12-04T10:25:42.425 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 45 kB/s | 1.7 kB 00:00 2023-12-04T10:25:44.913 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2023-12-04T10:25:44.924 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout:================================================================================ 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 1 Package 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 328 M 2023-12-04T10:25:44.925 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2023-12-04T10:25:44.991 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-04T10:25:45.001 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-04T10:25:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-04T10:25:45.001 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-04T10:25:45.001 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2023-12-04T10:25:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-04T10:25:45.001 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:25:45.001 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-04T10:25:45.002 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-04T10:25:45.002 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 1 Package 2023-12-04T10:25:45.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:25:45.002 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 328 M 2023-12-04T10:25:45.002 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-04T10:25:59.647 INFO:teuthology.orchestra.run.smithi063.stdout:linux-firmware-20231030-141.el9.noarch.rpm 22 MB/s | 328 MB 00:14 2023-12-04T10:25:59.648 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-04T10:25:59.648 INFO:teuthology.orchestra.run.smithi063.stdout:Total 22 MB/s | 328 MB 00:14 2023-12-04T10:25:59.649 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-04T10:25:59.743 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-04T10:25:59.743 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-04T10:26:01.954 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-04T10:26:01.954 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-04T10:26:03.808 INFO:teuthology.orchestra.run.smithi066.stdout:linux-firmware-20231030-141.el9.noarch.rpm 17 MB/s | 328 MB 00:18 2023-12-04T10:26:03.809 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2023-12-04T10:26:03.809 INFO:teuthology.orchestra.run.smithi066.stdout:Total 17 MB/s | 328 MB 00:18 2023-12-04T10:26:03.810 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2023-12-04T10:26:03.902 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2023-12-04T10:26:03.903 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2023-12-04T10:26:06.094 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2023-12-04T10:26:06.095 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2023-12-04T10:26:07.856 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-04T10:26:08.118 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-04T10:26:08.221 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-04T10:26:09.069 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-04T10:26:09.070 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-04T10:26:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-04T10:26:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:26:09.469 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2023-12-04T10:26:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-04T10:26:09.469 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:26:09.469 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-04T10:26:09.778 INFO:teuthology.task.kernel:Downloading kernel 9c0b943f8476b8090f302186b32f5e600b7b0866 on client.0... 2023-12-04T10:26:09.779 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9c0b943f8476b8090f302186b32f5e600b7b0866 2023-12-04T10:26:09.935 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/9c0b943f8476b8090f302186b32f5e600b7b0866/centos/9/flavors/default/x86_64/ 2023-12-04T10:26:09.935 DEBUG:teuthology.orchestra.run.smithi063:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g9c0b943f8476-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/9c0b943f8476b8090f302186b32f5e600b7b0866/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-04T10:26:09.937 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi063.front.sepia.ceph.com to complete... 2023-12-04T10:26:12.140 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2023-12-04T10:26:12.580 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-04T10:26:12.683 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-04T10:26:13.338 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-04T10:26:13.338 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-04T10:26:13.701 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-04T10:26:13.701 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:26:13.701 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2023-12-04T10:26:13.701 INFO:teuthology.orchestra.run.smithi066.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-04T10:26:13.701 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:26:13.701 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2023-12-04T10:26:13.978 INFO:teuthology.task.kernel:Downloading kernel 9c0b943f8476b8090f302186b32f5e600b7b0866 on client.1... 2023-12-04T10:26:13.979 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=9c0b943f8476b8090f302186b32f5e600b7b0866 2023-12-04T10:26:14.120 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/9c0b943f8476b8090f302186b32f5e600b7b0866/centos/9/flavors/default/x86_64/ 2023-12-04T10:26:14.121 DEBUG:teuthology.orchestra.run.smithi066:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_g9c0b943f8476-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/9c0b943f8476b8090f302186b32f5e600b7b0866/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-04T10:26:14.123 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi066.front.sepia.ceph.com to complete... 2023-12-04T10:26:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04 10:26:33 URL:https://3.chacra.ceph.com/r/kernel/testing/9c0b943f8476b8090f302186b32f5e600b7b0866/centos/9/flavors/default/x86_64/kernel-6.6.0_g9c0b943f8476-1.x86_64.rpm [320634108/320634108] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-04T10:26:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:FINISHED --2023-12-04 10:26:33-- 2023-12-04T10:26:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:Total wall clock time: 24s 2023-12-04T10:26:33.907 INFO:teuthology.orchestra.run.smithi063.stderr:Downloaded: 1 files, 306M in 24s (12.9 MB/s) 2023-12-04T10:26:33.908 INFO:teuthology.task.kernel:Installing kernel 9c0b943f8476b8090f302186b32f5e600b7b0866 on client.0... 2023-12-04T10:26:33.908 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-04T10:26:35.852 INFO:teuthology.orchestra.run.smithi063.stdout:Verifying... ######################################## 2023-12-04T10:26:35.918 INFO:teuthology.orchestra.run.smithi063.stdout:Preparing... ######################################## 2023-12-04T10:26:36.002 INFO:teuthology.orchestra.run.smithi063.stdout:Updating / installing... 2023-12-04T10:26:43.344 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-6.6.0_g9c0b943f8476-1 ######################################## 2023-12-04T10:26:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04 10:26:48 URL:https://3.chacra.ceph.com/r/kernel/testing/9c0b943f8476b8090f302186b32f5e600b7b0866/centos/9/flavors/default/x86_64/kernel-6.6.0_g9c0b943f8476-1.x86_64.rpm [320634108/320634108] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-04T10:26:48.990 INFO:teuthology.orchestra.run.smithi066.stderr:FINISHED --2023-12-04 10:26:48-- 2023-12-04T10:26:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:Total wall clock time: 35s 2023-12-04T10:26:48.991 INFO:teuthology.orchestra.run.smithi066.stderr:Downloaded: 1 files, 306M in 34s (8.93 MB/s) 2023-12-04T10:26:48.992 INFO:teuthology.task.kernel:Installing kernel 9c0b943f8476b8090f302186b32f5e600b7b0866 on client.1... 2023-12-04T10:26:48.992 DEBUG:teuthology.orchestra.run.smithi066:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-04T10:26:50.928 INFO:teuthology.orchestra.run.smithi066.stdout:Verifying... ######################################## 2023-12-04T10:26:51.246 INFO:teuthology.orchestra.run.smithi066.stdout:Preparing... ######################################## 2023-12-04T10:26:51.331 INFO:teuthology.orchestra.run.smithi066.stdout:Updating / installing... 2023-12-04T10:26:58.576 INFO:teuthology.orchestra.run.smithi063.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-04T10:26:58.674 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-6.6.0_g9c0b943f8476-1 ######################################## 2023-12-04T10:27:11.663 INFO:teuthology.orchestra.run.smithi066.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-04T10:27:20.426 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi063.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-04T10:27:20.426 DEBUG:teuthology.orchestra.run.smithi063:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/System.map-6.6.0-g9c0b943f8476 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/config-6.6.0-g9c0b943f8476 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/boot/vmlinuz-6.6.0-g9c0b943f8476 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-04T10:27:20.509 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-04T10:27:20.510 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kernel 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kernel/cpu 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kernel/cpu/mce 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kvm 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kvm/kvm.ko 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto 2023-12-04T10:27:20.511 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/ansi_cprng.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/anubis.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/arc4.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_memcpy.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_pq.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_tx.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_xor.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/raid6test.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/authenc.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/authencesn.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/blake2b_generic.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/blowfish_common.ko 2023-12-04T10:27:20.512 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/blowfish_generic.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/camellia_generic.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cast5_generic.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cast6_generic.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cast_common.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/ccm.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cmac.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/crc32_generic.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/crypto_engine.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/crypto_user.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cts.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/des_generic.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/dh_generic.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/echainiv.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/essiv.ko 2023-12-04T10:27:20.513 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/fcrypt.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/khazad.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/lz4.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/lz4hc.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/md4.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/michael_mic.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/pcbc.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/pcrypt.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/rmd160.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/seed.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/serpent_generic.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/tcrypt.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/tea.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/twofish_common.ko 2023-12-04T10:27:20.514 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/twofish_generic.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/vmac.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/wp512.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/xcbc.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/xor.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/xxhash_generic.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/acpi_pad.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/custom_method.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/ec_sys.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/platform_profile.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/sbs.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/sbshc.ko 2023-12-04T10:27:20.515 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/video.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/acard-ahci.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/ahci_platform.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/ata_generic.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/libahci_platform.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_acpi.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_ali.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_amd.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_artop.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_atiixp.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_atp867x.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_cmd640.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_cmd64x.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_cypress.ko 2023-12-04T10:27:20.516 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_efar.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_hpt366.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_hpt37x.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_it8213.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_it821x.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_jmicron.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_marvell.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_mpiix.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_netcell.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_ninja32.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_ns87410.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_ns87415.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_oldpiix.ko 2023-12-04T10:27:20.517 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_opti.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_optidma.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_pcmcia.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_piccolo.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_rdc.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_sch.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_serverworks.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_sil680.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_sis.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_sl82c105.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_triflex.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_via.ko 2023-12-04T10:27:20.518 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pdc_adma.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_inic162x.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_mv.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_nv.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_promise.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_qstor.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_sil.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_sil24.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_sis.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_svw.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_sx4.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_uli.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_via.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_vsc.ko 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/auxdisplay 2023-12-04T10:27:20.519 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/auxdisplay/ks0108.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/base 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/base/regmap 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/bcma 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/bcma/bcma.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/aoe 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/aoe/aoe.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/brd.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/drbd 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/drbd/drbd.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/floppy.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/loop.ko 2023-12-04T10:27:20.520 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/mtip32xx 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/nbd.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/null_blk 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/null_blk/null_blk.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/pktcdvd.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/rbd.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/virtio_blk.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/xen-blkback 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/xen-blkfront.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/zram 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/zram/zram.ko 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char 2023-12-04T10:27:20.521 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hangcheck-timer.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/via-rng.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/lp.ko 2023-12-04T10:27:20.522 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/mwave 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/mwave/mwave.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ppdev.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tlclk.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/uv_mmtimer.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/virtio_console.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-04T10:27:20.523 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/ccp 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/ccp/ccp.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat/qat_common 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-04T10:27:20.524 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/padlock-aes.ko 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/padlock-sha.ko 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/virtio 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dca 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dca/dca.ko 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/devfreq 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma/dw 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma/ioat 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/amd64_edac.ko 2023-12-04T10:27:20.525 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/e752x_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/edac_mce_amd.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i3000_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i3200_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i5100_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i5400_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i7300_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i7core_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i82975x_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/ie31200_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/sb_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/x38_edac.ko 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/firmware 2023-12-04T10:27:20.526 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/firmware/edd.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/gpio 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/gpio/gpio-ich.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-appleir.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-aureal.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-axff.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-dr.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-elecom.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-elo.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-emsff.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-gaff.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-gt683r.ko 2023-12-04T10:27:20.527 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-gyration.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-holtekff.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-hyperv.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-icade.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-keytouch.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-kye.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-lcpower.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-led.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-lenovo.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-multitouch.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-ortek.ko 2023-12-04T10:27:20.528 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-penmount.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-petalynx.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-picolcd.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-pl.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-plantronics.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-primax.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-rmi.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-common.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-04T10:27:20.529 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-saitek.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-samsung.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-sjoy.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-sony.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-speedlink.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-steelseries.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-sunplus.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-tivo.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-tmff.ko 2023-12-04T10:27:20.530 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-topseed.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-twinhan.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-uclogic.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-waltop.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-wiimote.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-xinmo.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-zpff.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-zydacron.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/uhid.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/wacom.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hv 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hv/hv_balloon.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hv/hv_utils.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hv/hv_vmbus.ko 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon 2023-12-04T10:27:20.531 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/abituguru.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/abituguru3.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ad7414.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ad7418.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adc128d818.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm1025.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm1026.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm1029.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm1031.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm9240.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ads7828.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7410.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7411.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7462.ko 2023-12-04T10:27:20.532 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7470.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7475.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7x10.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/amc6821.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/applesmc.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/asb100.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/asc7621.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/atxp1.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/coretemp.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/dme1737.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ds1621.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ds620.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/emc1403.ko 2023-12-04T10:27:20.533 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/emc6w201.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/f71805f.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/f71882fg.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/f75375s.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/fam15h_power.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/fschmd.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/g760a.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/g762.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/gl518sm.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/gl520sm.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/i5500_temp.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/i5k_amb.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ibmaem.ko 2023-12-04T10:27:20.534 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ibmpex.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ina209.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ina2xx.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/it87.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/k10temp.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/k8temp.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lineage-pem.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm63.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm73.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm75.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm77.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm78.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm80.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm83.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm85.ko 2023-12-04T10:27:20.535 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm87.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm90.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm92.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm93.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm95234.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm95241.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm95245.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc2945.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4151.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4215.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4222.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4245.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4260.ko 2023-12-04T10:27:20.536 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4261.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max16065.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max1619.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max1668.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max197.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max6639.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max6650.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max6697.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/mcp3021.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/nct6683.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/nct6775-core.ko 2023-12-04T10:27:20.537 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/nct6775.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/nct7802.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pc87360.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pc87427.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pcf8591.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-04T10:27:20.538 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/powr1220.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sch5627.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sch5636.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sht15.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sht21.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/shtc1.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sis5595.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/smsc47b397.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/smsc47m1.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/smsc47m192.ko 2023-12-04T10:27:20.539 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/thmc50.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/tmp102.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/tmp103.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/tmp401.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/tmp421.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/via-cputemp.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/via686a.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/vt1211.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/vt8231.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83627ehf.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83627hf.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83781d.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83791d.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83792d.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83793.ko 2023-12-04T10:27:20.540 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83795.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83l785ts.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83l786ng.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/algos 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-04T10:27:20.541 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-04T10:27:20.542 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-dev.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-mux.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-smbus.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-stub.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/ib_core.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-04T10:27:20.543 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/cxgb4 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mlx4 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mlx5 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mthca 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/ipoib 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/iser 2023-12-04T10:27:20.544 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/isert 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/srp 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/srpt 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/gameport 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/gameport/gameport.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/joydev.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/keyboard 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-04T10:27:20.545 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/appletouch.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/bcm5974.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/cyapatp.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/sermouse.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/rmi4 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio/altera_ps2.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio/arc_ps2.ko 2023-12-04T10:27:20.546 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio/serio_raw.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/sparse-keymap.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/iommu 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/iommu/amd 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/leds-blinkm.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/leds-lm3530.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/leds-lp3944.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/leds-ss4200.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-04T10:27:20.547 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/bcache 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/bcache/bcache.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-bio-prison.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-cache-smq.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-cache.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-crypt.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-delay.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-flakey.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-log-userspace.ko 2023-12-04T10:27:20.548 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-multipath.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-queue-length.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-raid.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-round-robin.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-service-time.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-switch.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-thin-pool.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-verity.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/faulty.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/linear.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/multipath.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/persistent-data 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/raid0.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/raid1.ko 2023-12-04T10:27:20.549 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/raid10.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/raid456.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptbase.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptctl.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptfc.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptlan.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptsas.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptscsih.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptspi.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/lpc_ich.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/lpc_sch.ko 2023-12-04T10:27:20.550 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/mfd-core.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/sm501.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/viperboard.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/vx855.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/wl1273-core.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/altera-stapl 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/apds9802als.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/apds990x.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/bh1770glc.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/cb710 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/cb710/cb710.ko 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom 2023-12-04T10:27:20.551 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom/at24.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom/max6875.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/enclosure.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/hpilo.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/isl29003.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/isl29020.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/lis3lv02d 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/mei 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/mei/mei-me.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/mei/mei-txe.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/mei/mei.ko 2023-12-04T10:27:20.552 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-gru 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-xp 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/tifm_7xx1.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/tifm_core.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/tsl2550.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/vmw_balloon.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/vmw_vmci 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/bonding 2023-12-04T10:27:20.553 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/bonding/bonding.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/b53 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/mv88e6xxx 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dummy.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/eql.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-04T10:27:20.554 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/adaptec 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/agere 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/alteon 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/altera 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/amd 2023-12-04T10:27:20.555 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/alx 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atlx 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-04T10:27:20.556 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/genet 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/brocade 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/brocade/bna 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-04T10:27:20.557 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/cisco 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/cisco/enic 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-04T10:27:20.558 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dlink 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dnet.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/emulex 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/emulex/benet 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/ethoc.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/fealnx.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e1000 2023-12-04T10:27:20.559 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e1000e 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/fm10k 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/i40e 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/iavf 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/igb 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/igbvf 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-04T10:27:20.560 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/jme.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/marvell 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-04T10:27:20.561 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/micrel 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/myricom 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/natsemi 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/neterion 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/nvidia 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/packetengines 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-04T10:27:20.562 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/rdc 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/rocker 2023-12-04T10:27:20.563 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sfc 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/silan 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sis 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/stmicro 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-04T10:27:20.564 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/tehuti 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/ti 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/via 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/wiznet 2023-12-04T10:27:20.565 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/xircom 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/geneve.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/hyperv 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ieee802154 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ifb.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ipvlan 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/macvlan.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/macvtap.ko 2023-12-04T10:27:20.566 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mii.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/net_failover.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/netconsole.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/nlmon.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/pcs 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/amd.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-04T10:27:20.567 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/bcm87xx.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/broadcom.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/cicada.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/davicom.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/dp83640.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/et1011c.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/icplus.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/lxt.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/marvell.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/micrel.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/national.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/phylink.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/qsemi.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/realtek.ko 2023-12-04T10:27:20.568 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/smsc.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/ste10Xp.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/vitesse.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_async.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/pppoe.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/pppox.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/pptp.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/slip 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/slip/slhc.ko 2023-12-04T10:27:20.569 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/slip/slip.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/sungem_phy.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/tap.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_random.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/tun.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/veth.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/virtio_net.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/vmxnet3 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-04T10:27:20.570 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/vxlan 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/vxlan/vxlan.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/xen-netback 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/xen-netfront.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ntb 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ntb/ntb.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/nvme 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/nvme/host 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/nvme/host/nvme-core.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/nvme/host/nvme.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport/parport.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport/parport_cs.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport/parport_pc.ko 2023-12-04T10:27:20.571 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport/parport_serial.ko 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/hotplug 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/pcie 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/xen-pcifront.ko 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pcmcia 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pcmcia/i82092.ko 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pcmcia/pd6729.ko 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pinctrl 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pinctrl/intel 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform 2023-12-04T10:27:20.572 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/acerhdf.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/hdaps.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/intel 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-04T10:27:20.573 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/intel_ips.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/wmi.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/powercap 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps 2023-12-04T10:27:20.574 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/clients 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/clients/pps_parport.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/pps_core.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ptp 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ptp/ptp.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ptp/ptp_kvm.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-04T10:27:20.575 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-em3027.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-max6900.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-04T10:27:20.576 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-x1205.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/3w-9xxx.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/3w-sas.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/3w-xxxx.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/BusLogic.ko 2023-12-04T10:27:20.577 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/a100u2w.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aacraid 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/advansys.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aic7xxx 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/am53c974.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/arcmsr 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/atp870u.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/be2iscsi 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bfa 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bfa/bfa.ko 2023-12-04T10:27:20.578 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bnx2fc 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bnx2i 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/ch.ko 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/csiostor 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/dc395x.ko 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler 2023-12-04T10:27:20.579 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/dmx3191d.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/esas2r 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/esp_scsi.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fcoe 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fnic 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fnic/fnic.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/hpsa.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/hptiop.ko 2023-12-04T10:27:20.580 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/hv_storvsc.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/initio.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/ipr.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/ips.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/isci 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/isci/isci.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libfc 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libfc/libfc.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libiscsi.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libsas 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libsas/libsas.ko 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/lpfc 2023-12-04T10:27:20.581 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mpt3sas 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mvsas 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mvumi.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/pm8001 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/pmcraid.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla1280.ko 2023-12-04T10:27:20.582 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla2xxx 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla4xxx 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/raid_class.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_debug.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/ses.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/st.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/stex.ko 2023-12-04T10:27:20.583 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/sym53c8xx_2 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/virtio_scsi.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/wd719x.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ssb 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ssb/ssb.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/iscsi 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/loopback 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_file.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_iblock.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_mod.ko 2023-12-04T10:27:20.584 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_pscsi.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_user.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/tcm_fc 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-04T10:27:20.585 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/ipwireless 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/n_gsm.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/n_hdlc.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/nozomi.ko 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/8250 2023-12-04T10:27:20.586 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/arc_uart.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/jsm 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs/core 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs/host 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio_aec.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio_cif.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio_pci_generic.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio_sercos3.ko 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb 2023-12-04T10:27:20.587 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class/cdc-acm.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class/usblp.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class/usbtmc.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/host 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/image 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/image/mdc800.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/image/microtek.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/adutux.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/appledisplay.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/emi26.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/emi62.ko 2023-12-04T10:27:20.588 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/ezusb.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/idmouse.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/iowarrior.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/ldusb.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/legousbtower.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/sisusbvga 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/usb3503.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/usblcd.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/uss720.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/yurex.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/phy 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/phy/phy-generic.ko 2023-12-04T10:27:20.589 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/aircable.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ark3116.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ch341.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/cp210x.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/cyberjack.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/empeg.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/io_ti.ko 2023-12-04T10:27:20.590 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ipaq.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ipw.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ir-usb.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/keyspan.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/mct_u232.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/mos7720.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/mos7840.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/navman.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/omninet.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/opticon.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/option.ko 2023-12-04T10:27:20.591 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/oti6858.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/pl2303.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/qcaux.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/qcserial.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/quatech2.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/safe_serial.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/sierra.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ssu100.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/symbolserial.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/usb_debug.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/visor.ko 2023-12-04T10:27:20.592 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/whiteheat.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/uas.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-karma.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-04T10:27:20.593 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/usb-storage.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/usbip 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/pci 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/vfio.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost/vhost.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-04T10:27:20.594 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost/vhost_net.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost/vhost_scsi.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video/backlight 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video/backlight/apple_bl.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video/backlight/lcd.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_balloon.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_mmio.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_pci.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_ring.ko 2023-12-04T10:27:20.595 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/masters 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/masters/ds2482.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/masters/ds2490.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-04T10:27:20.596 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/wire.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/hpwdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/i6300esb.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/ib700wdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/ibmasr.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/it87_wdt.ko 2023-12-04T10:27:20.597 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/machzwd.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/nv_tco.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/softdog.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/via_wdt.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/wdt_pci.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/xen_wdt.ko 2023-12-04T10:27:20.598 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-evtchn.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-gntalloc.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-gntdev.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-pciback 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-privcmd.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xenfs 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/9p 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/9p/9p.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/affs 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/affs/affs.ko 2023-12-04T10:27:20.599 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/befs 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/befs/befs.ko 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/binfmt_misc.ko 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/btrfs 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/btrfs/btrfs.ko 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/cachefiles 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/cachefiles/cachefiles.ko 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ceph 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ceph/ceph.ko 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/coda 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/coda/coda.ko 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/cramfs 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/cramfs/cramfs.ko 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/dlm 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/dlm/dlm.ko 2023-12-04T10:27:20.600 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ecryptfs 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/f2fs 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/f2fs/f2fs.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fat 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fat/fat.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fat/msdos.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fat/vfat.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fscache 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fscache/fscache.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fuse 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fuse/cuse.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fuse/fuse.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/gfs2 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/gfs2/gfs2.ko 2023-12-04T10:27:20.601 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/hfs 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/hfs/hfs.ko 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/hfsplus 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/hfsplus/hfsplus.ko 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/isofs 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/isofs/isofs.ko 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/jfs 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/jfs/jfs.ko 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/lockd 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/lockd/lockd.ko 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/minix 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/minix/minix.ko 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/netfs 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/netfs/netfs.ko 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs 2023-12-04T10:27:20.602 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/blocklayout 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/filelayout 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/flexfilelayout 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/nfs.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/nfsv3.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/nfsv4.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs_common 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs_common/grace.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs_common/nfs_acl.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfsd 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfsd/nfsd.ko 2023-12-04T10:27:20.603 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nilfs2 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nilfs2/nilfs2.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-celtic.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-centeuro.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-croatian.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-cyrillic.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-gaelic.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-greek.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-iceland.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-inuit.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-roman.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-romanian.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-turkish.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp1250.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp1251.ko 2023-12-04T10:27:20.604 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp1255.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp737.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp775.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp850.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp852.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp855.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp857.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp860.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp861.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp862.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp863.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp864.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp865.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp866.ko 2023-12-04T10:27:20.605 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp869.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp874.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp932.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp936.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp949.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp950.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_euc-jp.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-1.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-13.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-14.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-15.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-2.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-3.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-4.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-5.ko 2023-12-04T10:27:20.606 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-6.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-7.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-9.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_koi8-r.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_koi8-ru.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_koi8-u.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_utf8.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/cluster 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/dlm 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/dlmfs 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-04T10:27:20.607 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/ocfs2.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/overlayfs 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/overlayfs/overlay.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/pstore 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/pstore/ramoops.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/reiserfs 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/reiserfs/reiserfs.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/romfs 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/romfs/romfs.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/client 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/client/cifs.ko 2023-12-04T10:27:20.608 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/common 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/common/cifs_arc4.ko 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/common/cifs_md4.ko 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/squashfs 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/squashfs/squashfs.ko 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/sysv 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/sysv/sysv.ko 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/udf 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/udf/udf.ko 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ufs 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ufs/ufs.ko 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/xfs 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/xfs/xfs.ko 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/rcu 2023-12-04T10:27:20.609 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/rcu/rcutorture.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/torture.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/trace 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/asn1_encoder.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crc-itu-t.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crc8.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crypto 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crypto/libarc4.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crypto/libdes.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/libcrc32c.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/lru_cache.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/lz4 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/lz4/lz4_compress.ko 2023-12-04T10:27:20.610 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/lz4/lz4hc_compress.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/math 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/math/cordic.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/raid6 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/raid6/raid6_pq.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/reed_solomon 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/ts_bm.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/ts_fsm.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/ts_kmp.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/zstd 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/zstd/zstd_compress.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/mm 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/mm/hwpoison-inject.ko 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net 2023-12-04T10:27:20.611 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/6lowpan.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_dest.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_fragment.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_hop.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_mobility.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_routing.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_udp.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/garp.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/mrp.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/p8022.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/psnap.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/stp.ko 2023-12-04T10:27:20.612 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/8021q 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/8021q/8021q.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p/9pnet.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p/9pnet_fd.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p/9pnet_rdma.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p/9pnet_virtio.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/batman-adv 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/batman-adv/batman-adv.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/br_netfilter.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/bridge.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-04T10:27:20.613 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-04T10:27:20.614 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebtables.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ceph 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ceph/libceph.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/core 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/core/failover.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/core/pktgen.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp/dccp.ko 2023-12-04T10:27:20.615 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp/dccp_diag.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp/dccp_ipv4.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp/dccp_ipv6.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dns_resolver 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dns_resolver/dns_resolver.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/dsa_core.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/tag_brcm.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/tag_dsa.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/tag_none.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/tag_trailer.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154/6lowpan 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154/ieee802154.ko 2023-12-04T10:27:20.616 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ah4.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/esp4.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/fou.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/gre.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/inet_diag.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ip_gre.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ip_tunnel.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ip_vti.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ipcomp.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ipip.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-04T10:27:20.617 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-04T10:27:20.618 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_bic.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_dctcp.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_diag.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_highspeed.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_htcp.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_hybla.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_illinois.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_lp.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_scalable.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_vegas.ko 2023-12-04T10:27:20.619 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_veno.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_westwood.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_yeah.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tunnel4.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/udp_diag.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/udp_tunnel.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ah6.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/esp6.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/fou6.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ip6_tunnel.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ip6_vti.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ipcomp6.ko 2023-12-04T10:27:20.620 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-04T10:27:20.621 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/sit.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/tunnel6.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/key 2023-12-04T10:27:20.622 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/key/af_key.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_core.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_eth.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_ip.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_ip6.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_netlink.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_ppp.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/llc 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/llc/llc.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/mac802154 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/mac802154/mac802154.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/mpls 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/mpls/mpls_gso.ko 2023-12-04T10:27:20.623 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-04T10:27:20.624 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-04T10:27:20.625 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conncount.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-04T10:27:20.626 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_flow_table.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_log_syslog.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_irc.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_sip.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_tables.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink.ko 2023-12-04T10:27:20.627 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink_log.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_chain_nat.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_compat.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_ct.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_fib.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_hash.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_limit.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_log.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_masq.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_nat.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_numgen.ko 2023-12-04T10:27:20.628 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_queue.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_quota.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_redir.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_reject.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_reject_inet.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_socket.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_tunnel.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_AUDIT.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_CT.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_DSCP.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_HL.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_HMARK.ko 2023-12-04T10:27:20.629 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_LED.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_LOG.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_NETMAP.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_NFLOG.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_RATEEST.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_SECMARK.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TEE.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TPROXY.ko 2023-12-04T10:27:20.630 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TRACE.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_addrtype.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_bpf.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_cgroup.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_cluster.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_comment.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_connbytes.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_connlabel.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_connlimit.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_connmark.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_conntrack.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_cpu.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_dccp.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_devgroup.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_dscp.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_ecn.ko 2023-12-04T10:27:20.631 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_esp.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_hashlimit.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_helper.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_hl.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_ipcomp.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_iprange.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_ipvs.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_l2tp.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_length.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_limit.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_mac.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_mark.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_multiport.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_nat.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_nfacct.ko 2023-12-04T10:27:20.632 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_osf.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_owner.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_physdev.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_pkttype.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_policy.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_quota.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_rateest.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_realm.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_recent.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_sctp.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_set.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_socket.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_state.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_statistic.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_string.ko 2023-12-04T10:27:20.633 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_tcpmss.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_time.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_u32.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netlink 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netlink/netlink_diag.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/nsh 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/nsh/nsh.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch/openvswitch.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch/vport-geneve.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch/vport-gre.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch/vport-vxlan.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/packet 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/packet/af_packet_diag.ko 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/rds 2023-12-04T10:27:20.634 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/rds/rds.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/rds/rds_rdma.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/rds/rds_tcp.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_csum.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_gact.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_ipt.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_mirred.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_nat.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_pedit.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_police.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_simple.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_skbedit.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_vlan.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_basic.ko 2023-12-04T10:27:20.635 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_bpf.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_flow.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_fw.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_route.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_u32.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_cmp.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_ipset.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_meta.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_nbyte.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_text.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_u32.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_choke.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_codel.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_drr.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_fq.ko 2023-12-04T10:27:20.636 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_gred.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_hfsc.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_hhf.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_htb.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_ingress.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_mqprio.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_mqprio_lib.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_multiq.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_netem.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_pie.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_plug.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_prio.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_qfq.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_red.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_sfb.ko 2023-12-04T10:27:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_sfq.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_tbf.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_teql.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sctp 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sctp/sctp.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sctp/sctp_diag.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/auth_gss 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/sunrpc.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/xprtrdma 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/tipc 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/tipc/diag.ko 2023-12-04T10:27:20.638 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/tipc/tipc.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/unix 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/unix/unix_diag.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vsock.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/xfrm 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys/encrypted-keys 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-04T10:27:20.639 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys/trusted-keys 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys/trusted-keys/trusted.ko 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/virt 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/virt/lib 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/virt/lib/irqbypass.ko 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.alias 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.alias.bin 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.builtin 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.builtin.alias.bin 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.builtin.bin 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.builtin.modinfo 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.dep 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.dep.bin 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.devname 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.order 2023-12-04T10:27:20.640 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.softdep 2023-12-04T10:27:20.641 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.symbols 2023-12-04T10:27:20.641 INFO:teuthology.orchestra.run.smithi063.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.symbols.bin 2023-12-04T10:27:20.641 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g9c0b943f8476 2023-12-04T10:27:20.641 DEBUG:teuthology.orchestra.run.smithi063:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-04T10:27:20.667 INFO:teuthology.orchestra.run.smithi063.stdout:postinstall scriptlet (using /bin/sh): 2023-12-04T10:27:20.668 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g9c0b943f8476 -a -r /boot/System.map-6.6.0-g9c0b943f8476 ]; then 2023-12-04T10:27:20.668 INFO:teuthology.orchestra.run.smithi063.stdout:cp /boot/vmlinuz-6.6.0-g9c0b943f8476 /boot/.vmlinuz-6.6.0-g9c0b943f8476-rpm 2023-12-04T10:27:20.668 INFO:teuthology.orchestra.run.smithi063.stdout:cp /boot/System.map-6.6.0-g9c0b943f8476 /boot/.System.map-6.6.0-g9c0b943f8476-rpm 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:rm -f /boot/vmlinuz-6.6.0-g9c0b943f8476 /boot/System.map-6.6.0-g9c0b943f8476 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/installkernel 6.6.0-g9c0b943f8476 /boot/.vmlinuz-6.6.0-g9c0b943f8476-rpm /boot/.System.map-6.6.0-g9c0b943f8476-rpm 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:rm -f /boot/.vmlinuz-6.6.0-g9c0b943f8476-rpm /boot/.System.map-6.6.0-g9c0b943f8476-rpm 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:new-kernel-pkg --remove 6.6.0-g9c0b943f8476 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g9c0b943f8476.img 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-04T10:27:20.669 INFO:teuthology.orchestra.run.smithi063.stdout:kernel-install remove 6.6.0-g9c0b943f8476 2023-12-04T10:27:20.670 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2023-12-04T10:27:20.670 INFO:teuthology.orchestra.run.smithi063.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-04T10:27:20.670 INFO:teuthology.orchestra.run.smithi063.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-04T10:27:20.670 INFO:teuthology.orchestra.run.smithi063.stdout:/sbin/update-bootloader --remove 6.6.0-g9c0b943f8476 2023-12-04T10:27:20.670 INFO:teuthology.orchestra.run.smithi063.stdout:fi 2023-12-04T10:27:20.671 DEBUG:teuthology.orchestra.run.smithi063:> sudo rpm -qi grub2-tools 2023-12-04T10:27:20.755 INFO:teuthology.orchestra.run.smithi063.stdout:Name : grub2-tools 2023-12-04T10:27:20.755 INFO:teuthology.orchestra.run.smithi063.stdout:Epoch : 1 2023-12-04T10:27:20.755 INFO:teuthology.orchestra.run.smithi063.stdout:Version : 2.06 2023-12-04T10:27:20.755 INFO:teuthology.orchestra.run.smithi063.stdout:Release : 68.el9 2023-12-04T10:27:20.755 INFO:teuthology.orchestra.run.smithi063.stdout:Architecture: x86_64 2023-12-04T10:27:20.756 INFO:teuthology.orchestra.run.smithi063.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-04T10:27:20.756 INFO:teuthology.orchestra.run.smithi063.stdout:Group : Unspecified 2023-12-04T10:27:20.756 INFO:teuthology.orchestra.run.smithi063.stdout:Size : 8264254 2023-12-04T10:27:20.756 INFO:teuthology.orchestra.run.smithi063.stdout:License : GPLv3+ 2023-12-04T10:27:20.756 INFO:teuthology.orchestra.run.smithi063.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-04T10:27:20.756 INFO:teuthology.orchestra.run.smithi063.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-04T10:27:20.756 INFO:teuthology.orchestra.run.smithi063.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-04T10:27:20.756 INFO:teuthology.orchestra.run.smithi063.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:Packager : builder@centos.org 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:Vendor : CentOS 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:Summary : Support tools for GRUB. 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:Description : 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:hardware devices. 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:27:20.757 INFO:teuthology.orchestra.run.smithi063.stdout:This subpackage provides tools for support of all platforms. 2023-12-04T10:27:20.758 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-04T10:27:20.759 INFO:teuthology.task.kernel:Updating grub on smithi063 to boot 6.6.0-g9c0b943f8476 2023-12-04T10:27:20.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-04T10:27:21.374 INFO:teuthology.orchestra.run.smithi063.stderr:Generating grub configuration file ... 2023-12-04T10:27:22.821 INFO:teuthology.orchestra.run.smithi063.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-04T10:27:22.842 INFO:teuthology.orchestra.run.smithi063.stderr:done 2023-12-04T10:27:22.845 DEBUG:teuthology.orchestra.run.smithi063:> mktemp 2023-12-04T10:27:22.860 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.DUcpBf0nIK 2023-12-04T10:27:22.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.DUcpBf0nIK 2023-12-04T10:27:22.933 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0666 /tmp/tmp.DUcpBf0nIK 2023-12-04T10:27:23.076 DEBUG:teuthology.orchestra.remote:smithi063:/tmp/tmp.DUcpBf0nIK is 6KB 2023-12-04T10:27:23.126 DEBUG:teuthology.orchestra.run.smithi063:> rm -fr /tmp/tmp.DUcpBf0nIK 2023-12-04T10:27:23.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo /bin/ls /boot/loader/entries || true 2023-12-04T10:27:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-04T10:27:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-04T10:27:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-04T10:27:23.209 INFO:teuthology.orchestra.run.smithi063.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g9c0b943f8476.conf 2023-12-04T10:27:23.210 DEBUG:teuthology.orchestra.run.smithi063:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g9c0b943f8476 2023-12-04T10:27:23.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo shutdown -r now 2023-12-04T10:27:33.577 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi066.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-04T10:27:33.578 DEBUG:teuthology.orchestra.run.smithi066:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-04T10:27:33.661 INFO:teuthology.orchestra.run.smithi066.stdout:/boot/System.map-6.6.0-g9c0b943f8476 2023-12-04T10:27:33.661 INFO:teuthology.orchestra.run.smithi066.stdout:/boot/config-6.6.0-g9c0b943f8476 2023-12-04T10:27:33.661 INFO:teuthology.orchestra.run.smithi066.stdout:/boot/vmlinuz-6.6.0-g9c0b943f8476 2023-12-04T10:27:33.661 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476 2023-12-04T10:27:33.661 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel 2023-12-04T10:27:33.661 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-04T10:27:33.662 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kernel 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kernel/cpu 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kernel/cpu/mce 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kvm 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-04T10:27:33.663 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/arch/x86/kvm/kvm.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/ansi_cprng.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/anubis.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/arc4.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_memcpy.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_pq.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_tx.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/async_xor.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/async_tx/raid6test.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/authenc.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/authencesn.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/blake2b_generic.ko 2023-12-04T10:27:33.664 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/blowfish_common.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/blowfish_generic.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/camellia_generic.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cast5_generic.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cast6_generic.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cast_common.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/ccm.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cmac.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/crc32_generic.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/crypto_engine.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/crypto_user.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/cts.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/des_generic.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/dh_generic.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/echainiv.ko 2023-12-04T10:27:33.665 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/essiv.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/fcrypt.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/khazad.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/lz4.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/lz4hc.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/md4.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/michael_mic.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/pcbc.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/pcrypt.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/rmd160.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/seed.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/serpent_generic.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/tcrypt.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/tea.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/twofish_common.ko 2023-12-04T10:27:33.666 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/twofish_generic.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/vmac.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/wp512.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/xcbc.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/xor.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/crypto/xxhash_generic.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/acpi_pad.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/custom_method.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/ec_sys.ko 2023-12-04T10:27:33.667 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/platform_profile.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/sbs.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/sbshc.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/acpi/video.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/acard-ahci.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/ahci_platform.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/ata_generic.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/libahci_platform.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_acpi.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_ali.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_amd.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_artop.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_atiixp.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_atp867x.ko 2023-12-04T10:27:33.668 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_cmd640.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_cmd64x.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_cypress.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_efar.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_hpt366.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_hpt37x.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_it8213.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_it821x.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_jmicron.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_marvell.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_mpiix.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_netcell.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_ninja32.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_ns87410.ko 2023-12-04T10:27:33.669 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_ns87415.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_oldpiix.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_opti.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_optidma.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_pcmcia.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_piccolo.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_rdc.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_sch.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_serverworks.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_sil680.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_sis.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_sl82c105.ko 2023-12-04T10:27:33.670 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_triflex.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pata_via.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/pdc_adma.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_inic162x.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_mv.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_nv.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_promise.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_qstor.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_sil.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_sil24.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_sis.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_svw.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_sx4.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_uli.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_via.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ata/sata_vsc.ko 2023-12-04T10:27:33.671 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/auxdisplay 2023-12-04T10:27:33.672 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/auxdisplay/ks0108.ko 2023-12-04T10:27:33.672 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/base 2023-12-04T10:27:33.672 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/base/regmap 2023-12-04T10:27:33.672 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/bcma 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/bcma/bcma.ko 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/aoe 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/aoe/aoe.ko 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/brd.ko 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/drbd 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/drbd/drbd.ko 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/floppy.ko 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/loop.ko 2023-12-04T10:27:33.673 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/mtip32xx 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/nbd.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/null_blk 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/null_blk/null_blk.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/pktcdvd.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/rbd.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/virtio_blk.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/xen-blkback 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/xen-blkfront.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/zram 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/block/zram/zram.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hangcheck-timer.ko 2023-12-04T10:27:33.674 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/via-rng.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/lp.ko 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/mwave 2023-12-04T10:27:33.675 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/mwave/mwave.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/ppdev.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tlclk.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/uv_mmtimer.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/char/virtio_console.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-04T10:27:33.676 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/ccp 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/ccp/ccp.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat/qat_common 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/padlock-aes.ko 2023-12-04T10:27:33.677 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/padlock-sha.ko 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/virtio 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dca 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dca/dca.ko 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/devfreq 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma/dw 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma/ioat 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/amd64_edac.ko 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/e752x_edac.ko 2023-12-04T10:27:33.678 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/edac_mce_amd.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i3000_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i3200_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i5100_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i5400_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i7300_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i7core_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/i82975x_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/ie31200_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/sb_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/edac/x38_edac.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/firmware 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/firmware/edd.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/gpio 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/gpio/gpio-ich.ko 2023-12-04T10:27:33.679 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-appleir.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-aureal.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-axff.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-dr.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-elecom.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-elo.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-emsff.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-gaff.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-gt683r.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-gyration.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-holtekff.ko 2023-12-04T10:27:33.680 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-hyperv.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-icade.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-keytouch.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-kye.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-lcpower.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-led.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-lenovo.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-multitouch.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-ortek.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-penmount.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-petalynx.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-picolcd.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-pl.ko 2023-12-04T10:27:33.681 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-plantronics.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-primax.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-rmi.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-common.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-roccat.ko 2023-12-04T10:27:33.682 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-saitek.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-samsung.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-sjoy.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-sony.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-speedlink.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-steelseries.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-sunplus.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-tivo.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-tmff.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-topseed.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-twinhan.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-uclogic.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-waltop.ko 2023-12-04T10:27:33.683 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-wiimote.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-xinmo.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-zpff.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/hid-zydacron.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/uhid.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hid/wacom.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hv 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hv/hv_balloon.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hv/hv_utils.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hv/hv_vmbus.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/abituguru.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/abituguru3.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ad7414.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ad7418.ko 2023-12-04T10:27:33.684 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adc128d818.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm1025.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm1026.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm1029.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm1031.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adm9240.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ads7828.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7410.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7411.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7462.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7470.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7475.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/adt7x10.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/amc6821.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/applesmc.ko 2023-12-04T10:27:33.685 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/asb100.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/asc7621.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/atxp1.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/coretemp.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/dme1737.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ds1621.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ds620.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/emc1403.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/emc6w201.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/f71805f.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/f71882fg.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/f75375s.ko 2023-12-04T10:27:33.686 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/fam15h_power.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/fschmd.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/g760a.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/g762.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/gl518sm.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/gl520sm.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/i5500_temp.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/i5k_amb.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ibmaem.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ibmpex.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ina209.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ina2xx.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/it87.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/k10temp.ko 2023-12-04T10:27:33.687 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/k8temp.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lineage-pem.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm63.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm73.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm75.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm77.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm78.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm80.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm83.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm85.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm87.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm90.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm92.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm93.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm95234.ko 2023-12-04T10:27:33.688 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm95241.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/lm95245.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc2945.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4151.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4215.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4222.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4245.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4260.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/ltc4261.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max16065.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max1619.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max1668.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max197.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max6639.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max6650.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/max6697.ko 2023-12-04T10:27:33.689 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/mcp3021.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/nct6683.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/nct6775-core.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/nct6775.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/nct7802.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pc87360.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pc87427.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pcf8591.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-04T10:27:33.690 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/powr1220.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sch5627.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sch5636.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sht15.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sht21.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/shtc1.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/sis5595.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/smsc47b397.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/smsc47m1.ko 2023-12-04T10:27:33.691 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/smsc47m192.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/thmc50.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/tmp102.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/tmp103.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/tmp401.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/tmp421.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/via-cputemp.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/via686a.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/vt1211.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/vt8231.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83627ehf.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83627hf.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83781d.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83791d.ko 2023-12-04T10:27:33.692 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83792d.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83793.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83795.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83l785ts.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/hwmon/w83l786ng.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/algos 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-04T10:27:33.693 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-04T10:27:33.694 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-dev.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-mux.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-smbus.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/i2c/i2c-stub.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/ib_core.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-04T10:27:33.695 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/cxgb4 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mlx4 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mlx5 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mthca 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/ipoib 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/iser 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/isert 2023-12-04T10:27:33.696 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/srp 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/srpt 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/gameport 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/gameport/gameport.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/joydev.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/keyboard 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/appletouch.ko 2023-12-04T10:27:33.697 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/bcm5974.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/cyapatp.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/sermouse.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/rmi4 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio/altera_ps2.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio/arc_ps2.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/serio/serio_raw.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/input/sparse-keymap.ko 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/iommu 2023-12-04T10:27:33.698 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/iommu/amd 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/leds-blinkm.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/leds-lm3530.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/leds-lp3944.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/leds-ss4200.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-04T10:27:33.699 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/bcache 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/bcache/bcache.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-bio-prison.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-cache-smq.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-cache.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-crypt.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-delay.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-flakey.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-log-userspace.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-multipath.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-queue-length.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-raid.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-round-robin.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-service-time.ko 2023-12-04T10:27:33.700 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-switch.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-thin-pool.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/dm-verity.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/faulty.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/linear.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/multipath.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/persistent-data 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/raid0.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/raid1.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/raid10.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/md/raid456.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptbase.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptctl.ko 2023-12-04T10:27:33.701 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptfc.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptlan.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptsas.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptscsih.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/message/fusion/mptspi.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/lpc_ich.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/lpc_sch.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/mfd-core.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/sm501.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/viperboard.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/vx855.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/mfd/wl1273-core.ko 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/altera-stapl 2023-12-04T10:27:33.702 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/apds9802als.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/apds990x.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/bh1770glc.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/cb710 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/cb710/cb710.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom/at24.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/eeprom/max6875.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/enclosure.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/hpilo.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/isl29003.ko 2023-12-04T10:27:33.703 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/isl29020.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/lis3lv02d 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/mei 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/mei/mei-me.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/mei/mei-txe.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/mei/mei.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-gru 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-xp 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/tifm_7xx1.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/tifm_core.ko 2023-12-04T10:27:33.704 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/tsl2550.ko 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/vmw_balloon.ko 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/vmw_vmci 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/bonding 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/bonding/bonding.ko 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/b53 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-04T10:27:33.705 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/mv88e6xxx 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/dummy.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/eql.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-04T10:27:33.706 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/adaptec 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/agere 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/alteon 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/altera 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/amd 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/alx 2023-12-04T10:27:33.707 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atlx 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-04T10:27:33.708 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/genet 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/brocade 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/brocade/bna 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-04T10:27:33.709 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/cisco 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/cisco/enic 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dlink 2023-12-04T10:27:33.710 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/dnet.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/emulex 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/emulex/benet 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/ethoc.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/fealnx.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e1000 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e1000e 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/fm10k 2023-12-04T10:27:33.711 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/i40e 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/iavf 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/igb 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/igbvf 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/jme.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/marvell 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-04T10:27:33.712 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/micrel 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/myricom 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/natsemi 2023-12-04T10:27:33.713 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/neterion 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/nvidia 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/packetengines 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-04T10:27:33.714 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/rdc 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/rocker 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sfc 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/silan 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sis 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-04T10:27:33.715 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/stmicro 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-04T10:27:33.716 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/tehuti 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/ti 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/via 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/wiznet 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/xircom 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/geneve.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/hyperv 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ieee802154 2023-12-04T10:27:33.717 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ifb.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ipvlan 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/macvlan.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/macvtap.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/mii.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/net_failover.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/netconsole.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/nlmon.ko 2023-12-04T10:27:33.718 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/pcs 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/amd.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/bcm87xx.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/broadcom.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/cicada.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/davicom.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/dp83640.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/et1011c.ko 2023-12-04T10:27:33.719 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/icplus.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/lxt.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/marvell.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/micrel.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/national.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/phylink.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/qsemi.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/realtek.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/smsc.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/ste10Xp.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/phy/vitesse.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_async.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-04T10:27:33.720 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/pppoe.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/pppox.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/ppp/pptp.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/slip 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/slip/slhc.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/slip/slip.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/sungem_phy.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/tap.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_random.ko 2023-12-04T10:27:33.721 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/tun.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/veth.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/virtio_net.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/vmxnet3 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/vxlan 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/vxlan/vxlan.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/xen-netback 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/net/xen-netfront.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ntb 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ntb/ntb.ko 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/nvme 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/nvme/host 2023-12-04T10:27:33.722 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/nvme/host/nvme-core.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/nvme/host/nvme.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport/parport.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport/parport_cs.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport/parport_pc.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/parport/parport_serial.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/hotplug 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/pcie 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pci/xen-pcifront.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pcmcia 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pcmcia/i82092.ko 2023-12-04T10:27:33.723 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pcmcia/pd6729.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pinctrl 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pinctrl/intel 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/acerhdf.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-04T10:27:33.724 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/hdaps.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/intel 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/intel_ips.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-04T10:27:33.725 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/platform/x86/wmi.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/powercap 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/clients 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/clients/pps_parport.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/pps/pps_core.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ptp 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ptp/ptp.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ptp/ptp_kvm.ko 2023-12-04T10:27:33.726 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-em3027.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-04T10:27:33.727 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-max6900.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-04T10:27:33.728 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/rtc/rtc-x1205.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/3w-9xxx.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/3w-sas.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/3w-xxxx.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/BusLogic.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/a100u2w.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aacraid 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/advansys.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aic7xxx 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/am53c974.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/arcmsr 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-04T10:27:33.729 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/atp870u.ko 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/be2iscsi 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bfa 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bfa/bfa.ko 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bnx2fc 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bnx2i 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/ch.ko 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/csiostor 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-04T10:27:33.730 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/dc395x.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/dmx3191d.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/esas2r 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/esp_scsi.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fcoe 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-04T10:27:33.731 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fnic 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/fnic/fnic.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/hpsa.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/hptiop.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/hv_storvsc.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/initio.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/ipr.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/ips.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/isci 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/isci/isci.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libfc 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libfc/libfc.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libiscsi.ko 2023-12-04T10:27:33.732 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libsas 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/libsas/libsas.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/lpfc 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mpt3sas 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mvsas 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/mvumi.ko 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/pm8001 2023-12-04T10:27:33.733 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/pmcraid.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla1280.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla2xxx 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla4xxx 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/raid_class.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_debug.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-04T10:27:33.734 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/ses.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/st.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/stex.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/sym53c8xx_2 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/virtio_scsi.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/scsi/wd719x.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ssb 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ssb/ssb.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/iscsi 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/loopback 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-04T10:27:33.735 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_file.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_iblock.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_mod.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_pscsi.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/target_core_user.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/tcm_fc 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-04T10:27:33.736 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/ipwireless 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-04T10:27:33.737 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/n_gsm.ko 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/n_hdlc.ko 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/nozomi.ko 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/8250 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/arc_uart.ko 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/jsm 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs/core 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs/host 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-04T10:27:33.738 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio_aec.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio_cif.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio_pci_generic.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/uio/uio_sercos3.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class/cdc-acm.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class/usblp.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/class/usbtmc.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/host 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/image 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/image/mdc800.ko 2023-12-04T10:27:33.739 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/image/microtek.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/adutux.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/appledisplay.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/emi26.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/emi62.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/ezusb.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/idmouse.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/iowarrior.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/ldusb.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/legousbtower.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/sisusbvga 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/usb3503.ko 2023-12-04T10:27:33.740 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/usblcd.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/uss720.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/misc/yurex.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/phy 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/phy/phy-generic.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/aircable.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ark3116.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ch341.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/cp210x.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/cyberjack.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-04T10:27:33.741 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/empeg.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/io_ti.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ipaq.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ipw.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ir-usb.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/keyspan.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/mct_u232.ko 2023-12-04T10:27:33.742 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/mos7720.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/mos7840.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/navman.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/omninet.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/opticon.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/option.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/oti6858.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/pl2303.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/qcaux.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/qcserial.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/quatech2.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/safe_serial.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/sierra.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ssu100.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/symbolserial.ko 2023-12-04T10:27:33.743 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/usb_debug.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/visor.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/whiteheat.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/uas.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-04T10:27:33.744 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-karma.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/storage/usb-storage.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/usbip 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/pci 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-04T10:27:33.745 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/vfio.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost/vhost.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost/vhost_net.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/vhost/vhost_scsi.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video/backlight 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video/backlight/apple_bl.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video/backlight/lcd.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio.ko 2023-12-04T10:27:33.746 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_balloon.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_mmio.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_pci.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/virtio/virtio_ring.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/masters 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/masters/ds2482.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/masters/ds2490.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-04T10:27:33.747 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/w1/wire.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/hpwdt.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/i6300esb.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-04T10:27:33.748 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/ib700wdt.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/ibmasr.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/it87_wdt.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/machzwd.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/nv_tco.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/softdog.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/via_wdt.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-04T10:27:33.749 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/wdt_pci.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/watchdog/xen_wdt.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-evtchn.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-gntalloc.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-gntdev.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-pciback 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xen-privcmd.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xenfs 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs 2023-12-04T10:27:33.750 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/9p 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/9p/9p.ko 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/affs 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/affs/affs.ko 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/befs 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/befs/befs.ko 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/binfmt_misc.ko 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/btrfs 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/btrfs/btrfs.ko 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/cachefiles 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/cachefiles/cachefiles.ko 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ceph 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ceph/ceph.ko 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/coda 2023-12-04T10:27:33.751 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/coda/coda.ko 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/cramfs 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/cramfs/cramfs.ko 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/dlm 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/dlm/dlm.ko 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ecryptfs 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/f2fs 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/f2fs/f2fs.ko 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fat 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fat/fat.ko 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fat/msdos.ko 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fat/vfat.ko 2023-12-04T10:27:33.752 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fscache 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fscache/fscache.ko 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fuse 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fuse/cuse.ko 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/fuse/fuse.ko 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/gfs2 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/gfs2/gfs2.ko 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/hfs 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/hfs/hfs.ko 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/hfsplus 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/hfsplus/hfsplus.ko 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/isofs 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/isofs/isofs.ko 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/jfs 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/jfs/jfs.ko 2023-12-04T10:27:33.753 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/lockd 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/lockd/lockd.ko 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/minix 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/minix/minix.ko 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/netfs 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/netfs/netfs.ko 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/blocklayout 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/filelayout 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/flexfilelayout 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/nfs.ko 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/nfsv3.ko 2023-12-04T10:27:33.754 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs/nfsv4.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs_common 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs_common/grace.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfs_common/nfs_acl.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfsd 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nfsd/nfsd.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nilfs2 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nilfs2/nilfs2.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-celtic.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-centeuro.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-croatian.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-cyrillic.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-gaelic.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-greek.ko 2023-12-04T10:27:33.755 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-iceland.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-inuit.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-roman.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-romanian.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/mac-turkish.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp1250.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp1251.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp1255.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp737.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp775.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp850.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp852.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp855.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp857.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp860.ko 2023-12-04T10:27:33.756 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp861.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp862.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp863.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp864.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp865.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp866.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp869.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp874.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp932.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp936.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp949.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_cp950.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_euc-jp.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-1.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-13.ko 2023-12-04T10:27:33.757 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-14.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-15.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-2.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-3.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-4.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-5.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-6.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-7.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_iso8859-9.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_koi8-r.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_koi8-ru.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_koi8-u.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/nls/nls_utf8.ko 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/cluster 2023-12-04T10:27:33.758 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/dlm 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/dlmfs 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/ocfs2.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/overlayfs 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/overlayfs/overlay.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/pstore 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/pstore/ramoops.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/reiserfs 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/reiserfs/reiserfs.ko 2023-12-04T10:27:33.759 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/romfs 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/romfs/romfs.ko 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/client 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/client/cifs.ko 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/common 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/common/cifs_arc4.ko 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/smb/common/cifs_md4.ko 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/squashfs 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/squashfs/squashfs.ko 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/sysv 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/sysv/sysv.ko 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/udf 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/udf/udf.ko 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ufs 2023-12-04T10:27:33.760 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/ufs/ufs.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/xfs 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/fs/xfs/xfs.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/rcu 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/rcu/rcutorture.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/torture.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/trace 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/asn1_encoder.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crc-itu-t.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crc8.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crypto 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crypto/libarc4.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/crypto/libdes.ko 2023-12-04T10:27:33.761 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/libcrc32c.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/lru_cache.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/lz4 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/lz4/lz4_compress.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/lz4/lz4hc_compress.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/math 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/math/cordic.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/raid6 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/raid6/raid6_pq.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/reed_solomon 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/ts_bm.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/ts_fsm.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/ts_kmp.ko 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/zstd 2023-12-04T10:27:33.762 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/lib/zstd/zstd_compress.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/mm 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/mm/hwpoison-inject.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/6lowpan.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_dest.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_fragment.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_hop.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_mobility.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_routing.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/6lowpan/nhc_udp.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/garp.ko 2023-12-04T10:27:33.763 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/mrp.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/p8022.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/psnap.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/802/stp.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/8021q 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/8021q/8021q.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p/9pnet.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p/9pnet_fd.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p/9pnet_rdma.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/9p/9pnet_virtio.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/batman-adv 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/batman-adv/batman-adv.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/br_netfilter.ko 2023-12-04T10:27:33.764 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/bridge.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-04T10:27:33.765 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/ebtables.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ceph 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ceph/libceph.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/core 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/core/failover.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/core/pktgen.ko 2023-12-04T10:27:33.766 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp/dccp.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp/dccp_diag.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp/dccp_ipv4.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dccp/dccp_ipv6.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dns_resolver 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dns_resolver/dns_resolver.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/dsa_core.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/tag_brcm.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/tag_dsa.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/tag_none.ko 2023-12-04T10:27:33.767 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/dsa/tag_trailer.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154/6lowpan 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154/ieee802154.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ah4.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/esp4.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/fou.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/gre.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/inet_diag.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ip_gre.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ip_tunnel.ko 2023-12-04T10:27:33.768 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ip_vti.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ipcomp.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/ipip.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-04T10:27:33.769 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_bic.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_dctcp.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_diag.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_highspeed.ko 2023-12-04T10:27:33.770 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_htcp.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_hybla.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_illinois.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_lp.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_scalable.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_vegas.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_veno.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_westwood.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tcp_yeah.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/tunnel4.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/udp_diag.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/udp_tunnel.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ah6.ko 2023-12-04T10:27:33.771 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/esp6.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/fou6.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ip6_tunnel.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ip6_vti.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/ipcomp6.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-04T10:27:33.772 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-04T10:27:33.773 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/sit.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/tunnel6.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/key 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/key/af_key.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_core.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_eth.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_ip.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_ip6.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_netlink.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/l2tp/l2tp_ppp.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/llc 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/llc/llc.ko 2023-12-04T10:27:33.774 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/mac802154 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/mac802154/mac802154.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/mpls 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/mpls/mpls_gso.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-04T10:27:33.775 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-04T10:27:33.776 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conncount.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-04T10:27:33.777 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_flow_table.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_log_syslog.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_irc.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_sip.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-04T10:27:33.778 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nf_tables.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink_log.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_chain_nat.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_compat.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_ct.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_fib.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_hash.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_limit.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_log.ko 2023-12-04T10:27:33.779 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_masq.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_nat.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_numgen.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_queue.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_quota.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_redir.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_reject.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_reject_inet.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_socket.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/nft_tunnel.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_AUDIT.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_CT.ko 2023-12-04T10:27:33.780 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_DSCP.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_HL.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_HMARK.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_LED.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_LOG.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_NETMAP.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_NFLOG.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_RATEEST.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_SECMARK.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TEE.ko 2023-12-04T10:27:33.781 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TPROXY.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_TRACE.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_addrtype.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_bpf.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_cgroup.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_cluster.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_comment.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_connbytes.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_connlabel.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_connlimit.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_connmark.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_conntrack.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_cpu.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_dccp.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_devgroup.ko 2023-12-04T10:27:33.782 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_dscp.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_ecn.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_esp.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_hashlimit.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_helper.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_hl.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_ipcomp.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_iprange.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_ipvs.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_l2tp.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_length.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_limit.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_mac.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_mark.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_multiport.ko 2023-12-04T10:27:33.783 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_nat.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_nfacct.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_osf.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_owner.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_physdev.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_pkttype.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_policy.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_quota.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_rateest.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_realm.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_recent.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_sctp.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_set.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_socket.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_state.ko 2023-12-04T10:27:33.784 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_statistic.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_string.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_tcpmss.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_time.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netfilter/xt_u32.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netlink 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/netlink/netlink_diag.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/nsh 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/nsh/nsh.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch/openvswitch.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch/vport-geneve.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch/vport-gre.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/openvswitch/vport-vxlan.ko 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/packet 2023-12-04T10:27:33.785 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/packet/af_packet_diag.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/rds 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/rds/rds.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/rds/rds_rdma.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/rds/rds_tcp.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_csum.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_gact.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_ipt.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_mirred.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_nat.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_pedit.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_police.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_simple.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_skbedit.ko 2023-12-04T10:27:33.786 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/act_vlan.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_basic.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_bpf.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_flow.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_fw.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_route.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/cls_u32.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_cmp.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_ipset.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_meta.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_nbyte.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_text.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/em_u32.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_choke.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_codel.ko 2023-12-04T10:27:33.787 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_drr.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_fq.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_gred.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_hfsc.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_hhf.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_htb.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_ingress.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_mqprio.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_mqprio_lib.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_multiq.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_netem.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_pie.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_plug.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_prio.ko 2023-12-04T10:27:33.788 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_qfq.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_red.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_sfb.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_sfq.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_tbf.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sched/sch_teql.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sctp 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sctp/sctp.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sctp/sctp_diag.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/auth_gss 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/sunrpc.ko 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/xprtrdma 2023-12-04T10:27:33.789 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/tipc 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/tipc/diag.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/tipc/tipc.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/unix 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/unix/unix_diag.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vsock.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/xfrm 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-04T10:27:33.790 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys/encrypted-keys 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys/trusted-keys 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/security/keys/trusted-keys/trusted.ko 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/virt 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/virt/lib 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/kernel/virt/lib/irqbypass.ko 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.alias 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.alias.bin 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.builtin 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.builtin.alias.bin 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.builtin.bin 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.builtin.modinfo 2023-12-04T10:27:33.791 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.dep 2023-12-04T10:27:33.792 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.dep.bin 2023-12-04T10:27:33.792 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.devname 2023-12-04T10:27:33.792 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.order 2023-12-04T10:27:33.792 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.softdep 2023-12-04T10:27:33.792 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.symbols 2023-12-04T10:27:33.792 INFO:teuthology.orchestra.run.smithi066.stdout:/lib/modules/6.6.0-g9c0b943f8476/modules.symbols.bin 2023-12-04T10:27:33.792 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g9c0b943f8476 2023-12-04T10:27:33.792 DEBUG:teuthology.orchestra.run.smithi066:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-04T10:27:33.819 INFO:teuthology.orchestra.run.smithi066.stdout:postinstall scriptlet (using /bin/sh): 2023-12-04T10:27:33.819 INFO:teuthology.orchestra.run.smithi066.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-g9c0b943f8476 -a -r /boot/System.map-6.6.0-g9c0b943f8476 ]; then 2023-12-04T10:27:33.819 INFO:teuthology.orchestra.run.smithi066.stdout:cp /boot/vmlinuz-6.6.0-g9c0b943f8476 /boot/.vmlinuz-6.6.0-g9c0b943f8476-rpm 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:cp /boot/System.map-6.6.0-g9c0b943f8476 /boot/.System.map-6.6.0-g9c0b943f8476-rpm 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:rm -f /boot/vmlinuz-6.6.0-g9c0b943f8476 /boot/System.map-6.6.0-g9c0b943f8476 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/installkernel 6.6.0-g9c0b943f8476 /boot/.vmlinuz-6.6.0-g9c0b943f8476-rpm /boot/.System.map-6.6.0-g9c0b943f8476-rpm 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:rm -f /boot/.vmlinuz-6.6.0-g9c0b943f8476-rpm /boot/.System.map-6.6.0-g9c0b943f8476-rpm 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:fi 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:new-kernel-pkg --remove 6.6.0-g9c0b943f8476 --rminitrd --initrdfile=/boot/initramfs-6.6.0-g9c0b943f8476.img 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:kernel-install remove 6.6.0-g9c0b943f8476 2023-12-04T10:27:33.820 INFO:teuthology.orchestra.run.smithi066.stdout:fi 2023-12-04T10:27:33.821 INFO:teuthology.orchestra.run.smithi066.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-04T10:27:33.821 INFO:teuthology.orchestra.run.smithi066.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-04T10:27:33.821 INFO:teuthology.orchestra.run.smithi066.stdout:/sbin/update-bootloader --remove 6.6.0-g9c0b943f8476 2023-12-04T10:27:33.821 INFO:teuthology.orchestra.run.smithi066.stdout:fi 2023-12-04T10:27:33.822 DEBUG:teuthology.orchestra.run.smithi066:> sudo rpm -qi grub2-tools 2023-12-04T10:27:33.906 INFO:teuthology.orchestra.run.smithi066.stdout:Name : grub2-tools 2023-12-04T10:27:33.906 INFO:teuthology.orchestra.run.smithi066.stdout:Epoch : 1 2023-12-04T10:27:33.906 INFO:teuthology.orchestra.run.smithi066.stdout:Version : 2.06 2023-12-04T10:27:33.906 INFO:teuthology.orchestra.run.smithi066.stdout:Release : 68.el9 2023-12-04T10:27:33.906 INFO:teuthology.orchestra.run.smithi066.stdout:Architecture: x86_64 2023-12-04T10:27:33.906 INFO:teuthology.orchestra.run.smithi066.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-04T10:27:33.906 INFO:teuthology.orchestra.run.smithi066.stdout:Group : Unspecified 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Size : 8264254 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:License : GPLv3+ 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Packager : builder@centos.org 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Vendor : CentOS 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Summary : Support tools for GRUB. 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:Description : 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-04T10:27:33.907 INFO:teuthology.orchestra.run.smithi066.stdout:hardware devices. 2023-12-04T10:27:33.908 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:27:33.908 INFO:teuthology.orchestra.run.smithi066.stdout:This subpackage provides tools for support of all platforms. 2023-12-04T10:27:33.908 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-04T10:27:33.909 INFO:teuthology.task.kernel:Updating grub on smithi066 to boot 6.6.0-g9c0b943f8476 2023-12-04T10:27:33.909 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-04T10:27:34.502 INFO:teuthology.orchestra.run.smithi066.stderr:Generating grub configuration file ... 2023-12-04T10:27:35.888 INFO:teuthology.orchestra.run.smithi066.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-04T10:27:35.928 INFO:teuthology.orchestra.run.smithi066.stderr:done 2023-12-04T10:27:35.947 DEBUG:teuthology.orchestra.run.smithi066:> mktemp 2023-12-04T10:27:35.963 INFO:teuthology.orchestra.run.smithi066.stdout:/tmp/tmp.eNdFu1KnUQ 2023-12-04T10:27:35.963 DEBUG:teuthology.orchestra.run.smithi066:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eNdFu1KnUQ 2023-12-04T10:27:36.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0666 /tmp/tmp.eNdFu1KnUQ 2023-12-04T10:27:36.186 DEBUG:teuthology.orchestra.remote:smithi066:/tmp/tmp.eNdFu1KnUQ is 6KB 2023-12-04T10:27:36.235 DEBUG:teuthology.orchestra.run.smithi066:> rm -fr /tmp/tmp.eNdFu1KnUQ 2023-12-04T10:27:36.249 DEBUG:teuthology.orchestra.run.smithi066:> sudo /bin/ls /boot/loader/entries || true 2023-12-04T10:27:36.317 INFO:teuthology.orchestra.run.smithi066.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-04T10:27:36.318 INFO:teuthology.orchestra.run.smithi066.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-04T10:27:36.318 INFO:teuthology.orchestra.run.smithi066.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-04T10:27:36.318 INFO:teuthology.orchestra.run.smithi066.stdout:15949e3c88704300882482eddfd7baae-6.6.0-g9c0b943f8476.conf 2023-12-04T10:27:36.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-g9c0b943f8476 2023-12-04T10:27:36.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo shutdown -r now 2023-12-04T10:27:53.374 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-04T10:27:53.375 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-04T10:27:53.375 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:28:06.482 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-04T10:28:06.482 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-04T10:28:06.483 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:28:27.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-04T10:28:36.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-04T10:28:36.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:28:40.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-12-04T10:28:49.939 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-04T10:28:49.940 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:28:52.994 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-12-04T10:28:55.266 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-04T10:29:05.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-04T10:29:05.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:29:07.269 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-04T10:29:07.270 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:29:08.066 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-12-04T10:29:10.338 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.63 2023-12-04T10:29:23.078 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-04T10:29:23.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:29:25.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-04T10:29:25.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:29:25.723 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-04T10:29:26.416 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-04T10:29:26.416 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g9c0b943f8476"... 2023-12-04T10:29:26.416 DEBUG:teuthology.orchestra.run.smithi063:> uname -r 2023-12-04T10:29:26.457 INFO:teuthology.orchestra.run.smithi063.stdout:6.6.0-g9c0b943f8476 2023-12-04T10:29:26.457 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g9c0b943f8476 vs 6.6.0-g9c0b943f8476 2023-12-04T10:29:26.457 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-04T10:29:26.457 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-04T10:29:27.459 DEBUG:teuthology.parallel:result is None 2023-12-04T10:29:41.602 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.66 2023-12-04T10:29:59.603 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-04T10:29:59.604 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:30:02.727 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-12-04T10:30:03.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-04T10:30:03.385 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-g9c0b943f8476"... 2023-12-04T10:30:03.385 DEBUG:teuthology.orchestra.run.smithi066:> uname -r 2023-12-04T10:30:03.428 INFO:teuthology.orchestra.run.smithi066.stdout:6.6.0-g9c0b943f8476 2023-12-04T10:30:03.428 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g9c0b943f8476 vs 6.6.0-g9c0b943f8476 2023-12-04T10:30:03.429 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-04T10:30:03.429 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-04T10:30:04.430 DEBUG:teuthology.parallel:result is None 2023-12-04T10:30:04.430 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-04T10:30:04.439 INFO:teuthology.task.internal:Creating test directory... 2023-12-04T10:30:04.439 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-04T10:30:04.449 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-04T10:30:04.505 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-04T10:30:04.520 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-04T10:30:04.529 INFO:teuthology.task.internal:Creating archive directory... 2023-12-04T10:30:04.529 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-04T10:30:04.537 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-04T10:30:04.611 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-04T10:30:04.619 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-04T10:30:04.619 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-04T10:30:04.628 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-04T10:30:04.780 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-04T10:30:04.812 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-04T10:30:04.855 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-04T10:30:04.887 INFO:teuthology.orchestra.run.smithi063.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-04T10:30:04.892 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-04T10:30:04.899 INFO:teuthology.task.internal:Configuring sudo... 2023-12-04T10:30:04.899 DEBUG:teuthology.orchestra.run.smithi063:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-04T10:30:04.908 DEBUG:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-04T10:30:05.005 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-04T10:30:05.016 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-04T10:30:05.016 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-04T10:30:05.025 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-04T10:30:05.075 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-04T10:30:05.163 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-04T10:30:05.285 DEBUG:teuthology.orchestra.run.smithi063:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-04T10:30:05.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-04T10:30:05.483 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:30:05.483 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-04T10:30:05.587 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-04T10:30:05.672 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-04T10:30:05.769 DEBUG:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-04T10:30:05.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-04T10:30:05.949 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:30:05.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-04T10:30:06.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo service rsyslog restart 2023-12-04T10:30:06.050 DEBUG:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2023-12-04T10:30:06.180 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-04T10:30:06.192 INFO:teuthology.orchestra.run.smithi063.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-04T10:30:06.623 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-04T10:30:06.631 INFO:teuthology.task.internal:Starting timer... 2023-12-04T10:30:06.631 INFO:teuthology.run_tasks:Running task pcp... 2023-12-04T10:30:06.651 INFO:teuthology.run_tasks:Running task selinux... 2023-12-04T10:30:06.661 DEBUG:teuthology.orchestra.run.smithi063:> sudo service auditd rotate 2023-12-04T10:30:06.813 INFO:teuthology.orchestra.run.smithi063.stdout:Rotating logs: 2023-12-04T10:30:06.819 DEBUG:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2023-12-04T10:30:06.948 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: 2023-12-04T10:30:06.952 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-04T10:30:06.952 DEBUG:teuthology.orchestra.run.smithi063:> /usr/sbin/getenforce 2023-12-04T10:30:07.024 INFO:teuthology.orchestra.run.smithi063.stdout:Permissive 2023-12-04T10:30:07.024 DEBUG:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2023-12-04T10:30:07.087 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2023-12-04T10:30:07.087 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi063.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi066.front.sepia.ceph.com': 'permissive'} 2023-12-04T10:30:07.088 DEBUG:teuthology.orchestra.run.smithi063:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-04T10:30:07.196 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T10:30:07.197 DEBUG:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-04T10:30:07.289 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T10:30:07.290 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-04T10:30:07.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo /usr/sbin/setenforce permissive 2023-12-04T10:30:07.413 DEBUG:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2023-12-04T10:30:07.508 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-04T10:30:07.518 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-04T10:30:07.518 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-04T10:30:07.536 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-04T10:30:07.537 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi063.front.sepia.ceph.com,smithi066.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-04T10:40:42.543 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi063.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com')] 2023-12-04T10:40:42.544 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-04T10:40:42.545 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi063.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:40:42.693 DEBUG:teuthology.orchestra.run.smithi063:> true 2023-12-04T10:40:42.861 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi063.front.sepia.ceph.com' 2023-12-04T10:40:42.861 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-04T10:40:42.862 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-04T10:40:43.016 DEBUG:teuthology.orchestra.run.smithi066:> true 2023-12-04T10:40:43.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi066.front.sepia.ceph.com' 2023-12-04T10:40:43.177 INFO:teuthology.run_tasks:Running task clock... 2023-12-04T10:40:43.188 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-04T10:40:43.188 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-04T10:40:43.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-04T10:40:43.198 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-04T10:40:43.198 DEBUG:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-04T10:40:43.302 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-04T10:40:43.314 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-04T10:40:43.361 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-04T10:40:43.378 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-04T10:40:43.469 INFO:teuthology.orchestra.run.smithi063.stderr:sudo: ntpd: command not found 2023-12-04T10:40:43.493 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2023-12-04T10:40:43.513 INFO:teuthology.orchestra.run.smithi063.stdout:506 Cannot talk to daemon 2023-12-04T10:40:43.548 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2023-12-04T10:40:43.566 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-04T10:40:43.611 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-04T10:40:43.620 INFO:teuthology.orchestra.run.smithi063.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-04T10:40:43.673 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-04T10:40:43.759 INFO:teuthology.orchestra.run.smithi063.stderr:bash: line 1: ntpq: command not found 2023-12-04T10:40:43.767 INFO:teuthology.orchestra.run.smithi063.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-04T10:40:43.767 INFO:teuthology.orchestra.run.smithi063.stdout:=============================================================================== 2023-12-04T10:40:43.767 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-04T10:40:43.767 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-04T10:40:43.767 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-04T10:40:43.767 INFO:teuthology.orchestra.run.smithi063.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-04T10:40:43.827 INFO:teuthology.orchestra.run.smithi066.stderr:bash: line 1: ntpq: command not found 2023-12-04T10:40:43.836 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-04T10:40:43.836 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2023-12-04T10:40:43.836 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-04T10:40:43.836 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-04T10:40:43.836 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-04T10:40:43.836 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-04T10:40:43.838 INFO:teuthology.run_tasks:Running task install... 2023-12-04T10:40:43.846 DEBUG:teuthology.task.install:project ceph 2023-12-04T10:40:43.846 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb'}} 2023-12-04T10:40:43.846 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb'} 2023-12-04T10:40:43.846 INFO:teuthology.task.install:Using flavor: default 2023-12-04T10:40:43.852 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-04T10:40:43.852 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-04T10:40:43.853 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb', 'tag': None, 'wait_for_package': False} 2023-12-04T10:40:43.853 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c7b0e682e685ca9c244e731128a4c5dcad3b99eb 2023-12-04T10:40:43.855 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb', 'tag': None, 'wait_for_package': False} 2023-12-04T10:40:43.855 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c7b0e682e685ca9c244e731128a4c5dcad3b99eb 2023-12-04T10:40:44.002 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231204.063332/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/centos/9/flavors/default/ 2023-12-04T10:40:44.003 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7690.gc7b0e682 2023-12-04T10:40:44.007 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231204.063332/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/centos/9/flavors/default/ 2023-12-04T10:40:44.008 INFO:teuthology.task.install.rpm:Package version is 18.0.0-7690.gc7b0e682 2023-12-04T10:40:44.115 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231204.063332/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231204.063332/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231204.063332/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-04T10:40:44.115 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:40:44.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-04T10:40:44.135 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231204.063332/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231204.063332/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231204.063332/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-04T10:40:44.135 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:40:44.135 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-04T10:40:44.231 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-04T10:40:44.231 DEBUG:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-04T10:40:44.245 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-04T10:40:44.245 DEBUG:teuthology.orchestra.run.smithi063:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/c7b0e682e685ca9c244e731128a4c5dcad3b99eb/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-04T10:40:44.370 DEBUG:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-04T10:40:44.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-04T10:40:44.517 DEBUG:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-04T10:40:44.534 DEBUG:teuthology.orchestra.run.smithi063:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-04T10:40:44.617 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2023-12-04T10:40:44.622 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum clean all 2023-12-04T10:40:44.631 INFO:teuthology.orchestra.run.smithi063.stdout:check_obsoletes = 1 2023-12-04T10:40:44.635 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum clean all 2023-12-04T10:40:44.990 INFO:teuthology.orchestra.run.smithi066.stdout:73 files removed 2023-12-04T10:40:45.114 INFO:teuthology.orchestra.run.smithi063.stdout:73 files removed 2023-12-04T10:40:45.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-04T10:40:45.116 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-04T10:40:46.211 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 139 kB/s | 78 kB 00:00 2023-12-04T10:40:46.292 INFO:teuthology.orchestra.run.smithi063.stdout:ceph packages for x86_64 122 kB/s | 78 kB 00:00 2023-12-04T10:40:46.845 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 18 kB/s | 9.5 kB 00:00 2023-12-04T10:40:47.002 INFO:teuthology.orchestra.run.smithi063.stdout:ceph noarch packages 16 kB/s | 9.5 kB 00:00 2023-12-04T10:40:47.595 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2023-12-04T10:40:47.718 INFO:teuthology.orchestra.run.smithi063.stdout:ceph source packages 2.9 kB/s | 1.9 kB 00:00 2023-12-04T10:40:48.549 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-9 - AppStream 7.3 MB/s | 6.4 MB 00:00 2023-12-04T10:40:49.431 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - AppStream 3.9 MB/s | 6.4 MB 00:01 2023-12-04T10:40:50.341 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS-9 - BaseOS 3.8 MB/s | 2.0 MB 00:00 2023-12-04T10:40:51.181 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS-9 - BaseOS 4.0 MB/s | 2.0 MB 00:00 2023-12-04T10:40:53.703 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 7.9 MB 00:02 2023-12-04T10:40:55.235 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-12-04T10:40:58.146 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - AppStream 5.7 MB/s | 18 MB 00:03 2023-12-04T10:41:02.622 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 5.8 MB 00:00 2023-12-04T10:41:03.285 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - AppStream 2.7 MB/s | 18 MB 00:06 2023-12-04T10:41:04.548 INFO:teuthology.orchestra.run.smithi066.stdout:CentOS Stream 9 - Extras packages 26 kB/s | 15 kB 00:00 2023-12-04T10:41:06.549 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-04T10:41:08.744 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 5.8 MB 00:01 2023-12-04T10:41:10.462 INFO:teuthology.orchestra.run.smithi063.stdout:CentOS Stream 9 - Extras packages 48 kB/s | 15 kB 00:00 2023-12-04T10:41:12.105 INFO:teuthology.orchestra.run.smithi063.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2023-12-04T10:41:12.457 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-04T10:41:15.505 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-04T10:41:15.507 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-04T10:41:15.528 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-04T10:41:15.529 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-04T10:41:15.531 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-04T10:41:15.532 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-04T10:41:15.535 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-04T10:41:15.539 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-04T10:41:15.540 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-04T10:41:15.629 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2023-12-04T10:41:15.652 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================================ 2023-12-04T10:41:15.652 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2023-12-04T10:41:15.652 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================================ 2023-12-04T10:41:15.652 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2023-12-04T10:41:15.652 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 6.6 k 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 5.2 M 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 860 k 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 141 k 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 1.5 M 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 133 k 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 1.8 M 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 7.4 M 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 50 k 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 8.6 M 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 41 M 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 262 k 2023-12-04T10:41:15.653 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 776 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 217 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 18 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 31 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 718 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 126 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-04T10:41:15.654 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 161 k 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 321 k 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 297 k 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 99 k 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 85 k 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 3.0 M 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 170 k 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-04T10:41:15.655 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 3.3 M 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 3.0 M 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-04T10:41:15.656 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 19 M 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 28 k 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 2.1 M 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 243 k 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 4.4 M 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 18 M 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 15 k 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 24 k 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-04T10:41:15.657 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 163 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 475 k 2023-12-04T10:41:15.658 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 4.8 M 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-04T10:41:15.659 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 45 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 129 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-04T10:41:15.660 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-04T10:41:15.661 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-04T10:41:15.662 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-04T10:41:15.663 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout:============================================================================================ 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout:Install 135 Packages 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 15 Packages 2023-12-04T10:41:15.664 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:41:15.665 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 204 M 2023-12-04T10:41:15.665 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2023-12-04T10:41:16.750 INFO:teuthology.orchestra.run.smithi066.stdout:(1/150): ceph-18.0.0-7690.gc7b0e682.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2023-12-04T10:41:16.992 INFO:teuthology.orchestra.run.smithi066.stdout:(2/150): ceph-fuse-18.0.0-7690.gc7b0e682.el9.x8 3.5 MB/s | 860 kB 00:00 2023-12-04T10:41:17.068 INFO:teuthology.orchestra.run.smithi066.stdout:(3/150): ceph-immutable-object-cache-18.0.0-769 1.9 MB/s | 141 kB 00:00 2023-12-04T10:41:17.393 INFO:teuthology.orchestra.run.smithi066.stdout:(4/150): ceph-mds-18.0.0-7690.gc7b0e682.el9.x86 6.4 MB/s | 2.1 MB 00:00 2023-12-04T10:41:17.527 INFO:teuthology.orchestra.run.smithi066.stdout:(5/150): ceph-base-18.0.0-7690.gc7b0e682.el9.x8 5.0 MB/s | 5.2 MB 00:01 2023-12-04T10:41:17.685 INFO:teuthology.orchestra.run.smithi066.stdout:(6/150): ceph-mgr-18.0.0-7690.gc7b0e682.el9.x86 5.0 MB/s | 1.5 MB 00:00 2023-12-04T10:41:17.922 INFO:teuthology.orchestra.run.smithi063.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2023-12-04T10:41:18.043 INFO:teuthology.orchestra.run.smithi066.stdout:(7/150): ceph-mon-18.0.0-7690.gc7b0e682.el9.x86 8.5 MB/s | 4.4 MB 00:00 2023-12-04T10:41:18.902 INFO:teuthology.orchestra.run.smithi066.stdout:(8/150): ceph-common-18.0.0-7690.gc7b0e682.el9. 7.8 MB/s | 19 MB 00:02 2023-12-04T10:41:18.944 INFO:teuthology.orchestra.run.smithi066.stdout:(9/150): ceph-selinux-18.0.0-7690.gc7b0e682.el9 596 kB/s | 24 kB 00:00 2023-12-04T10:41:19.111 INFO:teuthology.orchestra.run.smithi066.stdout:(10/150): ceph-radosgw-18.0.0-7690.gc7b0e682.el 8.0 MB/s | 8.6 MB 00:01 2023-12-04T10:41:19.203 INFO:teuthology.orchestra.run.smithi066.stdout:(11/150): cephfs-mirror-18.0.0-7690.gc7b0e682.e 2.3 MB/s | 217 kB 00:00 2023-12-04T10:41:19.262 INFO:teuthology.orchestra.run.smithi066.stdout:(12/150): libcephfs-devel-18.0.0-7690.gc7b0e682 544 kB/s | 31 kB 00:00 2023-12-04T10:41:19.446 INFO:teuthology.orchestra.run.smithi066.stdout:(13/150): libcephfs2-18.0.0-7690.gc7b0e682.el9. 3.8 MB/s | 718 kB 00:00 2023-12-04T10:41:19.512 INFO:teuthology.orchestra.run.smithi066.stdout:(14/150): libcephsqlite-18.0.0-7690.gc7b0e682.e 2.4 MB/s | 163 kB 00:00 2023-12-04T10:41:19.621 INFO:teuthology.orchestra.run.smithi066.stdout:(15/150): librados-devel-18.0.0-7690.gc7b0e682. 1.1 MB/s | 126 kB 00:00 2023-12-04T10:41:19.721 INFO:teuthology.orchestra.run.smithi066.stdout:(16/150): libradosstriper1-18.0.0-7690.gc7b0e68 4.7 MB/s | 475 kB 00:00 2023-12-04T10:41:19.947 INFO:teuthology.orchestra.run.smithi066.stdout:(17/150): ceph-osd-18.0.0-7690.gc7b0e682.el9.x8 7.8 MB/s | 18 MB 00:02 2023-12-04T10:41:20.020 INFO:teuthology.orchestra.run.smithi066.stdout:(18/150): python3-ceph-argparse-18.0.0-7690.gc7 629 kB/s | 45 kB 00:00 2023-12-04T10:41:20.089 INFO:teuthology.orchestra.run.smithi066.stdout:(19/150): python3-ceph-common-18.0.0-7690.gc7b0 1.9 MB/s | 129 kB 00:00 2023-12-04T10:41:20.156 INFO:teuthology.orchestra.run.smithi066.stdout:(20/150): python3-cephfs-18.0.0-7690.gc7b0e682. 2.4 MB/s | 161 kB 00:00 2023-12-04T10:41:20.281 INFO:teuthology.orchestra.run.smithi066.stdout:(21/150): librgw2-18.0.0-7690.gc7b0e682.el9.x86 8.5 MB/s | 4.8 MB 00:00 2023-12-04T10:41:20.315 INFO:teuthology.orchestra.run.smithi066.stdout:(22/150): python3-rados-18.0.0-7690.gc7b0e682.e 2.0 MB/s | 321 kB 00:00 2023-12-04T10:41:20.365 INFO:teuthology.orchestra.run.smithi066.stdout:(23/150): python3-rbd-18.0.0-7690.gc7b0e682.el9 3.5 MB/s | 297 kB 00:00 2023-12-04T10:41:20.399 INFO:teuthology.orchestra.run.smithi066.stdout:(24/150): python3-rgw-18.0.0-7690.gc7b0e682.el9 1.2 MB/s | 99 kB 00:00 2023-12-04T10:41:20.514 INFO:teuthology.orchestra.run.smithi066.stdout:(25/150): rbd-fuse-18.0.0-7690.gc7b0e682.el9.x8 577 kB/s | 85 kB 00:00 2023-12-04T10:41:20.658 INFO:teuthology.orchestra.run.smithi066.stdout:(26/150): rbd-nbd-18.0.0-7690.gc7b0e682.el9.x86 1.2 MB/s | 170 kB 00:00 2023-12-04T10:41:20.716 INFO:teuthology.orchestra.run.smithi066.stdout:(27/150): ceph-grafana-dashboards-18.0.0-7690.g 493 kB/s | 28 kB 00:00 2023-12-04T10:41:20.808 INFO:teuthology.orchestra.run.smithi066.stdout:(28/150): rbd-mirror-18.0.0-7690.gc7b0e682.el9. 7.4 MB/s | 3.0 MB 00:00 2023-12-04T10:41:20.842 INFO:teuthology.orchestra.run.smithi066.stdout:(29/150): ceph-mgr-cephadm-18.0.0-7690.gc7b0e68 1.0 MB/s | 133 kB 00:00 2023-12-04T10:41:20.948 INFO:teuthology.orchestra.run.smithi063.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-04T10:41:20.950 INFO:teuthology.orchestra.run.smithi063.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-04T10:41:20.970 INFO:teuthology.orchestra.run.smithi063.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-04T10:41:20.971 INFO:teuthology.orchestra.run.smithi063.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-04T10:41:20.973 INFO:teuthology.orchestra.run.smithi063.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-04T10:41:20.974 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-04T10:41:20.976 INFO:teuthology.orchestra.run.smithi063.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-04T10:41:20.980 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-04T10:41:20.981 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-04T10:41:21.051 INFO:teuthology.orchestra.run.smithi066.stdout:(30/150): ceph-mgr-dashboard-18.0.0-7690.gc7b0e 7.3 MB/s | 1.8 MB 00:00 2023-12-04T10:41:21.069 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: ceph x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 6.6 k 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 5.2 M 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 860 k 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 141 k 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 1.5 M 2023-12-04T10:41:21.101 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 133 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 1.8 M 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 7.4 M 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 50 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 8.6 M 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 41 M 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 262 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 776 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 217 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 18 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-04T10:41:21.102 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 31 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 718 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 126 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 161 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 321 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 297 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 99 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 85 k 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 3.0 M 2023-12-04T10:41:21.103 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 170 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: librados2 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 3.3 M 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 3.0 M 2023-12-04T10:41:21.104 INFO:teuthology.orchestra.run.smithi063.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 19 M 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 28 k 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 2.1 M 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 243 k 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 4.4 M 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 18 M 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts noarch 2:18.0.0-7690.gc7b0e682.el9 ceph-noarch 15 k 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 24 k 2023-12-04T10:41:21.105 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow x86_64 9.0.0-9.el9 epel 4.4 M 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc noarch 9.0.0-9.el9 epel 24 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 163 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-04T10:41:21.106 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 475 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2 x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 4.8 M 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs x86_64 9.0.0-9.el9 epel 837 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-04T10:41:21.107 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 45 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common x86_64 2:18.0.0-7690.gc7b0e682.el9 ceph 129 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-04T10:41:21.108 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-04T10:41:21.109 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-04T10:41:21.110 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-04T10:41:21.111 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-04T10:41:21.112 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2023-12-04T10:41:21.112 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-04T10:41:21.112 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:41:21.112 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-04T10:41:21.112 INFO:teuthology.orchestra.run.smithi063.stdout:============================================================================================ 2023-12-04T10:41:21.112 INFO:teuthology.orchestra.run.smithi063.stdout:Install 135 Packages 2023-12-04T10:41:21.112 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 15 Packages 2023-12-04T10:41:21.112 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:41:21.113 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 204 M 2023-12-04T10:41:21.113 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-04T10:41:21.260 INFO:teuthology.orchestra.run.smithi066.stdout:(31/150): ceph-mgr-modules-core-18.0.0-7690.gc7 1.1 MB/s | 243 kB 00:00 2023-12-04T10:41:21.353 INFO:teuthology.orchestra.run.smithi066.stdout:(32/150): ceph-mgr-rook-18.0.0-7690.gc7b0e682.e 554 kB/s | 50 kB 00:00 2023-12-04T10:41:21.435 INFO:teuthology.orchestra.run.smithi066.stdout:(33/150): ceph-prometheus-alerts-18.0.0-7690.gc 183 kB/s | 15 kB 00:00 2023-12-04T10:41:21.535 INFO:teuthology.orchestra.run.smithi066.stdout:(34/150): ceph-volume-18.0.0-7690.gc7b0e682.el9 2.6 MB/s | 262 kB 00:00 2023-12-04T10:41:21.677 INFO:teuthology.orchestra.run.smithi066.stdout:(35/150): ceph-mgr-diskprediction-local-18.0.0- 8.9 MB/s | 7.4 MB 00:00 2023-12-04T10:41:21.744 INFO:teuthology.orchestra.run.smithi066.stdout:(36/150): cephadm-18.0.0-7690.gc7b0e682.el9.noa 3.7 MB/s | 776 kB 00:00 2023-12-04T10:41:21.762 INFO:teuthology.orchestra.run.smithi066.stdout:(37/150): cephfs-top-18.0.0-7690.gc7b0e682.el9. 222 kB/s | 18 kB 00:00 2023-12-04T10:41:21.978 INFO:teuthology.orchestra.run.smithi066.stdout:(38/150): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 662 kB 00:00 2023-12-04T10:41:22.132 INFO:teuthology.orchestra.run.smithi063.stdout:(1/150): ceph-18.0.0-7690.gc7b0e682.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2023-12-04T10:41:22.375 INFO:teuthology.orchestra.run.smithi063.stdout:(2/150): ceph-fuse-18.0.0-7690.gc7b0e682.el9.x8 3.5 MB/s | 860 kB 00:00 2023-12-04T10:41:22.395 INFO:teuthology.orchestra.run.smithi066.stdout:(39/150): ceph-test-18.0.0-7690.gc7b0e682.el9.x 12 MB/s | 41 MB 00:03 2023-12-04T10:41:22.424 INFO:teuthology.orchestra.run.smithi063.stdout:(3/150): ceph-immutable-object-cache-18.0.0-769 2.8 MB/s | 141 kB 00:00 2023-12-04T10:41:22.446 INFO:teuthology.orchestra.run.smithi066.stdout:(40/150): bison-3.7.4-5.el9.x86_64.rpm 1.3 MB/s | 920 kB 00:00 2023-12-04T10:41:22.470 INFO:teuthology.orchestra.run.smithi066.stdout:(41/150): boost-program-options-1.75.0-8.el9.x8 216 kB/s | 106 kB 00:00 2023-12-04T10:41:22.488 INFO:teuthology.orchestra.run.smithi066.stdout:(42/150): elfutils-libelf-devel-0.190-1.el9.x86 239 kB/s | 21 kB 00:00 2023-12-04T10:41:22.505 INFO:teuthology.orchestra.run.smithi066.stdout:(43/150): flexiblas-3.0.4-8.el9.x86_64.rpm 986 kB/s | 32 kB 00:00 2023-12-04T10:41:22.570 INFO:teuthology.orchestra.run.smithi066.stdout:(44/150): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 307 kB 00:00 2023-12-04T10:41:22.730 INFO:teuthology.orchestra.run.smithi066.stdout:(45/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2023-12-04T10:41:22.747 INFO:teuthology.orchestra.run.smithi066.stdout:(46/150): flexiblas-openblas-openmp-3.0.4-8.el9 74 kB/s | 17 kB 00:00 2023-12-04T10:41:22.757 INFO:teuthology.orchestra.run.smithi063.stdout:(4/150): ceph-mds-18.0.0-7690.gc7b0e682.el9.x86 6.3 MB/s | 2.1 MB 00:00 2023-12-04T10:41:22.781 INFO:teuthology.orchestra.run.smithi066.stdout:(47/150): jq-1.6-16.el9.x86_64.rpm 963 kB/s | 186 kB 00:00 2023-12-04T10:41:22.798 INFO:teuthology.orchestra.run.smithi066.stdout:(48/150): libaio-devel-0.3.111-13.el9.x86_64.rp 212 kB/s | 10 kB 00:00 2023-12-04T10:41:22.825 INFO:teuthology.orchestra.run.smithi066.stdout:(49/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-12-04T10:41:22.839 INFO:teuthology.orchestra.run.smithi066.stdout:(50/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 787 kB/s | 44 kB 00:00 2023-12-04T10:41:22.858 INFO:teuthology.orchestra.run.smithi063.stdout:(5/150): ceph-base-18.0.0-7690.gc7b0e682.el9.x8 5.2 MB/s | 5.2 MB 00:00 2023-12-04T10:41:22.898 INFO:teuthology.orchestra.run.smithi066.stdout:(51/150): librdkafka-1.6.1-102.el9.x86_64.rpm 8.8 MB/s | 661 kB 00:00 2023-12-04T10:41:22.940 INFO:teuthology.orchestra.run.smithi066.stdout:(52/150): libtool-2.4.6-45.el9.x86_64.rpm 4.9 MB/s | 578 kB 00:00 2023-12-04T10:41:22.957 INFO:teuthology.orchestra.run.smithi066.stdout:(53/150): libuuid-devel-2.37.4-15.el9.x86_64.rp 211 kB/s | 24 kB 00:00 2023-12-04T10:41:23.007 INFO:teuthology.orchestra.run.smithi066.stdout:(54/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 431 kB/s | 46 kB 00:00 2023-12-04T10:41:23.041 INFO:teuthology.orchestra.run.smithi066.stdout:(55/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 282 kB 00:00 2023-12-04T10:41:23.041 INFO:teuthology.orchestra.run.smithi063.stdout:(6/150): ceph-mgr-18.0.0-7690.gc7b0e682.el9.x86 5.2 MB/s | 1.5 MB 00:00 2023-12-04T10:41:23.066 INFO:teuthology.orchestra.run.smithi066.stdout:(56/150): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 187 kB 00:00 2023-12-04T10:41:23.099 INFO:teuthology.orchestra.run.smithi066.stdout:(57/150): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.3 MB/s | 217 kB 00:00 2023-12-04T10:41:23.133 INFO:teuthology.orchestra.run.smithi066.stdout:(58/150): openblas-0.3.21-2.el9.x86_64.rpm 535 kB/s | 34 kB 00:00 2023-12-04T10:41:23.292 INFO:teuthology.orchestra.run.smithi066.stdout:(59/150): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2023-12-04T10:41:23.367 INFO:teuthology.orchestra.run.smithi066.stdout:(60/150): postgresql-13.11-1.el9.x86_64.rpm 5.7 MB/s | 1.5 MB 00:00 2023-12-04T10:41:23.375 INFO:teuthology.orchestra.run.smithi063.stdout:(7/150): ceph-mon-18.0.0-7690.gc7b0e682.el9.x86 8.5 MB/s | 4.4 MB 00:00 2023-12-04T10:41:23.434 INFO:teuthology.orchestra.run.smithi066.stdout:(61/150): postgresql-contrib-13.11-1.el9.x86_64 2.8 MB/s | 811 kB 00:00 2023-12-04T10:41:23.467 INFO:teuthology.orchestra.run.smithi066.stdout:(62/150): postgresql-private-libs-13.11-1.el9.x 873 kB/s | 134 kB 00:00 2023-12-04T10:41:23.768 INFO:teuthology.orchestra.run.smithi066.stdout:(63/150): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 5.8 MB 00:00 2023-12-04T10:41:23.801 INFO:teuthology.orchestra.run.smithi066.stdout:(64/150): python3-jinja2-2.11.3-4.el9.noarch.rp 687 kB/s | 228 kB 00:00 2023-12-04T10:41:23.918 INFO:teuthology.orchestra.run.smithi066.stdout:(65/150): postgresql-server-13.11-1.el9.x86_64. 12 MB/s | 5.7 MB 00:00 2023-12-04T10:41:23.943 INFO:teuthology.orchestra.run.smithi066.stdout:(66/150): python3-jsonpatch-1.21-16.el9.noarch. 141 kB/s | 24 kB 00:00 2023-12-04T10:41:23.969 INFO:teuthology.orchestra.run.smithi066.stdout:(67/150): python3-jsonpointer-2.0-4.el9.noarch. 111 kB/s | 18 kB 00:00 2023-12-04T10:41:23.994 INFO:teuthology.orchestra.run.smithi066.stdout:(68/150): python3-markupsafe-1.1.1-12.el9.x86_6 648 kB/s | 32 kB 00:00 2023-12-04T10:41:24.036 INFO:teuthology.orchestra.run.smithi066.stdout:(69/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.6 MB/s | 144 kB 00:00 2023-12-04T10:41:24.153 INFO:teuthology.orchestra.run.smithi066.stdout:(70/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-12-04T10:41:24.178 INFO:teuthology.orchestra.run.smithi066.stdout:(71/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2023-12-04T10:41:24.203 INFO:teuthology.orchestra.run.smithi066.stdout:(72/150): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2023-12-04T10:41:24.245 INFO:teuthology.orchestra.run.smithi066.stdout:(73/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-12-04T10:41:24.292 INFO:teuthology.orchestra.run.smithi063.stdout:(8/150): ceph-common-18.0.0-7690.gc7b0e682.el9. 7.8 MB/s | 19 MB 00:02 2023-12-04T10:41:24.295 INFO:teuthology.orchestra.run.smithi066.stdout:(74/150): python3-prettytable-0.7.2-27.el9.noar 453 kB/s | 41 kB 00:00 2023-12-04T10:41:24.321 INFO:teuthology.orchestra.run.smithi066.stdout:(75/150): python3-pyasn1-modules-0.4.8-6.el9.no 1.8 MB/s | 211 kB 00:00 2023-12-04T10:41:24.346 INFO:teuthology.orchestra.run.smithi066.stdout:(76/150): python3-pytz-2021.1-5.el9.noarch.rpm 484 kB/s | 47 kB 00:00 2023-12-04T10:41:24.375 INFO:teuthology.orchestra.run.smithi063.stdout:(9/150): ceph-selinux-18.0.0-7690.gc7b0e682.el9 293 kB/s | 24 kB 00:00 2023-12-04T10:41:24.379 INFO:teuthology.orchestra.run.smithi066.stdout:(77/150): python3-requests-oauthlib-1.3.0-12.el 751 kB/s | 43 kB 00:00 2023-12-04T10:41:24.555 INFO:teuthology.orchestra.run.smithi066.stdout:(78/150): python3-toml-0.10.2-6.el9.noarch.rpm 201 kB/s | 39 kB 00:00 2023-12-04T10:41:24.559 INFO:teuthology.orchestra.run.smithi063.stdout:(10/150): ceph-radosgw-18.0.0-7690.gc7b0e682.el 7.2 MB/s | 8.6 MB 00:01 2023-12-04T10:41:24.634 INFO:teuthology.orchestra.run.smithi063.stdout:(11/150): cephfs-mirror-18.0.0-7690.gc7b0e682.e 2.9 MB/s | 217 kB 00:00 2023-12-04T10:41:24.726 INFO:teuthology.orchestra.run.smithi063.stdout:(12/150): libcephfs-devel-18.0.0-7690.gc7b0e682 344 kB/s | 31 kB 00:00 2023-12-04T10:41:24.772 INFO:teuthology.orchestra.run.smithi066.stdout:(79/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 35 MB/s | 16 MB 00:00 2023-12-04T10:41:24.805 INFO:teuthology.orchestra.run.smithi066.stdout:(80/150): socat-1.7.4.1-5.el9.x86_64.rpm 732 kB/s | 300 kB 00:00 2023-12-04T10:41:24.822 INFO:teuthology.orchestra.run.smithi066.stdout:(81/150): uuid-1.6.2-55.el9.x86_64.rpm 214 kB/s | 56 kB 00:00 2023-12-04T10:41:24.848 INFO:teuthology.orchestra.run.smithi066.stdout:(82/150): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 2.1 MB/s | 85 kB 00:00 2023-12-04T10:41:24.864 INFO:teuthology.orchestra.run.smithi066.stdout:(83/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2023-12-04T10:41:24.876 INFO:teuthology.orchestra.run.smithi063.stdout:(13/150): libcephfs2-18.0.0-7690.gc7b0e682.el9. 4.7 MB/s | 718 kB 00:00 2023-12-04T10:41:24.881 INFO:teuthology.orchestra.run.smithi066.stdout:(84/150): zlib-devel-1.2.11-40.el9.x86_64.rpm 766 kB/s | 44 kB 00:00 2023-12-04T10:41:24.915 INFO:teuthology.orchestra.run.smithi066.stdout:(85/150): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-12-04T10:41:24.949 INFO:teuthology.orchestra.run.smithi066.stdout:(86/150): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.6 MB/s | 803 kB 00:00 2023-12-04T10:41:24.952 INFO:teuthology.orchestra.run.smithi063.stdout:(14/150): libcephsqlite-18.0.0-7690.gc7b0e682.e 2.2 MB/s | 163 kB 00:00 2023-12-04T10:41:24.982 INFO:teuthology.orchestra.run.smithi066.stdout:(87/150): libquadmath-11.4.1-2.3.el9.x86_64.rpm 1.9 MB/s | 195 kB 00:00 2023-12-04T10:41:25.024 INFO:teuthology.orchestra.run.smithi066.stdout:(88/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 241 kB 00:00 2023-12-04T10:41:25.027 INFO:teuthology.orchestra.run.smithi063.stdout:(15/150): librados-devel-18.0.0-7690.gc7b0e682. 1.7 MB/s | 126 kB 00:00 2023-12-04T10:41:25.066 INFO:teuthology.orchestra.run.smithi066.stdout:(89/150): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2023-12-04T10:41:25.091 INFO:teuthology.orchestra.run.smithi066.stdout:(90/150): python3-ply-3.11-14.el9.noarch.rpm 956 kB/s | 103 kB 00:00 2023-12-04T10:41:25.133 INFO:teuthology.orchestra.run.smithi066.stdout:(91/150): python3-pycparser-2.20-6.el9.noarch.r 3.0 MB/s | 124 kB 00:00 2023-12-04T10:41:25.191 INFO:teuthology.orchestra.run.smithi066.stdout:(92/150): python3-urllib3-1.26.5-4.el9.noarch.r 1.9 MB/s | 187 kB 00:00 2023-12-04T10:41:25.225 INFO:teuthology.orchestra.run.smithi066.stdout:(93/150): python3-requests-2.25.1-7.el9.noarch. 851 kB/s | 113 kB 00:00 2023-12-04T10:41:25.253 INFO:teuthology.orchestra.run.smithi063.stdout:(16/150): ceph-osd-18.0.0-7690.gc7b0e682.el9.x8 8.0 MB/s | 18 MB 00:02 2023-12-04T10:41:25.294 INFO:teuthology.orchestra.run.smithi063.stdout:(17/150): libradosstriper1-18.0.0-7690.gc7b0e68 1.7 MB/s | 475 kB 00:00 2023-12-04T10:41:25.301 INFO:teuthology.orchestra.run.smithi066.stdout:(94/150): lua-devel-5.4.4-4.el9.x86_64.rpm 299 kB/s | 22 kB 00:00 2023-12-04T10:41:25.394 INFO:teuthology.orchestra.run.smithi063.stdout:(18/150): python3-ceph-argparse-18.0.0-7690.gc7 455 kB/s | 45 kB 00:00 2023-12-04T10:41:25.453 INFO:teuthology.orchestra.run.smithi063.stdout:(19/150): python3-ceph-common-18.0.0-7690.gc7b0 2.2 MB/s | 129 kB 00:00 2023-12-04T10:41:25.484 INFO:teuthology.orchestra.run.smithi066.stdout:(95/150): python3-devel-3.9.17-2.el9.x86_64.rpm 843 kB/s | 245 kB 00:00 2023-12-04T10:41:25.537 INFO:teuthology.orchestra.run.smithi063.stdout:(20/150): python3-cephfs-18.0.0-7690.gc7b0e682. 1.9 MB/s | 161 kB 00:00 2023-12-04T10:41:25.621 INFO:teuthology.orchestra.run.smithi063.stdout:(21/150): python3-rados-18.0.0-7690.gc7b0e682.e 3.8 MB/s | 321 kB 00:00 2023-12-04T10:41:25.763 INFO:teuthology.orchestra.run.smithi063.stdout:(22/150): librgw2-18.0.0-7690.gc7b0e682.el9.x86 9.4 MB/s | 4.8 MB 00:00 2023-12-04T10:41:25.804 INFO:teuthology.orchestra.run.smithi063.stdout:(23/150): python3-rbd-18.0.0-7690.gc7b0e682.el9 1.6 MB/s | 297 kB 00:00 2023-12-04T10:41:25.838 INFO:teuthology.orchestra.run.smithi063.stdout:(24/150): python3-rgw-18.0.0-7690.gc7b0e682.el9 1.3 MB/s | 99 kB 00:00 2023-12-04T10:41:25.872 INFO:teuthology.orchestra.run.smithi063.stdout:(25/150): rbd-fuse-18.0.0-7690.gc7b0e682.el9.x8 1.3 MB/s | 85 kB 00:00 2023-12-04T10:41:25.930 INFO:teuthology.orchestra.run.smithi063.stdout:(26/150): rbd-nbd-18.0.0-7690.gc7b0e682.el9.x86 2.9 MB/s | 170 kB 00:00 2023-12-04T10:41:26.022 INFO:teuthology.orchestra.run.smithi063.stdout:(27/150): ceph-grafana-dashboards-18.0.0-7690.g 310 kB/s | 28 kB 00:00 2023-12-04T10:41:26.106 INFO:teuthology.orchestra.run.smithi063.stdout:(28/150): ceph-mgr-cephadm-18.0.0-7690.gc7b0e68 1.6 MB/s | 133 kB 00:00 2023-12-04T10:41:26.176 INFO:teuthology.orchestra.run.smithi066.stdout:(96/150): gperftools-libs-2.9.1-2.el9.x86_64.rp 353 kB/s | 309 kB 00:00 2023-12-04T10:41:26.189 INFO:teuthology.orchestra.run.smithi063.stdout:(29/150): rbd-mirror-18.0.0-7690.gc7b0e682.el9. 8.6 MB/s | 3.0 MB 00:00 2023-12-04T10:41:26.302 INFO:teuthology.orchestra.run.smithi066.stdout:(97/150): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.5 MB/s | 4.1 MB 00:01 2023-12-04T10:41:26.327 INFO:teuthology.orchestra.run.smithi066.stdout:(98/150): libarrow-doc-9.0.0-9.el9.noarch.rpm 163 kB/s | 24 kB 00:00 2023-12-04T10:41:26.348 INFO:teuthology.orchestra.run.smithi063.stdout:(30/150): ceph-mgr-dashboard-18.0.0-7690.gc7b0e 7.3 MB/s | 1.8 MB 00:00 2023-12-04T10:41:26.440 INFO:teuthology.orchestra.run.smithi063.stdout:(31/150): ceph-mgr-modules-core-18.0.0-7690.gc7 2.6 MB/s | 243 kB 00:00 2023-12-04T10:41:26.485 INFO:teuthology.orchestra.run.smithi066.stdout:(99/150): libunwind-1.6.2-1.el9.x86_64.rpm 428 kB/s | 67 kB 00:00 2023-12-04T10:41:26.540 INFO:teuthology.orchestra.run.smithi063.stdout:(32/150): ceph-mgr-rook-18.0.0-7690.gc7b0e682.e 507 kB/s | 50 kB 00:00 2023-12-04T10:41:26.594 INFO:teuthology.orchestra.run.smithi066.stdout:(100/150): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2023-12-04T10:41:26.632 INFO:teuthology.orchestra.run.smithi063.stdout:(33/150): ceph-prometheus-alerts-18.0.0-7690.gc 167 kB/s | 15 kB 00:00 2023-12-04T10:41:26.724 INFO:teuthology.orchestra.run.smithi063.stdout:(34/150): ceph-volume-18.0.0-7690.gc7b0e682.el9 2.8 MB/s | 262 kB 00:00 2023-12-04T10:41:26.778 INFO:teuthology.orchestra.run.smithi066.stdout:(101/150): libarrow-9.0.0-9.el9.x86_64.rpm 3.4 MB/s | 4.4 MB 00:01 2023-12-04T10:41:26.828 INFO:teuthology.orchestra.run.smithi066.stdout:(102/150): parquet-libs-9.0.0-9.el9.x86_64.rpm 3.5 MB/s | 837 kB 00:00 2023-12-04T10:41:26.891 INFO:teuthology.orchestra.run.smithi063.stdout:(35/150): cephadm-18.0.0-7690.gc7b0e682.el9.noa 4.6 MB/s | 776 kB 00:00 2023-12-04T10:41:26.894 INFO:teuthology.orchestra.run.smithi066.stdout:(103/150): liboath-2.6.7-2.el9.x86_64.rpm 82 kB/s | 49 kB 00:00 2023-12-04T10:41:26.946 INFO:teuthology.orchestra.run.smithi066.stdout:(104/150): python3-asyncssh-2.13.2-3.el9.noarch 3.2 MB/s | 548 kB 00:00 2023-12-04T10:41:26.971 INFO:teuthology.orchestra.run.smithi066.stdout:(105/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 306 kB/s | 43 kB 00:00 2023-12-04T10:41:27.046 INFO:teuthology.orchestra.run.smithi066.stdout:(106/150): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2023-12-04T10:41:27.071 INFO:teuthology.orchestra.run.smithi066.stdout:(107/150): python3-cachetools-4.2.4-1.el9.noarc 182 kB/s | 32 kB 00:00 2023-12-04T10:41:27.105 INFO:teuthology.orchestra.run.smithi066.stdout:(108/150): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2023-12-04T10:41:27.172 INFO:teuthology.orchestra.run.smithi066.stdout:(109/150): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2023-12-04T10:41:27.205 INFO:teuthology.orchestra.run.smithi066.stdout:(110/150): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-12-04T10:41:27.272 INFO:teuthology.orchestra.run.smithi066.stdout:(111/150): python3-jaraco-classes-3.2.1-5.el9.n 177 kB/s | 18 kB 00:00 2023-12-04T10:41:27.316 INFO:teuthology.orchestra.run.smithi063.stdout:(36/150): ceph-test-18.0.0-7690.gc7b0e682.el9.x 14 MB/s | 41 MB 00:02 2023-12-04T10:41:27.330 INFO:teuthology.orchestra.run.smithi066.stdout:(112/150): python3-jaraco-collections-3.0.0-8.e 187 kB/s | 23 kB 00:00 2023-12-04T10:41:27.358 INFO:teuthology.orchestra.run.smithi063.stdout:(37/150): cephfs-top-18.0.0-7690.gc7b0e682.el9. 39 kB/s | 18 kB 00:00 2023-12-04T10:41:27.364 INFO:teuthology.orchestra.run.smithi066.stdout:(113/150): python3-google-auth-2.23.4-1.el9.noa 676 kB/s | 197 kB 00:00 2023-12-04T10:41:27.390 INFO:teuthology.orchestra.run.smithi066.stdout:(114/150): python3-jaraco-functools-3.5.0-2.el9 167 kB/s | 19 kB 00:00 2023-12-04T10:41:27.423 INFO:teuthology.orchestra.run.smithi066.stdout:(115/150): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2023-12-04T10:41:27.465 INFO:teuthology.orchestra.run.smithi066.stdout:(116/150): python3-jwt+crypto-2.4.0-1.el9.noarc 91 kB/s | 9.0 kB 00:00 2023-12-04T10:41:27.491 INFO:teuthology.orchestra.run.smithi066.stdout:(117/150): python3-jwt-2.4.0-1.el9.noarch.rpm 409 kB/s | 41 kB 00:00 2023-12-04T10:41:27.566 INFO:teuthology.orchestra.run.smithi066.stdout:(118/150): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2023-12-04T10:41:27.591 INFO:teuthology.orchestra.run.smithi066.stdout:(119/150): python3-logutils-0.3.5-21.el9.noarch 370 kB/s | 46 kB 00:00 2023-12-04T10:41:27.592 INFO:teuthology.orchestra.run.smithi063.stdout:(38/150): ceph-mgr-diskprediction-local-18.0.0- 5.3 MB/s | 7.4 MB 00:01 2023-12-04T10:41:27.616 INFO:teuthology.orchestra.run.smithi066.stdout:(120/150): python3-more-itertools-8.12.0-2.el9. 631 kB/s | 79 kB 00:00 2023-12-04T10:41:27.658 INFO:teuthology.orchestra.run.smithi066.stdout:(121/150): python3-natsort-7.1.1-5.el9.noarch.r 631 kB/s | 58 kB 00:00 2023-12-04T10:41:27.700 INFO:teuthology.orchestra.run.smithi063.stdout:(39/150): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 920 kB 00:00 2023-12-04T10:41:27.708 INFO:teuthology.orchestra.run.smithi066.stdout:(122/150): python3-portend-3.1.0-2.el9.noarch.r 180 kB/s | 16 kB 00:00 2023-12-04T10:41:27.751 INFO:teuthology.orchestra.run.smithi063.stdout:(40/150): automake-1.16.2-8.el9.noarch.rpm 1.5 MB/s | 662 kB 00:00 2023-12-04T10:41:27.776 INFO:teuthology.orchestra.run.smithi066.stdout:(123/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 773 kB/s | 90 kB 00:00 2023-12-04T10:41:27.776 INFO:teuthology.orchestra.run.smithi063.stdout:(41/150): boost-program-options-1.75.0-8.el9.x8 592 kB/s | 106 kB 00:00 2023-12-04T10:41:27.809 INFO:teuthology.orchestra.run.smithi066.stdout:(124/150): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2023-12-04T10:41:27.826 INFO:teuthology.orchestra.run.smithi063.stdout:(42/150): elfutils-libelf-devel-0.190-1.el9.x86 176 kB/s | 21 kB 00:00 2023-12-04T10:41:27.834 INFO:teuthology.orchestra.run.smithi066.stdout:(125/150): python3-repoze-lru-0.7-16.el9.noarch 246 kB/s | 31 kB 00:00 2023-12-04T10:41:27.868 INFO:teuthology.orchestra.run.smithi063.stdout:(43/150): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 307 kB 00:00 2023-12-04T10:41:27.884 INFO:teuthology.orchestra.run.smithi066.stdout:(126/150): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2023-12-04T10:41:27.918 INFO:teuthology.orchestra.run.smithi066.stdout:(127/150): python3-rsa-4.9-2.el9.noarch.rpm 546 kB/s | 59 kB 00:00 2023-12-04T10:41:27.927 INFO:teuthology.orchestra.run.smithi063.stdout:(44/150): flexiblas-3.0.4-8.el9.x86_64.rpm 328 kB/s | 32 kB 00:00 2023-12-04T10:41:27.944 INFO:teuthology.orchestra.run.smithi066.stdout:(128/150): python3-tempora-5.0.0-2.el9.noarch.r 330 kB/s | 36 kB 00:00 2023-12-04T10:41:27.985 INFO:teuthology.orchestra.run.smithi066.stdout:(129/150): python3-typing-extensions-4.4.0-2.el 509 kB/s | 51 kB 00:00 2023-12-04T10:41:28.019 INFO:teuthology.orchestra.run.smithi063.stdout:(45/150): flexiblas-openblas-openmp-3.0.4-8.el9 119 kB/s | 17 kB 00:00 2023-12-04T10:41:28.027 INFO:teuthology.orchestra.run.smithi066.stdout:(130/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2023-12-04T10:41:28.053 INFO:teuthology.orchestra.run.smithi066.stdout:(131/150): python3-websocket-client-1.2.3-2.el9 828 kB/s | 90 kB 00:00 2023-12-04T10:41:28.094 INFO:teuthology.orchestra.run.smithi063.stdout:(46/150): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2023-12-04T10:41:28.111 INFO:teuthology.orchestra.run.smithi066.stdout:(132/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2023-12-04T10:41:28.119 INFO:teuthology.orchestra.run.smithi063.stdout:(47/150): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 186 kB 00:00 2023-12-04T10:41:28.136 INFO:teuthology.orchestra.run.smithi066.stdout:(133/150): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2023-12-04T10:41:28.146 INFO:teuthology.orchestra.run.smithi063.stdout:(48/150): libaio-devel-0.3.111-13.el9.x86_64.rp 84 kB/s | 10 kB 00:00 2023-12-04T10:41:28.169 INFO:teuthology.orchestra.run.smithi063.stdout:(49/150): librabbitmq-0.11.0-7.el9.x86_64.rpm 909 kB/s | 44 kB 00:00 2023-12-04T10:41:28.187 INFO:teuthology.orchestra.run.smithi066.stdout:(134/150): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2023-12-04T10:41:28.195 INFO:teuthology.orchestra.run.smithi063.stdout:(50/150): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2023-12-04T10:41:28.228 INFO:teuthology.orchestra.run.smithi063.stdout:(51/150): librdkafka-1.6.1-102.el9.x86_64.rpm 7.8 MB/s | 661 kB 00:00 2023-12-04T10:41:28.262 INFO:teuthology.orchestra.run.smithi063.stdout:(52/150): libtool-2.4.6-45.el9.x86_64.rpm 6.7 MB/s | 578 kB 00:00 2023-12-04T10:41:28.271 INFO:teuthology.orchestra.run.smithi066.stdout:(135/150): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2023-12-04T10:41:28.287 INFO:teuthology.orchestra.run.smithi063.stdout:(53/150): libuuid-devel-2.37.4-15.el9.x86_64.rp 271 kB/s | 24 kB 00:00 2023-12-04T10:41:28.312 INFO:teuthology.orchestra.run.smithi063.stdout:(54/150): libzstd-devel-1.5.1-2.el9.x86_64.rpm 590 kB/s | 46 kB 00:00 2023-12-04T10:41:28.313 INFO:teuthology.orchestra.run.smithi066.stdout:(136/150): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 68 kB 00:00 2023-12-04T10:41:28.346 INFO:teuthology.orchestra.run.smithi063.stdout:(55/150): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-04T10:41:28.355 INFO:teuthology.orchestra.run.smithi066.stdout:(137/150): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 69 kB 00:00 2023-12-04T10:41:28.388 INFO:teuthology.orchestra.run.smithi066.stdout:(138/150): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-04T10:41:28.401 INFO:teuthology.orchestra.run.smithi063.stdout:(56/150): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 187 kB 00:00 2023-12-04T10:41:28.430 INFO:teuthology.orchestra.run.smithi066.stdout:(139/150): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-04T10:41:28.438 INFO:teuthology.orchestra.run.smithi063.stdout:(57/150): oniguruma-6.9.6-1.el9.5.x86_64.rpm 1.7 MB/s | 217 kB 00:00 2023-12-04T10:41:28.472 INFO:teuthology.orchestra.run.smithi063.stdout:(58/150): openblas-0.3.21-2.el9.x86_64.rpm 506 kB/s | 34 kB 00:00 2023-12-04T10:41:28.472 INFO:teuthology.orchestra.run.smithi066.stdout:(140/150): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-04T10:41:28.506 INFO:teuthology.orchestra.run.smithi066.stdout:(141/150): libacl-2.3.1-4.el9.x86_64.rpm 677 kB/s | 22 kB 00:00 2023-12-04T10:41:28.557 INFO:teuthology.orchestra.run.smithi066.stdout:(142/150): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2023-12-04T10:41:28.639 INFO:teuthology.orchestra.run.smithi063.stdout:(59/150): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2023-12-04T10:41:28.648 INFO:teuthology.orchestra.run.smithi066.stdout:(143/150): librados2-18.0.0-7690.gc7b0e682.el9. 6.5 MB/s | 3.3 MB 00:00 2023-12-04T10:41:28.706 INFO:teuthology.orchestra.run.smithi063.stdout:(60/150): postgresql-13.11-1.el9.x86_64.rpm 5.7 MB/s | 1.5 MB 00:00 2023-12-04T10:41:28.723 INFO:teuthology.orchestra.run.smithi066.stdout:(144/150): librbd1-18.0.0-7690.gc7b0e682.el9.x8 5.6 MB/s | 3.0 MB 00:00 2023-12-04T10:41:28.739 INFO:teuthology.orchestra.run.smithi063.stdout:(61/150): postgresql-contrib-13.11-1.el9.x86_64 3.1 MB/s | 811 kB 00:00 2023-12-04T10:41:28.765 INFO:teuthology.orchestra.run.smithi063.stdout:(62/150): postgresql-private-libs-13.11-1.el9.x 1.2 MB/s | 134 kB 00:00 2023-12-04T10:41:28.849 INFO:teuthology.orchestra.run.smithi066.stdout:(145/150): NetworkManager-team-1.45.7-1.el9.x86 350 kB/s | 43 kB 00:00 2023-12-04T10:41:28.941 INFO:teuthology.orchestra.run.smithi066.stdout:(146/150): NetworkManager-libnm-1.45.7-1.el9.x8 6.1 MB/s | 1.8 MB 00:00 2023-12-04T10:41:29.032 INFO:teuthology.orchestra.run.smithi063.stdout:(63/150): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-12-04T10:41:29.049 INFO:teuthology.orchestra.run.smithi066.stdout:(147/150): NetworkManager-tui-1.45.7-1.el9.x86_ 1.2 MB/s | 246 kB 00:00 2023-12-04T10:41:29.149 INFO:teuthology.orchestra.run.smithi063.stdout:(64/150): postgresql-server-13.11-1.el9.x86_64. 14 MB/s | 5.7 MB 00:00 2023-12-04T10:41:29.149 INFO:teuthology.orchestra.run.smithi066.stdout:(148/150): NetworkManager-1.45.7-1.el9.x86_64.r 3.8 MB/s | 2.3 MB 00:00 2023-12-04T10:41:29.173 INFO:teuthology.orchestra.run.smithi063.stdout:(65/150): python3-jinja2-2.11.3-4.el9.noarch.rp 560 kB/s | 228 kB 00:00 2023-12-04T10:41:29.199 INFO:teuthology.orchestra.run.smithi063.stdout:(66/150): python3-jsonpatch-1.21-16.el9.noarch. 153 kB/s | 24 kB 00:00 2023-12-04T10:41:29.208 INFO:teuthology.orchestra.run.smithi066.stdout:(149/150): openssl-3.0.7-25.el9.x86_64.rpm 4.6 MB/s | 1.2 MB 00:00 2023-12-04T10:41:29.225 INFO:teuthology.orchestra.run.smithi063.stdout:(67/150): python3-jsonpointer-2.0-4.el9.noarch. 369 kB/s | 18 kB 00:00 2023-12-04T10:41:29.258 INFO:teuthology.orchestra.run.smithi063.stdout:(68/150): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 144 kB 00:00 2023-12-04T10:41:29.283 INFO:teuthology.orchestra.run.smithi063.stdout:(69/150): python3-markupsafe-1.1.1-12.el9.x86_6 388 kB/s | 32 kB 00:00 2023-12-04T10:41:29.316 INFO:teuthology.orchestra.run.smithi063.stdout:(70/150): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 217 kB 00:00 2023-12-04T10:41:29.442 INFO:teuthology.orchestra.run.smithi063.stdout:(71/150): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2023-12-04T10:41:29.467 INFO:teuthology.orchestra.run.smithi063.stdout:(72/150): python3-oauthlib-3.1.1-5.el9.noarch.r 957 kB/s | 174 kB 00:00 2023-12-04T10:41:29.483 INFO:teuthology.orchestra.run.smithi066.stdout:(150/150): openssl-libs-3.0.7-25.el9.x86_64.rpm 5.0 MB/s | 2.2 MB 00:00 2023-12-04T10:41:29.483 INFO:teuthology.orchestra.run.smithi063.stdout:(73/150): python3-prettytable-0.7.2-27.el9.noar 276 kB/s | 41 kB 00:00 2023-12-04T10:41:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2023-12-04T10:41:29.500 INFO:teuthology.orchestra.run.smithi066.stdout:Total 15 MB/s | 204 MB 00:13 2023-12-04T10:41:29.526 INFO:teuthology.orchestra.run.smithi063.stdout:(74/150): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-12-04T10:41:29.551 INFO:teuthology.orchestra.run.smithi063.stdout:(75/150): python3-pytz-2021.1-5.el9.noarch.rpm 729 kB/s | 47 kB 00:00 2023-12-04T10:41:29.585 INFO:teuthology.orchestra.run.smithi063.stdout:(76/150): python3-pyasn1-modules-0.4.8-6.el9.no 2.1 MB/s | 211 kB 00:00 2023-12-04T10:41:29.626 INFO:teuthology.orchestra.run.smithi063.stdout:(77/150): python3-requests-oauthlib-1.3.0-12.el 591 kB/s | 43 kB 00:00 2023-12-04T10:41:29.752 INFO:teuthology.orchestra.run.smithi063.stdout:(78/150): python3-toml-0.10.2-6.el9.noarch.rpm 233 kB/s | 39 kB 00:00 2023-12-04T10:41:29.961 INFO:teuthology.orchestra.run.smithi063.stdout:(79/150): python3-scipy-1.6.2-8.el9.x86_64.rpm 39 MB/s | 16 MB 00:00 2023-12-04T10:41:29.982 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2023-12-04T10:41:29.985 INFO:teuthology.orchestra.run.smithi063.stdout:(80/150): socat-1.7.4.1-5.el9.x86_64.rpm 878 kB/s | 300 kB 00:00 2023-12-04T10:41:30.002 INFO:teuthology.orchestra.run.smithi063.stdout:(81/150): uuid-1.6.2-55.el9.x86_64.rpm 241 kB/s | 56 kB 00:00 2023-12-04T10:41:30.036 INFO:teuthology.orchestra.run.smithi063.stdout:(82/150): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.4 MB/s | 44 kB 00:00 2023-12-04T10:41:30.061 INFO:teuthology.orchestra.run.smithi063.stdout:(83/150): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.5 MB/s | 85 kB 00:00 2023-12-04T10:41:30.078 INFO:teuthology.orchestra.run.smithi063.stdout:(84/150): xmlstarlet-1.6.1-20.el9.x86_64.rpm 851 kB/s | 63 kB 00:00 2023-12-04T10:41:30.103 INFO:teuthology.orchestra.run.smithi063.stdout:(85/150): fuse-2.9.9-15.el9.x86_64.rpm 1.2 MB/s | 79 kB 00:00 2023-12-04T10:41:30.137 INFO:teuthology.orchestra.run.smithi063.stdout:(86/150): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.4 MB/s | 195 kB 00:00 2023-12-04T10:41:30.187 INFO:teuthology.orchestra.run.smithi063.stdout:(87/150): libgfortran-11.4.1-2.3.el9.x86_64.rpm 7.3 MB/s | 803 kB 00:00 2023-12-04T10:41:30.212 INFO:teuthology.orchestra.run.smithi063.stdout:(88/150): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.2 MB/s | 241 kB 00:00 2023-12-04T10:41:30.271 INFO:teuthology.orchestra.run.smithi063.stdout:(89/150): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.1 MB 00:00 2023-12-04T10:41:30.290 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2023-12-04T10:41:30.290 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2023-12-04T10:41:30.321 INFO:teuthology.orchestra.run.smithi063.stdout:(90/150): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2023-12-04T10:41:30.349 INFO:teuthology.orchestra.run.smithi063.stdout:(91/150): python3-pycparser-2.20-6.el9.noarch.r 1.0 MB/s | 124 kB 00:00 2023-12-04T10:41:30.372 INFO:teuthology.orchestra.run.smithi063.stdout:(92/150): python3-requests-2.25.1-7.el9.noarch. 1.1 MB/s | 113 kB 00:00 2023-12-04T10:41:30.406 INFO:teuthology.orchestra.run.smithi063.stdout:(93/150): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-04T10:41:30.498 INFO:teuthology.orchestra.run.smithi063.stdout:(94/150): lua-devel-5.4.4-4.el9.x86_64.rpm 246 kB/s | 22 kB 00:00 2023-12-04T10:41:30.531 INFO:teuthology.orchestra.run.smithi063.stdout:(95/150): python3-devel-3.9.17-2.el9.x86_64.rpm 1.5 MB/s | 245 kB 00:00 2023-12-04T10:41:30.656 INFO:teuthology.orchestra.run.smithi063.stdout:(96/150): gperftools-libs-2.9.1-2.el9.x86_64.rp 1.9 MB/s | 309 kB 00:00 2023-12-04T10:41:30.698 INFO:teuthology.orchestra.run.smithi063.stdout:(97/150): libarrow-doc-9.0.0-9.el9.noarch.rpm 598 kB/s | 24 kB 00:00 2023-12-04T10:41:30.740 INFO:teuthology.orchestra.run.smithi063.stdout:(98/150): liboath-2.6.7-2.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2023-12-04T10:41:30.791 INFO:teuthology.orchestra.run.smithi063.stdout:(99/150): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2023-12-04T10:41:30.841 INFO:teuthology.orchestra.run.smithi063.stdout:(100/150): luarocks-3.9.2-1.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2023-12-04T10:41:30.949 INFO:teuthology.orchestra.run.smithi063.stdout:(101/150): libarrow-9.0.0-9.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2023-12-04T10:41:31.016 INFO:teuthology.orchestra.run.smithi063.stdout:(102/150): parquet-libs-9.0.0-9.el9.x86_64.rpm 4.7 MB/s | 837 kB 00:00 2023-12-04T10:41:31.050 INFO:teuthology.orchestra.run.smithi063.stdout:(103/150): python3-asyncssh-2.13.2-3.el9.noarch 5.4 MB/s | 548 kB 00:00 2023-12-04T10:41:31.075 INFO:teuthology.orchestra.run.smithi063.stdout:(104/150): python3-bcrypt-3.2.2-1.el9.x86_64.rp 752 kB/s | 43 kB 00:00 2023-12-04T10:41:31.100 INFO:teuthology.orchestra.run.smithi063.stdout:(105/150): python3-cachetools-4.2.4-1.el9.noarc 651 kB/s | 32 kB 00:00 2023-12-04T10:41:31.126 INFO:teuthology.orchestra.run.smithi063.stdout:(106/150): python3-certifi-2021.10.8-2.el9.noar 304 kB/s | 15 kB 00:00 2023-12-04T10:41:31.159 INFO:teuthology.orchestra.run.smithi063.stdout:(107/150): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2023-12-04T10:41:31.201 INFO:teuthology.orchestra.run.smithi063.stdout:(108/150): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2023-12-04T10:41:31.235 INFO:teuthology.orchestra.run.smithi063.stdout:(109/150): python3-google-auth-2.23.4-1.el9.noa 2.6 MB/s | 197 kB 00:00 2023-12-04T10:41:31.282 INFO:teuthology.orchestra.run.smithi063.stdout:(110/150): python3-jaraco-8.2.1-3.el9.noarch.rp 134 kB/s | 11 kB 00:00 2023-12-04T10:41:31.311 INFO:teuthology.orchestra.run.smithi063.stdout:(111/150): python3-jaraco-classes-3.2.1-5.el9.n 237 kB/s | 18 kB 00:00 2023-12-04T10:41:31.402 INFO:teuthology.orchestra.run.smithi063.stdout:(112/150): openssl-devel-3.0.7-25.el9.x86_64.rp 3.9 MB/s | 4.1 MB 00:01 2023-12-04T10:41:31.429 INFO:teuthology.orchestra.run.smithi063.stdout:(113/150): python3-jaraco-collections-3.0.0-8.e 160 kB/s | 23 kB 00:00 2023-12-04T10:41:31.453 INFO:teuthology.orchestra.run.smithi063.stdout:(114/150): python3-jaraco-functools-3.5.0-2.el9 137 kB/s | 19 kB 00:00 2023-12-04T10:41:31.478 INFO:teuthology.orchestra.run.smithi063.stdout:(115/150): python3-jaraco-text-3.2.0-6.el9.noar 264 kB/s | 20 kB 00:00 2023-12-04T10:41:31.495 INFO:teuthology.orchestra.run.smithi063.stdout:(116/150): python3-jwt+crypto-2.4.0-1.el9.noarc 137 kB/s | 9.0 kB 00:00 2023-12-04T10:41:31.521 INFO:teuthology.orchestra.run.smithi063.stdout:(117/150): python3-jwt-2.4.0-1.el9.noarch.rpm 615 kB/s | 41 kB 00:00 2023-12-04T10:41:31.571 INFO:teuthology.orchestra.run.smithi063.stdout:(118/150): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2023-12-04T10:41:31.613 INFO:teuthology.orchestra.run.smithi063.stdout:(119/150): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2023-12-04T10:41:31.630 INFO:teuthology.orchestra.run.smithi063.stdout:(120/150): python3-logutils-0.3.5-21.el9.noarch 348 kB/s | 46 kB 00:00 2023-12-04T10:41:31.647 INFO:teuthology.orchestra.run.smithi063.stdout:(121/150): python3-natsort-7.1.1-5.el9.noarch.r 773 kB/s | 58 kB 00:00 2023-12-04T10:41:31.680 INFO:teuthology.orchestra.run.smithi063.stdout:(122/150): python3-portend-3.1.0-2.el9.noarch.r 335 kB/s | 16 kB 00:00 2023-12-04T10:41:31.705 INFO:teuthology.orchestra.run.smithi063.stdout:(123/150): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2023-12-04T10:41:31.722 INFO:teuthology.orchestra.run.smithi063.stdout:(124/150): python3-repoze-lru-0.7-16.el9.noarch 749 kB/s | 31 kB 00:00 2023-12-04T10:41:31.756 INFO:teuthology.orchestra.run.smithi063.stdout:(125/150): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2023-12-04T10:41:31.782 INFO:teuthology.orchestra.run.smithi063.stdout:(126/150): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2023-12-04T10:41:31.798 INFO:teuthology.orchestra.run.smithi063.stdout:(127/150): python3-tempora-5.0.0-2.el9.noarch.r 872 kB/s | 36 kB 00:00 2023-12-04T10:41:31.823 INFO:teuthology.orchestra.run.smithi063.stdout:(128/150): python3-routes-2.5.1-5.el9.noarch.rp 1.6 MB/s | 188 kB 00:00 2023-12-04T10:41:31.840 INFO:teuthology.orchestra.run.smithi063.stdout:(129/150): python3-typing-extensions-4.4.0-2.el 880 kB/s | 51 kB 00:00 2023-12-04T10:41:31.866 INFO:teuthology.orchestra.run.smithi063.stdout:(130/150): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2023-12-04T10:41:31.891 INFO:teuthology.orchestra.run.smithi063.stdout:(131/150): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-12-04T10:41:31.917 INFO:teuthology.orchestra.run.smithi063.stdout:(132/150): python3-zc-lockfile-2.0-10.el9.noarc 405 kB/s | 20 kB 00:00 2023-12-04T10:41:31.958 INFO:teuthology.orchestra.run.smithi063.stdout:(133/150): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-12-04T10:41:31.992 INFO:teuthology.orchestra.run.smithi063.stdout:(134/150): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2023-12-04T10:41:32.059 INFO:teuthology.orchestra.run.smithi063.stdout:(135/150): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2023-12-04T10:41:32.093 INFO:teuthology.orchestra.run.smithi063.stdout:(136/150): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-04T10:41:32.126 INFO:teuthology.orchestra.run.smithi063.stdout:(137/150): acl-2.3.1-4.el9.x86_64.rpm 2.1 MB/s | 69 kB 00:00 2023-12-04T10:41:32.160 INFO:teuthology.orchestra.run.smithi063.stdout:(138/150): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-04T10:41:32.235 INFO:teuthology.orchestra.run.smithi063.stdout:(139/150): elfutils-libelf-0.190-1.el9.x86_64.r 2.5 MB/s | 192 kB 00:00 2023-12-04T10:41:32.294 INFO:teuthology.orchestra.run.smithi063.stdout:(140/150): elfutils-libs-0.190-1.el9.x86_64.rpm 4.3 MB/s | 255 kB 00:00 2023-12-04T10:41:32.344 INFO:teuthology.orchestra.run.smithi063.stdout:(141/150): libacl-2.3.1-4.el9.x86_64.rpm 447 kB/s | 22 kB 00:00 2023-12-04T10:41:32.427 INFO:teuthology.orchestra.run.smithi063.stdout:(142/150): librados2-18.0.0-7690.gc7b0e682.el9. 7.1 MB/s | 3.3 MB 00:00 2023-12-04T10:41:32.461 INFO:teuthology.orchestra.run.smithi063.stdout:(143/150): xfsdump-3.1.12-4.el9.x86_64.rpm 2.7 MB/s | 321 kB 00:00 2023-12-04T10:41:32.519 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2023-12-04T10:41:32.519 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2023-12-04T10:41:32.536 INFO:teuthology.orchestra.run.smithi063.stdout:(144/150): librbd1-18.0.0-7690.gc7b0e682.el9.x8 5.6 MB/s | 3.0 MB 00:00 2023-12-04T10:41:32.612 INFO:teuthology.orchestra.run.smithi063.stdout:(145/150): NetworkManager-team-1.45.7-1.el9.x86 584 kB/s | 43 kB 00:00 2023-12-04T10:41:32.728 INFO:teuthology.orchestra.run.smithi063.stdout:(146/150): NetworkManager-tui-1.45.7-1.el9.x86_ 2.1 MB/s | 246 kB 00:00 2023-12-04T10:41:32.804 INFO:teuthology.orchestra.run.smithi063.stdout:(147/150): NetworkManager-libnm-1.45.7-1.el9.x8 5.2 MB/s | 1.8 MB 00:00 2023-12-04T10:41:32.971 INFO:teuthology.orchestra.run.smithi063.stdout:(148/150): NetworkManager-1.45.7-1.el9.x86_64.r 4.2 MB/s | 2.3 MB 00:00 2023-12-04T10:41:33.013 INFO:teuthology.orchestra.run.smithi063.stdout:(149/150): openssl-3.0.7-25.el9.x86_64.rpm 4.3 MB/s | 1.2 MB 00:00 2023-12-04T10:41:33.213 INFO:teuthology.orchestra.run.smithi063.stdout:(150/150): openssl-libs-3.0.7-25.el9.x86_64.rpm 5.3 MB/s | 2.2 MB 00:00 2023-12-04T10:41:33.224 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-04T10:41:33.225 INFO:teuthology.orchestra.run.smithi063.stdout:Total 17 MB/s | 204 MB 00:12 2023-12-04T10:41:33.700 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-04T10:41:34.002 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-04T10:41:34.003 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-04T10:41:36.208 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-04T10:41:36.208 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-04T10:41:39.325 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2023-12-04T10:41:39.523 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2023-12-04T10:41:39.559 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/165 2023-12-04T10:41:39.647 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/165 2023-12-04T10:41:39.704 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/165 2023-12-04T10:41:39.742 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2023-12-04T10:41:39.847 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2023-12-04T10:41:40.262 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2023-12-04T10:41:40.306 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:18.0.0-7690.gc7b0e682.el9.x86_64 8/165 2023-12-04T10:41:40.585 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:18.0.0-7690.gc7b0e682.el9.x86_64 8/165 2023-12-04T10:41:40.585 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:18.0.0-7690.gc7b0e682.el9.x86_64 9/165 2023-12-04T10:41:40.656 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:18.0.0-7690.gc7b0e682.el9.x86_64 9/165 2023-12-04T10:41:40.692 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:18.0.0-7690.gc7b0e682.el9.x86_64 10/165 2023-12-04T10:41:40.767 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2023-12-04T10:41:41.063 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/165 2023-12-04T10:41:41.129 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/165 2023-12-04T10:41:41.154 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephsqlite-2:18.0.0-7690.gc7b0e682.el9.x86_64 14/165 2023-12-04T10:41:41.316 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7690.gc7b0e682.el9.x86_64 14/165 2023-12-04T10:41:41.346 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:18.0.0-7690.gc7b0e682.el9.x86 15/165 2023-12-04T10:41:41.860 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7690.gc7b0e682.el9.x86 15/165 2023-12-04T10:41:42.042 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/165 2023-12-04T10:41:42.115 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/165 2023-12-04T10:41:42.320 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-04T10:41:42.379 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-04T10:41:42.631 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-04T10:41:42.720 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-04T10:41:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/165 2023-12-04T10:41:42.902 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/165 2023-12-04T10:41:42.904 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/165 2023-12-04T10:41:42.945 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/165 2023-12-04T10:41:42.981 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/165 2023-12-04T10:41:43.041 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/165 2023-12-04T10:41:43.059 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/165 2023-12-04T10:41:43.105 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2023-12-04T10:41:43.155 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/165 2023-12-04T10:41:43.205 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/165 2023-12-04T10:41:43.207 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2023-12-04T10:41:43.262 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/165 2023-12-04T10:41:43.318 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/165 2023-12-04T10:41:43.444 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/165 2023-12-04T10:41:43.502 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/165 2023-12-04T10:41:43.570 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/165 2023-12-04T10:41:43.612 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2023-12-04T10:41:43.629 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2023-12-04T10:41:43.751 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2023-12-04T10:41:43.790 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:18.0.0-7690.gc7b0e682.el9. 30/165 2023-12-04T10:41:43.843 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:18.0.0-7690.gc7b0e682.el 31/165 2023-12-04T10:41:43.881 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:18.0.0-7690.gc7b0e682.el9.x86_6 32/165 2023-12-04T10:41:43.954 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librados2-2:18.0.0-7690.gc7b0e682.el9.x86_64 8/165 2023-12-04T10:41:44.012 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/165 2023-12-04T10:41:44.140 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/165 2023-12-04T10:41:44.145 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:18.0.0-7690.gc7b0e682.el9.x86_64 8/165 2023-12-04T10:41:44.270 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs2-2:18.0.0-7690.gc7b0e682.el9.x86_64 9/165 2023-12-04T10:41:44.322 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/165 2023-12-04T10:41:44.391 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/165 2023-12-04T10:41:44.408 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephfs2-2:18.0.0-7690.gc7b0e682.el9.x86_64 9/165 2023-12-04T10:41:44.450 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rados-2:18.0.0-7690.gc7b0e682.el9.x86_64 10/165 2023-12-04T10:41:44.526 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/165 2023-12-04T10:41:44.837 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/165 2023-12-04T10:41:44.901 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/165 2023-12-04T10:41:44.925 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephsqlite-2:18.0.0-7690.gc7b0e682.el9.x86_64 14/165 2023-12-04T10:41:45.105 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libcephsqlite-2:18.0.0-7690.gc7b0e682.el9.x86_64 14/165 2023-12-04T10:41:45.107 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/165 2023-12-04T10:41:45.259 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libradosstriper1-2:18.0.0-7690.gc7b0e682.el9.x86 15/165 2023-12-04T10:41:45.335 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/165 2023-12-04T10:41:45.395 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 39/165 2023-12-04T10:41:45.461 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 40/165 2023-12-04T10:41:45.523 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:18.0.0-7690.gc7b0e682.el9.x86_6 41/165 2023-12-04T10:41:45.614 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/165 2023-12-04T10:41:45.666 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libradosstriper1-2:18.0.0-7690.gc7b0e682.el9.x86 15/165 2023-12-04T10:41:45.822 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/165 2023-12-04T10:41:45.845 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/165 2023-12-04T10:41:45.895 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/165 2023-12-04T10:41:45.926 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 44/165 2023-12-04T10:41:46.087 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : re2-1:20211101-3.el9.x86_64 45/165 2023-12-04T10:41:46.097 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-04T10:41:46.155 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 46/165 2023-12-04T10:41:46.175 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-04T10:41:46.238 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/165 2023-12-04T10:41:46.473 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/165 2023-12-04T10:41:46.489 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/165 2023-12-04T10:41:46.523 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/165 2023-12-04T10:41:46.590 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/165 2023-12-04T10:41:46.673 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/165 2023-12-04T10:41:46.679 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/165 2023-12-04T10:41:46.748 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/165 2023-12-04T10:41:46.763 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/165 2023-12-04T10:41:46.818 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/165 2023-12-04T10:41:46.884 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/165 2023-12-04T10:41:46.957 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/165 2023-12-04T10:41:46.992 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/165 2023-12-04T10:41:47.024 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/165 2023-12-04T10:41:47.050 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/165 2023-12-04T10:41:47.095 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/165 2023-12-04T10:41:47.114 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/165 2023-12-04T10:41:47.142 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/165 2023-12-04T10:41:47.222 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/165 2023-12-04T10:41:47.269 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/165 2023-12-04T10:41:47.275 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/165 2023-12-04T10:41:47.314 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/165 2023-12-04T10:41:47.340 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/165 2023-12-04T10:41:47.362 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2023-12-04T10:41:47.426 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/165 2023-12-04T10:41:47.470 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/165 2023-12-04T10:41:47.487 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2023-12-04T10:41:47.524 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-common-2:18.0.0-7690.gc7b0e682.el9. 30/165 2023-12-04T10:41:47.578 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ceph-argparse-2:18.0.0-7690.gc7b0e682.el 31/165 2023-12-04T10:41:47.614 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cephfs-2:18.0.0-7690.gc7b0e682.el9.x86_6 32/165 2023-12-04T10:41:47.685 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 61/165 2023-12-04T10:41:47.736 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 33/165 2023-12-04T10:41:47.852 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : luarocks-3.9.2-1.el9.noarch 34/165 2023-12-04T10:41:47.990 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/165 2023-12-04T10:41:48.066 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 35/165 2023-12-04T10:41:48.075 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/165 2023-12-04T10:41:48.127 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 36/165 2023-12-04T10:41:48.168 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/165 2023-12-04T10:41:48.431 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/165 2023-12-04T10:41:48.493 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/165 2023-12-04T10:41:48.668 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/165 2023-12-04T10:41:48.721 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/165 2023-12-04T10:41:48.753 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/165 2023-12-04T10:41:48.818 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/165 2023-12-04T10:41:48.854 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rsa-4.9-2.el9.noarch 37/165 2023-12-04T10:41:48.878 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/165 2023-12-04T10:41:48.925 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/165 2023-12-04T10:41:48.977 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/165 2023-12-04T10:41:49.039 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/165 2023-12-04T10:41:49.110 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/165 2023-12-04T10:41:49.137 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 38/165 2023-12-04T10:41:49.160 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/165 2023-12-04T10:41:49.186 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 39/165 2023-12-04T10:41:49.247 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 40/165 2023-12-04T10:41:49.294 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librados-devel-2:18.0.0-7690.gc7b0e682.el9.x86_6 41/165 2023-12-04T10:41:49.305 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/165 2023-12-04T10:41:49.353 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 78/165 2023-12-04T10:41:49.398 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/165 2023-12-04T10:41:49.422 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 42/165 2023-12-04T10:41:49.464 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/165 2023-12-04T10:41:49.508 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/165 2023-12-04T10:41:49.651 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 43/165 2023-12-04T10:41:49.659 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/165 2023-12-04T10:41:49.700 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 44/165 2023-12-04T10:41:49.714 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 83/165 2023-12-04T10:41:49.857 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : re2-1:20211101-3.el9.x86_64 45/165 2023-12-04T10:41:49.864 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/165 2023-12-04T10:41:49.896 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-9.0.0-9.el9.x86_64 46/165 2023-12-04T10:41:49.936 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/165 2023-12-04T10:41:49.969 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/165 2023-12-04T10:41:50.061 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/165 2023-12-04T10:41:50.105 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/165 2023-12-04T10:41:50.144 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/165 2023-12-04T10:41:50.215 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/165 2023-12-04T10:41:50.280 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/165 2023-12-04T10:41:50.340 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 53/165 2023-12-04T10:41:50.536 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 54/165 2023-12-04T10:41:50.578 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 55/165 2023-12-04T10:41:50.625 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 56/165 2023-12-04T10:41:50.755 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 57/165 2023-12-04T10:41:50.802 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 58/165 2023-12-04T10:41:50.852 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 59/165 2023-12-04T10:41:50.884 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 60/165 2023-12-04T10:41:50.958 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/165 2023-12-04T10:41:51.018 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/165 2023-12-04T10:41:51.045 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libarrow-doc-9.0.0-9.el9.noarch 61/165 2023-12-04T10:41:51.052 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/165 2023-12-04T10:41:51.085 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/165 2023-12-04T10:41:51.099 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/165 2023-12-04T10:41:51.171 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/165 2023-12-04T10:41:51.251 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/165 2023-12-04T10:41:51.343 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/165 2023-12-04T10:41:51.373 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/165 2023-12-04T10:41:51.479 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/165 2023-12-04T10:41:51.525 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/165 2023-12-04T10:41:51.585 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/165 2023-12-04T10:41:51.760 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/165 2023-12-04T10:41:51.813 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/165 2023-12-04T10:41:51.853 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/165 2023-12-04T10:41:51.893 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/165 2023-12-04T10:41:51.935 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/165 2023-12-04T10:41:51.972 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/165 2023-12-04T10:41:52.016 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/165 2023-12-04T10:41:52.072 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/165 2023-12-04T10:41:52.131 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/165 2023-12-04T10:41:52.182 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/165 2023-12-04T10:41:52.327 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/165 2023-12-04T10:41:52.340 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/165 2023-12-04T10:41:52.368 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 78/165 2023-12-04T10:41:52.402 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 79/165 2023-12-04T10:41:52.468 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 80/165 2023-12-04T10:41:52.483 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/165 2023-12-04T10:41:52.505 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 81/165 2023-12-04T10:41:52.655 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 82/165 2023-12-04T10:41:52.695 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 83/165 2023-12-04T10:41:52.838 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/165 2023-12-04T10:41:52.902 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/165 2023-12-04T10:41:53.924 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/165 2023-12-04T10:41:53.992 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/165 2023-12-04T10:41:54.026 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/165 2023-12-04T10:41:54.059 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/165 2023-12-04T10:41:54.141 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/165 2023-12-04T10:41:54.227 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/165 2023-12-04T10:41:54.264 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 97/165 2023-12-04T10:41:54.294 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : jq-1.6-16.el9.x86_64 98/165 2023-12-04T10:41:54.308 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-0.3.21-2.el9.x86_64 90/165 2023-12-04T10:41:54.346 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 91/165 2023-12-04T10:41:54.372 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2023-12-04T10:41:54.423 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 100/165 2023-12-04T10:41:54.444 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 92/165 2023-12-04T10:41:54.821 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2023-12-04T10:41:54.859 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:18.0.0-7690.gc7b0e682.el9.x86_64 102/165 2023-12-04T10:41:54.982 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:18.0.0-7690.gc7b0e682.el9.x86_64 102/165 2023-12-04T10:41:55.015 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 103/165 2023-12-04T10:41:55.072 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2023-12-04T10:41:55.304 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 93/165 2023-12-04T10:41:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 94/165 2023-12-04T10:41:55.611 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 105/165 2023-12-04T10:41:55.645 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:18.0.0-7690.gc7b0e682.el9.x86_64 106/165 2023-12-04T10:41:55.746 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:18.0.0-7690.gc7b0e682.el9.x86_64 106/165 2023-12-04T10:41:55.772 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 107/165 2023-12-04T10:41:57.089 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 95/165 2023-12-04T10:41:57.182 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 96/165 2023-12-04T10:41:57.221 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 97/165 2023-12-04T10:41:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : jq-1.6-16.el9.x86_64 98/165 2023-12-04T10:41:57.296 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2023-12-04T10:41:57.337 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 100/165 2023-12-04T10:41:57.727 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2023-12-04T10:41:57.757 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : librbd1-2:18.0.0-7690.gc7b0e682.el9.x86_64 102/165 2023-12-04T10:41:57.911 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:18.0.0-7690.gc7b0e682.el9.x86_64 102/165 2023-12-04T10:41:57.947 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 103/165 2023-12-04T10:41:58.002 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2023-12-04T10:41:58.344 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 108/165 2023-12-04T10:41:58.385 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 108/165 2023-12-04T10:41:58.508 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : parquet-libs-9.0.0-9.el9.x86_64 105/165 2023-12-04T10:41:58.535 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : librgw2-2:18.0.0-7690.gc7b0e682.el9.x86_64 106/165 2023-12-04T10:41:58.634 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librgw2-2:18.0.0-7690.gc7b0e682.el9.x86_64 106/165 2023-12-04T10:41:58.662 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : python3-rgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 107/165 2023-12-04T10:41:59.056 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 108/165 2023-12-04T10:41:59.105 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:18.0.0-7690.gc7b0e682.el9.x86_64 109/165 2023-12-04T10:41:59.269 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:18.0.0-7690.gc7b0e682.el9.x86_64 109/165 2023-12-04T10:41:59.269 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-04T10:41:59.269 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-04T10:41:59.269 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:41:59.314 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:18.0.0-7690.gc7b0e682.el9.x86_64 110/165 2023-12-04T10:42:01.321 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 108/165 2023-12-04T10:42:01.559 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 108/165 2023-12-04T10:42:02.272 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 108/165 2023-12-04T10:42:02.355 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-base-2:18.0.0-7690.gc7b0e682.el9.x86_64 109/165 2023-12-04T10:42:02.524 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-base-2:18.0.0-7690.gc7b0e682.el9.x86_64 109/165 2023-12-04T10:42:02.524 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-04T10:42:02.524 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-04T10:42:02.524 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:02.579 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-selinux-2:18.0.0-7690.gc7b0e682.el9.x86_64 110/165 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7690.gc7b0e682.el9.x86_64 110/165 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /root 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2023-12-04T10:42:12.453 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:12.669 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-volume-2:18.0.0-7690.gc7b0e682.el9.noarch 111/165 2023-12-04T10:42:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-volume-2:18.0.0-7690.gc7b0e682.el9.noarch 111/165 2023-12-04T10:42:12.723 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:12.723 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-04T10:42:12.723 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:14.473 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:18.0.0-7690.gc7b0e682.el9.x86_64 112/165 2023-12-04T10:42:14.581 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:18.0.0-7690.gc7b0e682.el9.x86_64 112/165 2023-12-04T10:42:14.581 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:14.581 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-04T10:42:14.581 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-04T10:42:14.581 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-04T10:42:14.582 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:14.820 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:18.0.0-7690.gc7b0e682.el9.x86_64 113/165 2023-12-04T10:42:14.927 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:18.0.0-7690.gc7b0e682.el9.x86_64 113/165 2023-12-04T10:42:14.927 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:14.927 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-04T10:42:14.927 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-04T10:42:14.927 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-04T10:42:14.927 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:15.454 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:18.0.0-7690.gc7b0e682.el9.x86_64 114/165 2023-12-04T10:42:15.543 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:18.0.0-7690.gc7b0e682.el9.x86_64 114/165 2023-12-04T10:42:15.544 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:15.544 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-04T10:42:15.544 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-04T10:42:15.544 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-04T10:42:15.544 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:15.612 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-selinux-2:18.0.0-7690.gc7b0e682.el9.x86_64 110/165 2023-12-04T10:42:15.613 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /sys 2023-12-04T10:42:15.613 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /proc 2023-12-04T10:42:15.613 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /mnt 2023-12-04T10:42:15.613 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /var/tmp 2023-12-04T10:42:15.613 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /home 2023-12-04T10:42:15.613 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /root 2023-12-04T10:42:15.613 INFO:teuthology.orchestra.run.smithi063.stdout:skipping the directory /tmp 2023-12-04T10:42:15.613 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:15.665 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2023-12-04T10:42:15.844 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-volume-2:18.0.0-7690.gc7b0e682.el9.noarch 111/165 2023-12-04T10:42:15.895 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-volume-2:18.0.0-7690.gc7b0e682.el9.noarch 111/165 2023-12-04T10:42:15.895 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:15.896 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-04T10:42:15.896 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:16.271 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 116/165 2023-12-04T10:42:16.307 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 116/165 2023-12-04T10:42:16.352 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7690.gc7b0e682.e 117/165 2023-12-04T10:42:16.459 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7690.gc7b0e682. 118/165 2023-12-04T10:42:16.486 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7690.gc7b0e682.el9.noa 119/165 2023-12-04T10:42:16.820 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7690.gc7b0e682.el9.noa 119/165 2023-12-04T10:42:16.854 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7690.gc7b0e682.el9.n 120/165 2023-12-04T10:42:17.669 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-osd-2:18.0.0-7690.gc7b0e682.el9.x86_64 112/165 2023-12-04T10:42:17.756 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-osd-2:18.0.0-7690.gc7b0e682.el9.x86_64 112/165 2023-12-04T10:42:17.757 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:17.757 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-04T10:42:17.757 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-04T10:42:17.757 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-04T10:42:17.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:17.995 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mds-2:18.0.0-7690.gc7b0e682.el9.x86_64 113/165 2023-12-04T10:42:18.019 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7690.gc7b0e682.el9.n 120/165 2023-12-04T10:42:18.054 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7690.gc7b 121/165 2023-12-04T10:42:18.070 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mds-2:18.0.0-7690.gc7b0e682.el9.x86_64 113/165 2023-12-04T10:42:18.071 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:18.071 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-04T10:42:18.071 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-04T10:42:18.071 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-04T10:42:18.071 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:18.207 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7690.gc7b 121/165 2023-12-04T10:42:18.387 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7690.gc7b0e682.el 122/165 2023-12-04T10:42:18.422 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:18.0.0-7690.gc7b0e682.el9.x86_64 123/165 2023-12-04T10:42:18.510 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7690.gc7b0e682.el9.x86_64 123/165 2023-12-04T10:42:18.510 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:18.510 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-04T10:42:18.511 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-04T10:42:18.511 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-04T10:42:18.511 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:18.574 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:18.0.0-7690.gc7b0e682.el9.noarch 124/165 2023-12-04T10:42:18.604 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mon-2:18.0.0-7690.gc7b0e682.el9.x86_64 114/165 2023-12-04T10:42:18.615 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7690.gc7b0e682.el9.noarch 124/165 2023-12-04T10:42:18.680 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mon-2:18.0.0-7690.gc7b0e682.el9.x86_64 114/165 2023-12-04T10:42:18.681 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:18.681 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-04T10:42:18.681 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-04T10:42:18.681 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-04T10:42:18.681 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:18.683 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:18.0.0-7690.gc7b0e682.el9.x86_64 125/165 2023-12-04T10:42:18.805 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2023-12-04T10:42:19.469 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 116/165 2023-12-04T10:42:19.498 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 116/165 2023-12-04T10:42:19.535 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-7690.gc7b0e682.e 117/165 2023-12-04T10:42:19.593 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/165 2023-12-04T10:42:19.619 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-7690.gc7b0e682. 118/165 2023-12-04T10:42:19.625 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 127/165 2023-12-04T10:42:19.661 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-7690.gc7b0e682.el9.noa 119/165 2023-12-04T10:42:19.717 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 127/165 2023-12-04T10:42:19.718 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:19.718 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-04T10:42:19.718 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-04T10:42:19.718 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-04T10:42:19.718 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:19.776 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7690.gc7b0e 128/165 2023-12-04T10:42:19.857 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7690.gc7b0e 128/165 2023-12-04T10:42:19.858 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:19.858 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-04T10:42:19.858 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:19.935 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 129/165 2023-12-04T10:42:19.992 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-7690.gc7b0e682.el9.noa 119/165 2023-12-04T10:42:20.028 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-7690.gc7b0e682.el9.n 120/165 2023-12-04T10:42:20.047 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 129/165 2023-12-04T10:42:20.047 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:20.047 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-04T10:42:20.047 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-04T10:42:20.047 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-04T10:42:20.047 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:20.443 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 130/165 2023-12-04T10:42:20.527 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 130/165 2023-12-04T10:42:20.528 INFO:teuthology.orchestra.run.smithi066.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:20.528 INFO:teuthology.orchestra.run.smithi066.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-04T10:42:20.528 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-04T10:42:20.528 INFO:teuthology.orchestra.run.smithi066.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-04T10:42:20.528 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:21.234 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-7690.gc7b0e682.el9.n 120/165 2023-12-04T10:42:21.278 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-7690.gc7b 121/165 2023-12-04T10:42:21.432 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-7690.gc7b 121/165 2023-12-04T10:42:21.612 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-7690.gc7b0e682.el 122/165 2023-12-04T10:42:21.647 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-2:18.0.0-7690.gc7b0e682.el9.x86_64 123/165 2023-12-04T10:42:21.724 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-2:18.0.0-7690.gc7b0e682.el9.x86_64 123/165 2023-12-04T10:42:21.724 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:21.724 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-04T10:42:21.724 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-04T10:42:21.724 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-04T10:42:21.724 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:21.789 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-mgr-rook-2:18.0.0-7690.gc7b0e682.el9.noarch 124/165 2023-12-04T10:42:21.831 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-7690.gc7b0e682.el9.noarch 124/165 2023-12-04T10:42:21.888 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-2:18.0.0-7690.gc7b0e682.el9.x86_64 125/165 2023-12-04T10:42:22.791 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libtool-2.4.6-45.el9.x86_64 126/165 2023-12-04T10:42:22.826 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-radosgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 127/165 2023-12-04T10:42:22.902 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 127/165 2023-12-04T10:42:22.902 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:22.903 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-04T10:42:22.903 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-04T10:42:22.903 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-04T10:42:22.903 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:22.950 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-7690.gc7b0e 128/165 2023-12-04T10:42:23.025 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-7690.gc7b0e 128/165 2023-12-04T10:42:23.026 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:23.026 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-04T10:42:23.026 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:23.092 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 129/165 2023-12-04T10:42:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 129/165 2023-12-04T10:42:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-04T10:42:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-04T10:42:23.201 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-04T10:42:23.201 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:23.576 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 130/165 2023-12-04T10:42:23.665 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: rbd-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 130/165 2023-12-04T10:42:23.665 INFO:teuthology.orchestra.run.smithi063.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-04T10:42:23.665 INFO:teuthology.orchestra.run.smithi063.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-04T10:42:23.665 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-04T10:42:23.665 INFO:teuthology.orchestra.run.smithi063.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-04T10:42:23.665 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:24.925 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:18.0.0-7690.gc7b0e682.el9.x86_64 131/165 2023-12-04T10:42:24.991 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 132/165 2023-12-04T10:42:25.062 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 133/165 2023-12-04T10:42:25.104 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 134/165 2023-12-04T10:42:25.399 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 135/165 2023-12-04T10:42:25.519 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 136/165 2023-12-04T10:42:25.560 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 137/165 2023-12-04T10:42:25.597 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:18.0.0-7690.gc7b0e682.el9.x86_ 138/165 2023-12-04T10:42:25.706 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 139/165 2023-12-04T10:42:25.769 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-12-04T10:42:25.814 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 141/165 2023-12-04T10:42:25.869 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 142/165 2023-12-04T10:42:25.921 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 143/165 2023-12-04T10:42:26.885 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-04T10:42:26.960 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-04T10:42:27.038 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-04T10:42:28.093 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-test-2:18.0.0-7690.gc7b0e682.el9.x86_64 131/165 2023-12-04T10:42:28.150 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 132/165 2023-12-04T10:42:28.215 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rbd-nbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 133/165 2023-12-04T10:42:28.249 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 134/165 2023-12-04T10:42:28.491 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephfs-top-2:18.0.0-7690.gc7b0e682.el9.noarch 145/165 2023-12-04T10:42:28.537 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 135/165 2023-12-04T10:42:28.652 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2023-12-04T10:42:28.668 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 136/165 2023-12-04T10:42:28.701 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : ceph-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 137/165 2023-12-04T10:42:28.715 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 147/165 2023-12-04T10:42:28.743 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcephfs-devel-2:18.0.0-7690.gc7b0e682.el9.x86_ 138/165 2023-12-04T10:42:28.800 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/165 2023-12-04T10:42:28.819 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 139/165 2023-12-04T10:42:28.885 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-12-04T10:42:28.928 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 141/165 2023-12-04T10:42:28.973 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/165 2023-12-04T10:42:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 142/165 2023-12-04T10:42:29.010 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/165 2023-12-04T10:42:29.028 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 143/165 2023-12-04T10:42:29.060 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/165 2023-12-04T10:42:29.103 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 152/165 2023-12-04T10:42:29.154 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 153/165 2023-12-04T10:42:29.154 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-12-04T10:42:29.294 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-12-04T10:42:29.346 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 155/165 2023-12-04T10:42:29.391 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 156/165 2023-12-04T10:42:29.423 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2023-12-04T10:42:29.423 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2023-12-04T10:42:29.553 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2023-12-04T10:42:29.583 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-12-04T10:42:29.623 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-04T10:42:29.624 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-04T10:42:29.966 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-04T10:42:29.966 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-12-04T10:42:30.091 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-12-04T10:42:30.127 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2023-12-04T10:42:30.161 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2023-12-04T10:42:30.195 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 164/165 2023-12-04T10:42:30.277 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-04T10:42:30.326 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-04T10:42:30.327 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 165/165 2023-12-04T10:42:30.390 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 144/165 2023-12-04T10:42:30.622 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 165/165 2023-12-04T10:42:30.622 INFO:teuthology.orchestra.run.smithi066.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-04T10:42:30.623 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:31.834 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : cephfs-top-2:18.0.0-7690.gc7b0e682.el9.noarch 145/165 2023-12-04T10:42:31.963 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 146/165 2023-12-04T10:42:32.013 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 147/165 2023-12-04T10:42:32.087 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 148/165 2023-12-04T10:42:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : flex-2.6.4-9.el9.x86_64 149/165 2023-12-04T10:42:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : bison-3.7.4-5.el9.x86_64 150/165 2023-12-04T10:42:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 151/165 2023-12-04T10:42:32.386 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 152/165 2023-12-04T10:42:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 153/165 2023-12-04T10:42:32.428 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-12-04T10:42:32.559 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 154/165 2023-12-04T10:42:32.611 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 155/165 2023-12-04T10:42:32.656 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 156/165 2023-12-04T10:42:32.688 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 157/165 2023-12-04T10:42:32.688 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 158/165 2023-12-04T10:42:32.859 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 158/165 2023-12-04T10:42:32.890 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-12-04T10:42:32.931 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-04T10:42:32.932 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-04T10:42:33.313 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 160/165 2023-12-04T10:42:33.313 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-12-04T10:42:33.465 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/165 2023-12-04T10:42:33.500 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 162/165 2023-12-04T10:42:33.534 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 163/165 2023-12-04T10:42:33.569 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 164/165 2023-12-04T10:42:33.700 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 165/165 2023-12-04T10:42:33.980 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 165/165 2023-12-04T10:42:33.980 INFO:teuthology.orchestra.run.smithi063.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-04T10:42:33.980 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:18.0.0-7690.gc7b0e682.el9.x86_64 1/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:18.0.0-7690.gc7b0e682.el9.x86_64 2/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 3/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 4/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7690.gc7b0e 5/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:18.0.0-7690.gc7b0e682.el9.x86_64 6/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:18.0.0-7690.gc7b0e682.el9.x86_64 7/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:18.0.0-7690.gc7b0e682.el9.x86_64 8/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:18.0.0-7690.gc7b0e682.el9.x86_64 9/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 10/165 2023-12-04T10:42:35.292 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:18.0.0-7690.gc7b0e682.el9.x86_64 11/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:18.0.0-7690.gc7b0e682.el9.x86_64 12/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 13/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:18.0.0-7690.gc7b0e682.el9.x86_ 14/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:18.0.0-7690.gc7b0e682.el9.x86_64 15/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephsqlite-2:18.0.0-7690.gc7b0e682.el9.x86_64 16/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:18.0.0-7690.gc7b0e682.el9.x86_6 17/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:18.0.0-7690.gc7b0e682.el9.x86 18/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:18.0.0-7690.gc7b0e682.el9.x86_64 19/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7690.gc7b0e682.el 20/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:18.0.0-7690.gc7b0e682.el9. 21/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:18.0.0-7690.gc7b0e682.el9.x86_6 22/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:18.0.0-7690.gc7b0e682.el9.x86_64 23/165 2023-12-04T10:42:35.293 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 24/165 2023-12-04T10:42:35.294 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 25/165 2023-12-04T10:42:35.294 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 26/165 2023-12-04T10:42:35.294 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 27/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 28/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7690.gc7b0e682. 29/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7690.gc7b0e682.el9.noa 30/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7690.gc7b0e682.el9.n 31/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7690.gc7b 32/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7690.gc7b0e682.el 33/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7690.gc7b0e682.el9.noarch 34/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7690.gc7b0e682.e 35/165 2023-12-04T10:42:35.307 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-volume-2:18.0.0-7690.gc7b0e682.el9.noarch 36/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 37/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephfs-top-2:18.0.0-7690.gc7b0e682.el9.noarch 38/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2023-12-04T10:42:35.308 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : jq-1.6-16.el9.x86_64 47/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/165 2023-12-04T10:42:35.309 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/165 2023-12-04T10:42:35.310 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/165 2023-12-04T10:42:35.311 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/165 2023-12-04T10:42:35.312 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 98/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 99/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2023-12-04T10:42:35.313 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 103/165 2023-12-04T10:42:35.314 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2023-12-04T10:42:35.314 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2023-12-04T10:42:35.314 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2023-12-04T10:42:35.314 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2023-12-04T10:42:35.314 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 110/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 116/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 117/165 2023-12-04T10:42:35.315 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/165 2023-12-04T10:42:35.316 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:18.0.0-7690.gc7b0e682.el9.x86_64 136/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:18.0.0-7690.gc7b0e682.el9.x86_64 138/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 141/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : acl-2.3.1-4.el9.x86_64 142/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : acl-2.3.1-3.el9.x86_64 143/165 2023-12-04T10:42:35.317 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 144/165 2023-12-04T10:42:35.318 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/165 2023-12-04T10:42:35.323 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 146/165 2023-12-04T10:42:35.323 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 147/165 2023-12-04T10:42:35.323 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 148/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 149/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 154/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 155/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 156/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 157/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 158/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 160/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 161/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/165 2023-12-04T10:42:35.324 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/165 2023-12-04T10:42:35.325 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/165 2023-12-04T10:42:37.540 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/165 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: acl-2.3.1-4.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-04T10:42:37.541 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.542 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.542 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-04T10:42:37.542 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-04T10:42:37.542 INFO:teuthology.orchestra.run.smithi066.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-04T10:42:37.542 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2023-12-04T10:42:37.542 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.2-8.el9.noarch 2023-12-04T10:42:37.542 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.7.4-5.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.543 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-volume-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: cephfs-top-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.4-9.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-04T10:42:37.544 INFO:teuthology.orchestra.run.smithi066.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-04T10:42:37.545 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-04T10:42:37.545 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-04T10:42:37.545 INFO:teuthology.orchestra.run.smithi066.stdout: jq-1.6-16.el9.x86_64 2023-12-04T10:42:37.545 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-04T10:42:37.545 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-04T10:42:37.545 INFO:teuthology.orchestra.run.smithi066.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-04T10:42:37.545 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: libcephsqlite-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.546 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: lua-5.4.4-4.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-04T10:42:37.547 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-04T10:42:37.548 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-04T10:42:37.548 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-04T10:42:37.548 INFO:teuthology.orchestra.run.smithi066.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-04T10:42:37.548 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-13.11-1.el9.x86_64 2023-12-04T10:42:37.548 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-04T10:42:37.548 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-04T10:42:37.548 INFO:teuthology.orchestra.run.smithi066.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-04T10:42:37.548 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-04T10:42:37.549 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-04T10:42:37.550 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ply-3.11-14.el9.noarch 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-04T10:42:37.551 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-04T10:42:37.552 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: re2-1:20211101-3.el9.x86_64 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-04T10:42:37.553 INFO:teuthology.orchestra.run.smithi066.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-04T10:42:37.554 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-04T10:42:37.554 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-04T10:42:37.554 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-04T10:42:37.554 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:37.554 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2023-12-04T10:42:38.169 DEBUG:teuthology.parallel:result is None 2023-12-04T10:42:38.400 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-2:18.0.0-7690.gc7b0e682.el9.x86_64 1/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-base-2:18.0.0-7690.gc7b0e682.el9.x86_64 2/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 3/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 4/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-7690.gc7b0e 5/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mds-2:18.0.0-7690.gc7b0e682.el9.x86_64 6/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-2:18.0.0-7690.gc7b0e682.el9.x86_64 7/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mon-2:18.0.0-7690.gc7b0e682.el9.x86_64 8/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-osd-2:18.0.0-7690.gc7b0e682.el9.x86_64 9/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-radosgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 10/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-selinux-2:18.0.0-7690.gc7b0e682.el9.x86_64 11/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-test-2:18.0.0-7690.gc7b0e682.el9.x86_64 12/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 13/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs-devel-2:18.0.0-7690.gc7b0e682.el9.x86_ 14/165 2023-12-04T10:42:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephfs2-2:18.0.0-7690.gc7b0e682.el9.x86_64 15/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcephsqlite-2:18.0.0-7690.gc7b0e682.el9.x86_64 16/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados-devel-2:18.0.0-7690.gc7b0e682.el9.x86_6 17/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libradosstriper1-2:18.0.0-7690.gc7b0e682.el9.x86 18/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librgw2-2:18.0.0-7690.gc7b0e682.el9.x86_64 19/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-argparse-2:18.0.0-7690.gc7b0e682.el 20/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ceph-common-2:18.0.0-7690.gc7b0e682.el9. 21/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cephfs-2:18.0.0-7690.gc7b0e682.el9.x86_6 22/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rados-2:18.0.0-7690.gc7b0e682.el9.x86_64 23/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 24/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 25/165 2023-12-04T10:42:38.402 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 26/165 2023-12-04T10:42:38.419 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 27/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rbd-nbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 28/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-7690.gc7b0e682. 29/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-7690.gc7b0e682.el9.noa 30/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-7690.gc7b0e682.el9.n 31/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-7690.gc7b 32/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-7690.gc7b0e682.el 33/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-mgr-rook-2:18.0.0-7690.gc7b0e682.el9.noarch 34/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-7690.gc7b0e682.e 35/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : ceph-volume-2:18.0.0-7690.gc7b0e682.el9.noarch 36/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 37/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cephfs-top-2:18.0.0-7690.gc7b0e682.el9.noarch 38/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/165 2023-12-04T10:42:38.420 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : jq-1.6-16.el9.x86_64 47/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/165 2023-12-04T10:42:38.421 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/165 2023-12-04T10:42:38.422 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/165 2023-12-04T10:42:38.423 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/165 2023-12-04T10:42:38.424 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/165 2023-12-04T10:42:38.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/165 2023-12-04T10:42:38.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/165 2023-12-04T10:42:38.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/165 2023-12-04T10:42:38.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/165 2023-12-04T10:42:38.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/165 2023-12-04T10:42:38.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/165 2023-12-04T10:42:38.426 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 96/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 97/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-9.0.0-9.el9.x86_64 98/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libarrow-doc-9.0.0-9.el9.noarch 99/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 100/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 101/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 102/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : parquet-libs-9.0.0-9.el9.x86_64 103/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 104/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 105/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 106/165 2023-12-04T10:42:38.427 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 107/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 108/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 109/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 110/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 111/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 112/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 113/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 114/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 115/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 116/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 117/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 118/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 119/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 120/165 2023-12-04T10:42:38.428 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 121/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 122/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 123/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 124/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 125/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 126/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 127/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 128/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 129/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 130/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 131/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 132/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 133/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : re2-1:20211101-3.el9.x86_64 134/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 135/165 2023-12-04T10:42:38.429 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:18.0.0-7690.gc7b0e682.el9.x86_64 136/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 137/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:18.0.0-7690.gc7b0e682.el9.x86_64 138/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 139/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 140/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 141/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : acl-2.3.1-4.el9.x86_64 142/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : acl-2.3.1-3.el9.x86_64 143/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 144/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 145/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 146/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 147/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 148/165 2023-12-04T10:42:38.430 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 149/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 150/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 151/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 152/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 153/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 154/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 155/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 156/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 157/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 158/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 159/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 160/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 161/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 162/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 163/165 2023-12-04T10:42:38.431 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 164/165 2023-12-04T10:42:40.592 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 165/165 2023-12-04T10:42:40.592 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:40.592 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2023-12-04T10:42:40.592 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-04T10:42:40.592 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-04T10:42:40.592 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-04T10:42:40.592 INFO:teuthology.orchestra.run.smithi063.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: acl-2.3.1-4.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: librados2-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: librbd1-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-04T10:42:40.593 INFO:teuthology.orchestra.run.smithi063.stdout: automake-1.16.2-8.el9.noarch 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: bison-3.7.4-5.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-base-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-grafana-dashboards-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-immutable-object-cache-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mds-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-dashboard-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-diskprediction-local-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.594 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-modules-core-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mgr-rook-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-mon-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-osd-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-prometheus-alerts-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-radosgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-selinux-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-test-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: ceph-volume-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: cephadm-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: cephfs-top-2:18.0.0-7690.gc7b0e682.el9.noarch 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: flex-2.6.4-9.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-04T10:42:40.595 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: jq-1.6-16.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-9.0.0-9.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libarrow-doc-9.0.0-9.el9.noarch 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs-devel-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libcephfs2-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libcephsqlite-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-04T10:42:40.596 INFO:teuthology.orchestra.run.smithi063.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: librados-devel-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: libradosstriper1-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: librgw2-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: lua-5.4.4-4.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: lua-devel-5.4.4-4.el9.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-04T10:42:40.597 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: parquet-libs-9.0.0-9.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-13.11-1.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-argparse-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ceph-common-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.598 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cephfs-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-04T10:42:40.599 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-ply-3.11-14.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-04T10:42:40.600 INFO:teuthology.orchestra.run.smithi063.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rados-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rgw-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-04T10:42:40.601 INFO:teuthology.orchestra.run.smithi063.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-fuse-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-mirror-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: rbd-nbd-2:18.0.0-7690.gc7b0e682.el9.x86_64 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: re2-1:20211101-3.el9.x86_64 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-04T10:42:40.602 INFO:teuthology.orchestra.run.smithi063.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-04T10:42:40.603 INFO:teuthology.orchestra.run.smithi063.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-04T10:42:40.603 INFO:teuthology.orchestra.run.smithi063.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-04T10:42:40.604 INFO:teuthology.orchestra.run.smithi063.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-04T10:42:40.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:40.604 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-04T10:42:41.164 DEBUG:teuthology.parallel:result is None 2023-12-04T10:42:41.165 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c7b0e682e685ca9c244e731128a4c5dcad3b99eb 2023-12-04T10:42:41.312 DEBUG:teuthology.orchestra.run.smithi063:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-04T10:42:41.384 INFO:teuthology.orchestra.run.smithi063.stdout:18.0.0-7690.gc7b0e682.el9 2023-12-04T10:42:41.385 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7690.gc7b0e682.el9 2023-12-04T10:42:41.385 INFO:teuthology.task.install:The correct ceph version 18.0.0-7690.gc7b0e682 is installed. 2023-12-04T10:42:41.385 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=c7b0e682e685ca9c244e731128a4c5dcad3b99eb 2023-12-04T10:42:41.761 DEBUG:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-04T10:42:41.830 INFO:teuthology.orchestra.run.smithi066.stdout:18.0.0-7690.gc7b0e682.el9 2023-12-04T10:42:41.831 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7690.gc7b0e682.el9 2023-12-04T10:42:41.831 INFO:teuthology.task.install:The correct ceph version 18.0.0-7690.gc7b0e682 is installed. 2023-12-04T10:42:41.831 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-04T10:42:41.831 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:41.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-04T10:42:41.938 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:42:41.939 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-04T10:42:42.038 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-04T10:42:42.038 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:42.038 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/daemon-helper 2023-12-04T10:42:42.128 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-04T10:42:42.206 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:42:42.206 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2023-12-04T10:42:42.290 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-04T10:42:42.419 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-04T10:42:42.419 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:42.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-04T10:42:42.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-04T10:42:42.619 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:42:42.619 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-04T10:42:42.719 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-04T10:42:42.800 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-04T10:42:42.800 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:42.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/usr/bin/stdin-killer 2023-12-04T10:42:42.881 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-04T10:42:42.999 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:42:42.999 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/stdin-killer 2023-12-04T10:42:43.086 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-04T10:42:43.210 INFO:teuthology.run_tasks:Running task ceph... 2023-12-04T10:42:43.297 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-04T10:42:43.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 777 /var/log/ceph 2023-12-04T10:42:43.308 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2023-12-04T10:42:43.408 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-04T10:42:43.408 DEBUG:teuthology.orchestra.run.smithi063:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-04T10:42:43.414 DEBUG:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-04T10:42:43.497 INFO:tasks.ceph:Creating extra log directories... 2023-12-04T10:42:43.497 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-04T10:42:43.502 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-04T10:42:43.595 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-04T10:42:43.595 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-04T10:42:43.595 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-04T10:42:43.595 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:43.595 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-04T10:42:43.635 DEBUG:teuthology.orchestra.run.smithi063:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-04T10:42:43.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-04T10:42:43.962 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:42:43.962 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-04T10:42:44.014 DEBUG:teuthology.orchestra.run.smithi066:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-04T10:42:44.254 DEBUG:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-04T10:42:44.339 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-04T10:42:44.339 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-04T10:42:44.339 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi/7476898', 'branch': 'wip-vshankar-testing-20231204.063332', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7476898', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '9c0b943f8476b8090f302186b32f5e600b7b0866'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-04_09:26:31-fs-wip-vshankar-testing-20231204.063332-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231204.063332'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231204.063332', 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 1577, 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb', 'sleep_before_teardown': 0, 'subset': '220/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231204.063332', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_c7b0e682e685ca9c244e731128a4c5dcad3b99eb/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi063.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM5a3499J6ROzU333sxNFjQ2PVyf7nSwc3ss1hgsmDzBE/vVoMRLYJK2u0h61oGIQ0Mhp9/dfomW96AGaJnLNNQ=', 'smithi066.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOdF/Pp4hi1Fk+AQ5D9r59OgmqVwB+gObKn+pIzWmzwdLh44Sm/lquwSnz0RxH7Oo5apBIHoq7S/hFbsrLS9GWw='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '9c0b943f8476b8090f302186b32f5e600b7b0866'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'c7b0e682e685ca9c244e731128a4c5dcad3b99eb', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'f2de108beb0a6dde7f3e6c96039071828a1f6269', 'timestamp': '2023-12-04_09:26:31', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-04T10:42:44.340 DEBUG:teuthology.orchestra.run.smithi063:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-04T10:42:44.344 DEBUG:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-04T10:42:44.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo install -d -m0777 -- /var/run/ceph 2023-12-04T10:42:44.428 DEBUG:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2023-12-04T10:42:44.543 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:44.543 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/scratch_devs of=/dev/stdout 2023-12-04T10:42:44.585 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-04T10:42:44.585 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_1 2023-12-04T10:42:44.665 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-04T10:42:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T10:42:44.666 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-04T10:42:44.666 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T10:42:44.666 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-04T10:42:44.666 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-04 10:42:34.458031390 +0000 2023-12-04T10:42:44.666 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-04 10:39:47.054618794 +0000 2023-12-04T10:42:44.666 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-04 10:39:47.054618794 +0000 2023-12-04T10:42:44.666 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-04 10:39:47.054618794 +0000 2023-12-04T10:42:44.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-04T10:42:44.776 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-04T10:42:44.776 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-04T10:42:44.776 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000345746 s, 1.5 MB/s 2023-12-04T10:42:44.779 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-04T10:42:44.825 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_2 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 653 Links: 1 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-04 10:42:34.459031380 +0000 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-04 10:39:48.080608268 +0000 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-04 10:39:48.080608268 +0000 2023-12-04T10:42:44.907 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-04 10:39:48.080608268 +0000 2023-12-04T10:42:44.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-04T10:42:45.021 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-04T10:42:45.021 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-04T10:42:45.021 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000361717 s, 1.4 MB/s 2023-12-04T10:42:45.024 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-04T10:42:45.070 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_3 2023-12-04T10:42:45.156 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-04T10:42:45.156 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T10:42:45.156 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-04T10:42:45.156 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T10:42:45.156 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-04T10:42:45.156 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-04 10:42:34.460031371 +0000 2023-12-04T10:42:45.156 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-04 10:39:49.165597137 +0000 2023-12-04T10:42:45.156 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-04 10:39:49.165597137 +0000 2023-12-04T10:42:45.157 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-04 10:39:49.165597137 +0000 2023-12-04T10:42:45.157 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-04T10:42:45.271 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-04T10:42:45.271 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-04T10:42:45.271 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000257598 s, 2.0 MB/s 2023-12-04T10:42:45.274 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-04T10:42:45.321 DEBUG:teuthology.orchestra.run.smithi063:> stat /dev/vg_nvme/lv_4 2023-12-04T10:42:45.403 INFO:teuthology.orchestra.run.smithi063.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-04T10:42:45.403 INFO:teuthology.orchestra.run.smithi063.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T10:42:45.403 INFO:teuthology.orchestra.run.smithi063.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-12-04T10:42:45.403 INFO:teuthology.orchestra.run.smithi063.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T10:42:45.403 INFO:teuthology.orchestra.run.smithi063.stdout:Context: system_u:object_r:device_t:s0 2023-12-04T10:42:45.403 INFO:teuthology.orchestra.run.smithi063.stdout:Access: 2023-12-04 10:42:34.460031371 +0000 2023-12-04T10:42:45.404 INFO:teuthology.orchestra.run.smithi063.stdout:Modify: 2023-12-04 10:39:50.226586252 +0000 2023-12-04T10:42:45.404 INFO:teuthology.orchestra.run.smithi063.stdout:Change: 2023-12-04 10:39:50.227586241 +0000 2023-12-04T10:42:45.404 INFO:teuthology.orchestra.run.smithi063.stdout: Birth: 2023-12-04 10:39:50.226586252 +0000 2023-12-04T10:42:45.404 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-04T10:42:45.519 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records in 2023-12-04T10:42:45.520 INFO:teuthology.orchestra.run.smithi063.stderr:1+0 records out 2023-12-04T10:42:45.520 INFO:teuthology.orchestra.run.smithi063.stderr:512 bytes copied, 0.000285722 s, 1.8 MB/s 2023-12-04T10:42:45.524 DEBUG:teuthology.orchestra.run.smithi063:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-04T10:42:45.571 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T10:42:45.571 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:42:45.571 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2023-12-04T10:42:45.637 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-04T10:42:45.637 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 632 Links: 1 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-12-04 10:42:31.108082847 +0000 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-12-04 10:39:51.101747431 +0000 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-12-04 10:39:51.101747431 +0000 2023-12-04T10:42:45.700 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2023-12-04 10:39:51.101747431 +0000 2023-12-04T10:42:45.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-04T10:42:45.804 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-12-04T10:42:45.805 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-12-04T10:42:45.805 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000345169 s, 1.5 MB/s 2023-12-04T10:42:45.809 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-04T10:42:45.873 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 2023-12-04T10:42:45.931 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-04T10:42:45.931 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T10:42:45.931 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-12-04T10:42:45.931 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T10:42:45.931 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2023-12-04T10:42:45.932 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-12-04 10:42:31.110082829 +0000 2023-12-04T10:42:45.932 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-12-04 10:39:52.160737902 +0000 2023-12-04T10:42:45.932 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-12-04 10:39:52.160737902 +0000 2023-12-04T10:42:45.932 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2023-12-04 10:39:52.160737902 +0000 2023-12-04T10:42:45.932 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-04T10:42:46.042 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-12-04T10:42:46.042 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-12-04T10:42:46.043 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.00037504 s, 1.4 MB/s 2023-12-04T10:42:46.047 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-04T10:42:46.111 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 2023-12-04T10:42:46.169 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-04T10:42:46.169 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T10:42:46.169 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-04T10:42:46.169 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T10:42:46.169 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2023-12-04T10:42:46.169 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-12-04 10:42:31.110082829 +0000 2023-12-04T10:42:46.169 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-12-04 10:39:53.215728379 +0000 2023-12-04T10:42:46.169 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-12-04 10:39:53.215728379 +0000 2023-12-04T10:42:46.170 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2023-12-04 10:39:53.215728379 +0000 2023-12-04T10:42:46.170 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-04T10:42:46.274 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-12-04T10:42:46.274 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-12-04T10:42:46.274 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000374175 s, 1.4 MB/s 2023-12-04T10:42:46.278 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-04T10:42:46.341 DEBUG:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 2023-12-04T10:42:46.400 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-04T10:42:46.400 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-04T10:42:46.400 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 5h/5d Inode: 688 Links: 1 2023-12-04T10:42:46.400 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-04T10:42:46.400 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2023-12-04T10:42:46.400 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2023-12-04 10:42:31.111082820 +0000 2023-12-04T10:42:46.400 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2023-12-04 10:39:54.306718516 +0000 2023-12-04T10:42:46.400 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2023-12-04 10:39:54.306718516 +0000 2023-12-04T10:42:46.401 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: 2023-12-04 10:39:54.306718516 +0000 2023-12-04T10:42:46.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-04T10:42:46.501 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2023-12-04T10:42:46.501 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2023-12-04T10:42:46.501 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000382776 s, 1.3 MB/s 2023-12-04T10:42:46.505 DEBUG:teuthology.orchestra.run.smithi066:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-04T10:42:46.571 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T10:42:46.572 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-04T10:42:46.572 INFO:tasks.ceph:Generating config... 2023-12-04T10:42:46.573 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-04T10:42:46.573 INFO:tasks.ceph:[client] debug client = 20 2023-12-04T10:42:46.573 INFO:tasks.ceph:[client] debug ms = 1 2023-12-04T10:42:46.573 INFO:tasks.ceph:[client] pid file = 2023-12-04T10:42:46.573 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-04T10:42:46.573 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-04T10:42:46.573 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-04T10:42:46.573 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-04T10:42:46.573 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-04T10:42:46.573 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-04T10:42:46.574 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-04T10:42:46.574 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-04T10:42:46.574 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-04T10:42:46.575 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-04T10:42:46.575 INFO:tasks.ceph:Setting up mon.a... 2023-12-04T10:42:46.576 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-04T10:42:46.705 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.keyring 2023-12-04T10:42:46.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-04T10:42:46.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-04T10:42:46.941 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.63'), ('mon.b', '172.21.15.66'), ('mon.c', '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]')] 2023-12-04T10:42:46.942 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.63,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-04T10:42:46.943 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:46.943 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-04T10:42:47.003 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.63 --add b 172.21.15.66 --addv c '[v2:172.21.15.66:3301,v1:172.21.15.66:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:42:47.158 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:42:47.158 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: generated fsid 41e9b14e-2141-4ea1-b0af-8533c9689063 2023-12-04T10:42:47.158 INFO:teuthology.orchestra.run.smithi063.stdout:setting min_mon_release = pacific 2023-12-04T10:42:47.158 INFO:teuthology.orchestra.run.smithi063.stdout:epoch 0 2023-12-04T10:42:47.158 INFO:teuthology.orchestra.run.smithi063.stdout:fsid 41e9b14e-2141-4ea1-b0af-8533c9689063 2023-12-04T10:42:47.158 INFO:teuthology.orchestra.run.smithi063.stdout:last_changed 2023-12-04T10:42:47.157628+0000 2023-12-04T10:42:47.158 INFO:teuthology.orchestra.run.smithi063.stdout:created 2023-12-04T10:42:47.157628+0000 2023-12-04T10:42:47.158 INFO:teuthology.orchestra.run.smithi063.stdout:min_mon_release 16 (pacific) 2023-12-04T10:42:47.159 INFO:teuthology.orchestra.run.smithi063.stdout:election_strategy: 1 2023-12-04T10:42:47.159 INFO:teuthology.orchestra.run.smithi063.stdout:0: [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] mon.a 2023-12-04T10:42:47.159 INFO:teuthology.orchestra.run.smithi063.stdout:1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2023-12-04T10:42:47.159 INFO:teuthology.orchestra.run.smithi063.stdout:2: [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] mon.c 2023-12-04T10:42:47.159 INFO:teuthology.orchestra.run.smithi063.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-04T10:42:47.161 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-04T10:42:47.213 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 41e9b14e-2141-4ea1-b0af-8533c9689063... 2023-12-04T10:42:47.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-04T10:42:47.220 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout:[global] 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout: chdir = "" 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout: auth supported = cephx 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout: filestore xattr use omap = true 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout: mon clock drift allowed = 1.000 2023-12-04T10:42:47.395 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: osd crush chooseleaf type = 0 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: auth debug = true 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on old message = true 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on bug = true 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: mon pg warn max object skew = 0 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: # disable pg_autoscaler by default for new pools 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default size = 2 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow primary affinity = true 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd allow pg remap = true 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on legacy crush tunables = false 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on crush straw calc version zero = false 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on no sortbitwise = false 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on osd down out interval zero = false 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon warn on too few osds = false 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon_allow_pool_size_one = true 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: osd default data pool replay window = 5 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: mon allow pool delete = true 2023-12-04T10:42:47.397 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.398 INFO:teuthology.orchestra.run.smithi063.stdout: mon cluster log file level = debug 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: debug asserts on shutdown = true 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: mon health detail to clog = false 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: mon host = "172.21.15.63,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: ms die on skipped message = False 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: fsid = 41e9b14e-2141-4ea1-b0af-8533c9689063 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout:[osd] 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: osd journal size = 100 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub load threshold = 5.0 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: osd scrub max interval = 600 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: osd mclock profile = high_recovery_ops 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.399 INFO:teuthology.orchestra.run.smithi063.stdout: osd recover clone overlap = true 2023-12-04T10:42:47.400 INFO:teuthology.orchestra.run.smithi063.stdout: osd recovery max chunk = 1048576 2023-12-04T10:42:47.400 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.400 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug shutdown = true 2023-12-04T10:42:47.400 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug op order = true 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug verify stray on activate = true 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug trim objects = true 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: osd open classes on start = true 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug pg log writeout = true 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: osd deep scrub update digest min age = 30 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: osd map max advance = 10 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: journal zero on create = true 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: filestore ondisk finisher threads = 3 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: filestore apply finisher threads = 3 2023-12-04T10:42:47.401 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: bdev debug aio = true 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: osd debug misdirected ops = true 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore block size = 96636764160 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: bluestore fsck on mount = True 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluefs = 20 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: debug bluestore = 20 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: debug osd = 20 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: debug rocksdb = 10 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd backfillfull_ratio = 0.85 2023-12-04T10:42:47.402 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd full ratio = 0.9 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd nearfull ratio = 0.8 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: osd failsafe full ratio = 0.95 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: osd objectstore = bluestore 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr] 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: debug mgr = 20 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: mgr/telemetry/nag = false 2023-12-04T10:42:47.403 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout:[mon] 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: debug mon = 20 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: debug paxos = 20 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: debug auth = 20 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: mon data avail warn = 5 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: mon mgr mkfs grace = 240 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min pgs per osd = 4 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd reporter subtree level = osd 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: mon osd prime pg temp = true 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: mon reweight min bytes per osd = 10 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: auth mon ticket ttl = 660 # 11m 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: auth service ticket ttl = 240 # 4m 2023-12-04T10:42:47.404 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: # don't complain about insecure global_id in the test suite 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: # 1m isn't quite enough 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: mon_down_mkfs_grace = 2m 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: mon_warn_on_filestore_osds = false 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: mon op complaint time = 120 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout:[client] 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: rgw cache enabled = true 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable ops log = true 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: rgw enable usage log = true 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-04T10:42:47.405 INFO:teuthology.orchestra.run.smithi063.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout: client mount timeout = 600 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout: debug client = 20 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout: pid file = "" 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout: rados mon op timeout = 900 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout: rados osd op timeout = 900 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.a] 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.b] 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout:[mon.c] 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout:[mds] 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds = 20 2023-12-04T10:42:47.406 INFO:teuthology.orchestra.run.smithi063.stdout: debug mds balancer = 20 2023-12-04T10:42:47.407 INFO:teuthology.orchestra.run.smithi063.stdout: debug ms = 1 2023-12-04T10:42:47.407 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug frag = True 2023-12-04T10:42:47.407 INFO:teuthology.orchestra.run.smithi063.stdout: mds debug scatterstat = True 2023-12-04T10:42:47.407 INFO:teuthology.orchestra.run.smithi063.stdout: mds op complaint time = 180 2023-12-04T10:42:47.407 INFO:teuthology.orchestra.run.smithi063.stdout: mds verify scatter = True 2023-12-04T10:42:47.407 INFO:teuthology.orchestra.run.smithi063.stdout: osd op complaint time = 180 2023-12-04T10:42:47.407 INFO:teuthology.orchestra.run.smithi063.stdout: rados mon op timeout = 900 2023-12-04T10:42:47.407 INFO:teuthology.orchestra.run.smithi063.stdout: rados osd op timeout = 900 2023-12-04T10:42:47.422 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2023-12-04T10:42:47.422 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2023-12-04T10:42:47.422 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-04T10:42:47.422 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2023-12-04T10:42:47.422 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.422 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2023-12-04T10:42:47.422 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.422 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2023-12-04T10:42:47.423 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2023-12-04T10:42:47.424 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.63,172.21.15.66,[v2:172.21.15.66:3301,v1:172.21.15.66:6790]" 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on skipped message = False 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = 41e9b14e-2141-4ea1-b0af-8533c9689063 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: osd mclock profile = high_recovery_ops 2023-12-04T10:42:47.425 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.426 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2023-12-04T10:42:47.426 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2023-12-04T10:42:47.426 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.426 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2023-12-04T10:42:47.426 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug trim objects = true 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.427 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 20 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2023-12-04T10:42:47.428 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2023-12-04T10:42:47.433 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2023-12-04T10:42:47.433 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2023-12-04T10:42:47.434 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: auth mon ticket ttl = 660 # 11m 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: auth service ticket ttl = 240 # 4m 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: # don't complain about insecure global_id in the test suite 2023-12-04T10:42:47.435 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: # 1m isn't quite enough 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: mon_down_mkfs_grace = 2m 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_filestore_osds = false 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2023-12-04T10:42:47.436 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = "" 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds balancer = 20 2023-12-04T10:42:47.437 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2023-12-04T10:42:47.438 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2023-12-04T10:42:47.438 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2023-12-04T10:42:47.438 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2023-12-04T10:42:47.438 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2023-12-04T10:42:47.438 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2023-12-04T10:42:47.438 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 900 2023-12-04T10:42:47.438 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 900 2023-12-04T10:42:47.475 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-04T10:42:47.475 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-04T10:42:47.638 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-04T10:42:47.638 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:47.638 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-04T10:42:47.693 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:47.693 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-04T10:42:47.748 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:42:47.748 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:47.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-04T10:42:47.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-04T10:42:47.907 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:42:47.907 DEBUG:teuthology.orchestra.run.smithi063:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:42:48.012 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T10:42:48.012 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:42:48.012 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-04T10:42:48.012 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-04T10:42:48.199 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:42:48.199 DEBUG:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:42:48.304 INFO:tasks.ceph:Setting up mon nodes... 2023-12-04T10:42:48.304 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-04T10:42:48.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-04T10:42:48.481 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-04T10:42:48.491 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-04T10:42:48.729 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-04T10:42:48.739 INFO:tasks.ceph:Setting up mds nodes... 2023-12-04T10:42:48.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-04T10:42:48.946 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-04T10:42:48.956 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-04T10:42:49.059 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-04T10:42:49.257 INFO:teuthology.orchestra.run.smithi063.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-04T10:42:49.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-04T10:42:49.368 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-04T10:42:49.587 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-04T10:42:49.597 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-04T10:42:49.705 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-04T10:42:49.911 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-04T10:42:49.921 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-04T10:42:50.027 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-04T10:42:50.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-04T10:42:50.170 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-04T10:42:50.236 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-04T10:42:50.376 INFO:teuthology.orchestra.run.smithi063.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-04T10:42:50.438 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-04T10:42:50.586 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-04T10:42:50.665 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-04T10:42:50.811 INFO:teuthology.orchestra.run.smithi066.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-04T10:42:50.879 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-04T10:42:50.879 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi063.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-04T10:42:50.879 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-04T10:42:50.991 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T10:42:50.992 INFO:tasks.ceph:role: osd.0 2023-12-04T10:42:50.992 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:42:50.992 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-04T10:42:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T10:42:51.104 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T10:42:51.614 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2023-12-04T10:42:51.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2023-12-04T10:42:51.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-04T10:42:51.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-04T10:42:51.930 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-04T10:42:52.030 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T10:42:52.030 INFO:tasks.ceph:role: osd.1 2023-12-04T10:42:52.030 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:42:52.030 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-04T10:42:52.135 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T10:42:52.136 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T10:42:52.627 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2023-12-04T10:42:52.634 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2023-12-04T10:42:52.634 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-04T10:42:52.810 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-04T10:42:52.920 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-04T10:42:53.019 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T10:42:53.019 INFO:tasks.ceph:role: osd.2 2023-12-04T10:42:53.019 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:42:53.019 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-04T10:42:53.128 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T10:42:53.128 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T10:42:53.128 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T10:42:53.128 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-04T10:42:53.128 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T10:42:53.129 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2023-12-04T10:42:53.129 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T10:42:53.129 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-04T10:42:53.129 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T10:42:53.129 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T10:42:53.644 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2023-12-04T10:42:53.651 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2023-12-04T10:42:53.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-04T10:42:53.868 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-04T10:42:53.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-04T10:42:54.097 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-04T10:42:54.097 INFO:tasks.ceph:role: osd.3 2023-12-04T10:42:54.097 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:42:54.097 DEBUG:teuthology.orchestra.run.smithi063:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-04T10:42:54.208 INFO:teuthology.orchestra.run.smithi063.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T10:42:54.208 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T10:42:54.209 INFO:teuthology.orchestra.run.smithi063.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T10:42:54.209 INFO:teuthology.orchestra.run.smithi063.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-04T10:42:54.209 INFO:teuthology.orchestra.run.smithi063.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T10:42:54.209 INFO:teuthology.orchestra.run.smithi063.stdout: = sunit=0 swidth=0 blks 2023-12-04T10:42:54.209 INFO:teuthology.orchestra.run.smithi063.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T10:42:54.209 INFO:teuthology.orchestra.run.smithi063.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-04T10:42:54.209 INFO:teuthology.orchestra.run.smithi063.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T10:42:54.209 INFO:teuthology.orchestra.run.smithi063.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T10:42:54.688 INFO:teuthology.orchestra.run.smithi063.stdout:Discarding blocks...Done. 2023-12-04T10:42:54.695 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi063.front.sepia.ceph.com -o noatime 2023-12-04T10:42:54.695 DEBUG:teuthology.orchestra.run.smithi063:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-04T10:42:54.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-04T10:42:54.974 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:42:55.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:55.127+0000 7f00ebbfe500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-04T10:42:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:55.134+0000 7f00ebbfe500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-04T10:42:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:55.134+0000 7f00ebbfe500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-04T10:42:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:55.134+0000 7f00ebbfe500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-04T10:42:55.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:55.134+0000 7f00ebbfe500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-04T10:42:55.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:55.144+0000 7f00ebbfe500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-04T10:42:58.097 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-04T10:42:58.200 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:42:58.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:58.345+0000 7f3a3a422500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-04T10:42:58.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:58.346+0000 7f3a3a422500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-04T10:42:58.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:58.346+0000 7f3a3a422500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-04T10:42:58.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:58.346+0000 7f3a3a422500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-04T10:42:58.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:58.346+0000 7f3a3a422500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-04T10:42:58.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:42:58.348+0000 7f3a3a422500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-04T10:43:01.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-04T10:43:01.620 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:43:01.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:01.767+0000 7feb2b8a5500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-04T10:43:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:01.768+0000 7feb2b8a5500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-04T10:43:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:01.768+0000 7feb2b8a5500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-04T10:43:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:01.768+0000 7feb2b8a5500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-04T10:43:01.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:01.768+0000 7feb2b8a5500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-04T10:43:01.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:01.770+0000 7feb2b8a5500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-04T10:43:04.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-04T10:43:05.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:43:05.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:05.217+0000 7f1bcab94500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-04T10:43:05.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:05.218+0000 7f1bcab94500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-04T10:43:05.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:05.218+0000 7f1bcab94500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-04T10:43:05.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:05.218+0000 7f1bcab94500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-04T10:43:05.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:05.218+0000 7f1bcab94500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-04T10:43:05.221 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:05.220+0000 7f1bcab94500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-04T10:43:08.399 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-04T10:43:08.501 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-04T10:43:08.618 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T10:43:08.618 INFO:tasks.ceph:role: osd.4 2023-12-04T10:43:08.618 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T10:43:08.619 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T10:43:08.735 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T10:43:09.245 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2023-12-04T10:43:09.251 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-12-04T10:43:09.252 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-04T10:43:09.439 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-04T10:43:09.564 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-04T10:43:09.667 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T10:43:09.667 INFO:tasks.ceph:role: osd.5 2023-12-04T10:43:09.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T10:43:09.667 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-04T10:43:09.765 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T10:43:09.765 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T10:43:09.765 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T10:43:09.765 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-04T10:43:09.765 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T10:43:09.766 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-12-04T10:43:09.766 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T10:43:09.766 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-04T10:43:09.766 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T10:43:09.766 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T10:43:10.250 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2023-12-04T10:43:10.254 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-12-04T10:43:10.254 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-04T10:43:10.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-04T10:43:10.485 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-04T10:43:10.576 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T10:43:10.576 INFO:tasks.ceph:role: osd.6 2023-12-04T10:43:10.576 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T10:43:10.576 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T10:43:10.665 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T10:43:11.179 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2023-12-04T10:43:11.186 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-12-04T10:43:11.187 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-04T10:43:11.378 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-04T10:43:11.500 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-04T10:43:11.609 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-04T10:43:11.609 INFO:tasks.ceph:role: osd.7 2023-12-04T10:43:11.609 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T10:43:11.609 DEBUG:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-04T10:43:11.714 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-04T10:43:11.715 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-04T10:43:12.183 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2023-12-04T10:43:12.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2023-12-04T10:43:12.191 DEBUG:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-04T10:43:12.350 DEBUG:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-04T10:43:12.464 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:43:12.637 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:12.635+0000 7fd82d813500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-04T10:43:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:12.641+0000 7fd82d813500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-04T10:43:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:12.641+0000 7fd82d813500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-04T10:43:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:12.641+0000 7fd82d813500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-04T10:43:12.643 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:12.641+0000 7fd82d813500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-04T10:43:12.655 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:12.654+0000 7fd82d813500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-04T10:43:14.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:43:14.351 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:43:15.855 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-04T10:43:15.967 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:43:16.127 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:16.126+0000 7f0cab00d500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-04T10:43:16.128 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:16.127+0000 7f0cab00d500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-04T10:43:16.128 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:16.127+0000 7f0cab00d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-04T10:43:16.128 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:16.127+0000 7f0cab00d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-04T10:43:16.128 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:16.127+0000 7f0cab00d500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-04T10:43:16.130 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:16.129+0000 7f0cab00d500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-04T10:43:19.299 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-04T10:43:19.411 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:43:19.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:19.563+0000 7f486da19500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-04T10:43:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:19.563+0000 7f486da19500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-04T10:43:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:19.563+0000 7f486da19500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-04T10:43:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:19.563+0000 7f486da19500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-04T10:43:19.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:19.563+0000 7f486da19500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-04T10:43:19.566 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:19.566+0000 7f486da19500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-04T10:43:22.747 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-04T10:43:22.865 DEBUG:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:43:23.023 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:23.021+0000 7fe39cb20500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-04T10:43:23.023 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:23.022+0000 7fe39cb20500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-04T10:43:23.024 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:23.022+0000 7fe39cb20500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-04T10:43:23.024 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:23.022+0000 7fe39cb20500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-04T10:43:23.024 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:23.022+0000 7fe39cb20500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-04T10:43:23.026 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:23.024+0000 7fe39cb20500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-04T10:43:26.207 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-04T10:43:26.318 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-04T10:43:26.318 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:26.318 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-04T10:43:26.432 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:26.432 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-04T10:43:26.542 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:26.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-04T10:43:26.642 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:26.642 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-04T10:43:26.744 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:26.744 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-04T10:43:26.851 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:26.852 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-04T10:43:26.956 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:26.956 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-04T10:43:27.058 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:27.059 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-04T10:43:27.174 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:27.174 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-04T10:43:27.286 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:27.286 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-04T10:43:27.398 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:27.398 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-04T10:43:27.505 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:27.505 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-04T10:43:27.614 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:27.614 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-04T10:43:27.730 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:27.730 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-04T10:43:27.838 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:27.838 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-04T10:43:27.901 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:27.901 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-04T10:43:27.957 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:27.957 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-04T10:43:28.021 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:28.021 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-04T10:43:28.076 INFO:tasks.ceph:Adding keys to all mons... 2023-12-04T10:43:28.077 DEBUG:teuthology.orchestra.run.smithi063:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-04T10:43:28.086 DEBUG:teuthology.orchestra.run.smithi066:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.y] 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAorW1lR0+yHBAAH2jKm94fo9r+yJdLSEs8EQ== 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.a] 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAorW1l0/hjOBAAZVCYxhAOVyKvxuFIBoMadA== 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.c] 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAprW1lE7BPDxAAwzk357acyu62cvXhBbmthw== 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.0] 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAvrW1lcj2zBxAA4CuX9XQl1PFtrXK/Z+x8UQ== 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.1] 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAyrW1lf8KvFBAAuB8QtCDBQfY896UIBobE3w== 2023-12-04T10:43:28.184 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.2] 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA1rW1l5xXXLRAAyRUEiNy1sjeEcVB40a3yoQ== 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.3] 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQA5rW1lKk4PDRAAGJs+yweykmUM7r8gKUEjpQ== 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:[mgr.x] 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAorW1lXB9eKxAAEtNOCYtzp0dzfiqZ/kcqew== 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.b] 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAprW1lKrn8IhAAdm23ZoeS4t+aRKAzl4yt2w== 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:[mds.d] 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAprW1lyLtSNhAAw4tOdyahGZO4Rdf0Fzx2rg== 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.4] 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBArW1l3rT0JRAAjHFG2T5wImLNsnsJcc8GNA== 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.5] 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBErW1lDvSWBxAACsL0tFOqEdyLOFpfIuF51A== 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.6] 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBHrW1lwDqeIRAAtamHkDpHpEQV0syCbElRKw== 2023-12-04T10:43:28.185 INFO:teuthology.orchestra.run.smithi063.stdout:[osd.7] 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQBLrW1lGONZARAAmS8KrbH+AcydbHpmklECqw== 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAqrW1lNHPvCRAAl2gnyDEti4/W/gQul97nNg== 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout:[client.2] 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAqrW1lN8ZwFhAAnTCU+8ziHvtvXFfshAB9Ng== 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout:[client.1] 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAqrW1lqtzxIhAAfJCX0+lgsQGnwbdljItHrQ== 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout:[client.3] 2023-12-04T10:43:28.186 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAqrW1ltptgMBAAw8YyznNmZQ+7hqA2g1dL4g== 2023-12-04T10:43:28.193 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAorW1lR0+yHBAAH2jKm94fo9r+yJdLSEs8EQ== 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAorW1l0/hjOBAAZVCYxhAOVyKvxuFIBoMadA== 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAprW1lE7BPDxAAwzk357acyu62cvXhBbmthw== 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.0] 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAvrW1lcj2zBxAA4CuX9XQl1PFtrXK/Z+x8UQ== 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAyrW1lf8KvFBAAuB8QtCDBQfY896UIBobE3w== 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.2] 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQA1rW1l5xXXLRAAyRUEiNy1sjeEcVB40a3yoQ== 2023-12-04T10:43:28.194 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.3] 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQA5rW1lKk4PDRAAGJs+yweykmUM7r8gKUEjpQ== 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.x] 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAorW1lXB9eKxAAEtNOCYtzp0dzfiqZ/kcqew== 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAprW1lKrn8IhAAdm23ZoeS4t+aRKAzl4yt2w== 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.d] 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAprW1lyLtSNhAAw4tOdyahGZO4Rdf0Fzx2rg== 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.4] 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQBArW1l3rT0JRAAjHFG2T5wImLNsnsJcc8GNA== 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.5] 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQBErW1lDvSWBxAACsL0tFOqEdyLOFpfIuF51A== 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.6] 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQBHrW1lwDqeIRAAtamHkDpHpEQV0syCbElRKw== 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.7] 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQBLrW1lGONZARAAmS8KrbH+AcydbHpmklECqw== 2023-12-04T10:43:28.195 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2023-12-04T10:43:28.196 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAqrW1lNHPvCRAAl2gnyDEti4/W/gQul97nNg== 2023-12-04T10:43:28.196 INFO:teuthology.orchestra.run.smithi066.stdout:[client.2] 2023-12-04T10:43:28.196 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAqrW1lN8ZwFhAAnTCU+8ziHvtvXFfshAB9Ng== 2023-12-04T10:43:28.196 INFO:teuthology.orchestra.run.smithi066.stdout:[client.1] 2023-12-04T10:43:28.196 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAqrW1lqtzxIhAAfJCX0+lgsQGnwbdljItHrQ== 2023-12-04T10:43:28.196 INFO:teuthology.orchestra.run.smithi066.stdout:[client.3] 2023-12-04T10:43:28.196 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAqrW1ltptgMBAAw8YyznNmZQ+7hqA2g1dL4g== 2023-12-04T10:43:28.198 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-04T10:43:28.206 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-04T10:43:28.368 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T10:43:28.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T10:43:28.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T10:43:28.545 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T10:43:28.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:28.709 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:28.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:28.885 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:29.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:29.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:29.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:29.231 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:29.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-04T10:43:29.404 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-04T10:43:29.568 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T10:43:29.577 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T10:43:29.750 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T10:43:29.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-04T10:43:29.925 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:29.934 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:30.097 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:30.105 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:30.269 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:30.278 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:30.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:30.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-04T10:43:30.612 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T10:43:30.618 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T10:43:30.780 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T10:43:30.789 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T10:43:30.948 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T10:43:30.957 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T10:43:31.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T10:43:31.120 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-04T10:43:31.284 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-04T10:43:31.285 DEBUG:teuthology.orchestra.run.smithi063:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-04T10:43:31.386 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-04T10:43:31.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-04T10:43:31.648 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-04T10:43:31.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-04T10:43:31.944 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-04T10:43:32.037 DEBUG:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-04T10:43:32.139 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-04T10:43:32.310 DEBUG:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-04T10:43:32.416 DEBUG:teuthology.orchestra.run.smithi063:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:43:32.425 DEBUG:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-04T10:43:32.486 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-04T10:43:32.486 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-04T10:43:32.487 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-04T10:43:32.492 INFO:tasks.ceph.mon.a:Started 2023-12-04T10:43:32.493 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-04T10:43:32.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-04T10:43:32.502 INFO:tasks.ceph.mon.b:Started 2023-12-04T10:43:32.502 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-04T10:43:32.502 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-04T10:43:32.511 INFO:tasks.ceph.mon.c:Started 2023-12-04T10:43:32.511 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-04T10:43:32.512 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-04T10:43:32.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-04T10:43:32.521 INFO:tasks.ceph.mgr.y:Started 2023-12-04T10:43:32.521 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-04T10:43:32.521 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-04T10:43:32.527 INFO:tasks.ceph.mgr.x:Started 2023-12-04T10:43:32.527 INFO:tasks.ceph:Setting crush tunables to default 2023-12-04T10:43:32.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --cluster ceph osd crush tunables default 2023-12-04T10:43:32.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.712+0000 7f6c8daad640 1 Processor -- start 2023-12-04T10:43:32.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.712+0000 7f6c8daad640 1 -- start start 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.713+0000 7f6c8daad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.713+0000 7f6c8daad640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 0x7f6c880b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.713+0000 7f6c8daad640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c880b2710 con 0x7f6c880ce8e0 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.713+0000 7f6c8daad640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c880ced70 con 0x7f6c880d1fb0 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.713+0000 7f6c8daad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880cf050 con 0x7f6c8815d5d0 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c877fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c877fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:42478/0 (socket says 172.21.15.63:42478) 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c877fe640 1 -- 172.21.15.63:0/1962829365 learned_addr learned my addr 172.21.15.63:0/1962829365 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c7ffff640 1 --1- 172.21.15.63:0/1962829365 >> v1:172.21.15.66:6789/0 conn(0x7f6c880ce8e0 0x7f6c880d18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:36752/0 (socket says 172.21.15.63:36752) 2023-12-04T10:43:32.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c87fff640 1 --2- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 0x7f6c880b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c87fff640 1 -- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 msgr2=0x7f6c880b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-04T10:43:32.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c87fff640 1 -- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 msgr2=0x7f6c880b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T10:43:32.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c87fff640 1 --2- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 0x7f6c880b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T10:43:32.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c877fe640 1 -- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 msgr2=0x7f6c880d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-04T10:43:32.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c877fe640 1 -- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 msgr2=0x7f6c880d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T10:43:32.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c877fe640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T10:43:32.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c87fff640 1 --2- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 0x7f6c880b3160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-04T10:43:32.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.714+0000 7f6c877fe640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.915+0000 7f6c87fff640 1 --2- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 0x7f6c880b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.915+0000 7f6c877fe640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.915+0000 7f6c87fff640 1 -- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 msgr2=0x7f6c880b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.915+0000 7f6c87fff640 1 -- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 msgr2=0x7f6c880b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.915+0000 7f6c87fff640 1 --2- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 0x7f6c880b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.916+0000 7f6c87fff640 1 --2- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 0x7f6c880b3160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.916+0000 7f6c877fe640 1 -- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 msgr2=0x7f6c880d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.916+0000 7f6c877fe640 1 -- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 msgr2=0x7f6c880d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.916+0000 7f6c877fe640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-04T10:43:32.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.916+0000 7f6c877fe640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-04T10:43:32.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.959+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 50594768 0 0) 0x7f6c880b2710 con 0x7f6c880ce8e0 2023-12-04T10:43:32.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.960+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6c74003520 con 0x7f6c880ce8e0 2023-12-04T10:43:32.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 <== mon.1 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3999396804 0 0) 0x7f6c74003520 con 0x7f6c880ce8e0 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 msgr2=0x7f6c880d3a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c880d3a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 msgr2=0x7f6c880b3160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 --2- 172.21.15.63:0/1962829365 >> v2:172.21.15.63:3300/0 conn(0x7f6c880d1fb0 0x7f6c880b3160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880b2960 con 0x7f6c880ce8e0 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 <== mon.1 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f6c70001670 con 0x7f6c880ce8e0 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 >> v1:172.21.15.66:6789/0 conn(0x7f6c880ce8e0 legacy=0x7f6c880d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c74003970 0x7f6c74003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.966+0000 7f6c86ffd640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c740047c0 0x7f6c74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.967+0000 7f6c86ffd640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.967+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880ced70 con 0x7f6c74003970 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.967+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880cf050 con 0x7f6c740047c0 2023-12-04T10:43:32.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.967+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7400ba80 con 0x7f6c8815d5d0 2023-12-04T10:43:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.968+0000 7f6c7ffff640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c740047c0 0x7f6c74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.968+0000 7f6c87fff640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.968+0000 7f6c877fe640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c74003970 0x7f6c74003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.969+0000 7f6c7ffff640 1 -- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 msgr2=0x7f6c74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:32.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.969+0000 7f6c7ffff640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c8815d5d0 0x7f6c74005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:32.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.969+0000 7f6c7ffff640 1 -- 172.21.15.63:0/1962829365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c74003970 msgr2=0x7f6c74003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:32.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.969+0000 7f6c7ffff640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c74003970 0x7f6c74003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:32.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.969+0000 7f6c7ffff640 1 -- 172.21.15.63:0/1962829365 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c74003520 con 0x7f6c740047c0 2023-12-04T10:43:32.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.970+0000 7f6c877fe640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c74003970 0x7f6c74003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:32.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.972+0000 7f6c7ffff640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c740047c0 0x7f6c74004c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c70001050 tx=0x7f6c740057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44b4790cb61db02f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:32.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.973+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70007270 con 0x7f6c740047c0 2023-12-04T10:43:32.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.973+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c700073d0 con 0x7f6c740047c0 2023-12-04T10:43:32.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.973+0000 7f6c86ffd640 1 -- 172.21.15.63:0/1962829365 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70005810 con 0x7f6c740047c0 2023-12-04T10:43:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.974+0000 7f6c8daad640 1 -- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c740047c0 msgr2=0x7f6c74004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.974+0000 7f6c8daad640 1 --2- 172.21.15.63:0/1962829365 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c740047c0 0x7f6c74004c40 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6c70001050 tx=0x7f6c740057f0 comp rx=0 tx=0).stop 2023-12-04T10:43:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.974+0000 7f6c87fff640 1 -- 172.21.15.63:0/1962829365 reap_dead start 2023-12-04T10:43:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.974+0000 7f6c8daad640 1 -- 172.21.15.63:0/1962829365 shutdown_connections 2023-12-04T10:43:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.974+0000 7f6c8daad640 1 -- 172.21.15.63:0/1962829365 >> 172.21.15.63:0/1962829365 conn(0x7f6c8809c600 msgr2=0x7f6c880d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.974+0000 7f6c8daad640 1 -- 172.21.15.63:0/1962829365 shutdown_connections 2023-12-04T10:43:32.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.974+0000 7f6c8daad640 1 -- 172.21.15.63:0/1962829365 wait complete. 2023-12-04T10:43:32.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.977+0000 7f6c8daad640 1 Processor -- start 2023-12-04T10:43:32.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.977+0000 7f6c8daad640 1 -- start start 2023-12-04T10:43:32.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c8daad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c740047c0 0x7f6c880cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:32.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c8daad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c880ca390 0x7f6c881f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:32.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c8daad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c88160620 0x7f6c88149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:32.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c8daad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880cb540 con 0x7f6c740047c0 2023-12-04T10:43:32.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c8daad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880ca930 con 0x7f6c880ca390 2023-12-04T10:43:32.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c8daad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c880cac10 con 0x7f6c88160620 2023-12-04T10:43:32.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c87fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c88160620 0x7f6c88149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c7ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c880ca390 0x7f6c881f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c740047c0 0x7f6c880cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:32.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c87fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c88160620 0x7f6c88149070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:42512/0 (socket says 172.21.15.63:42512) 2023-12-04T10:43:32.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.979+0000 7f6c87fff640 1 -- 172.21.15.63:0/999568217 learned_addr learned my addr 172.21.15.63:0/999568217 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:32.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.980+0000 7f6c877fe640 1 -- 172.21.15.63:0/999568217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c88160620 msgr2=0x7f6c88149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:32.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.980+0000 7f6c877fe640 1 --2- 172.21.15.63:0/999568217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c88160620 0x7f6c88149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:32.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.980+0000 7f6c877fe640 1 -- 172.21.15.63:0/999568217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c880ca390 msgr2=0x7f6c881f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:32.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.980+0000 7f6c877fe640 1 --2- 172.21.15.63:0/999568217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c880ca390 0x7f6c881f2250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:32.982 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.980+0000 7f6c877fe640 1 -- 172.21.15.63:0/999568217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c880caef0 con 0x7f6c740047c0 2023-12-04T10:43:32.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.981+0000 7f6c877fe640 1 --2- 172.21.15.63:0/999568217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c740047c0 0x7f6c880cb9d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6c780126b0 tx=0x7f6c78012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:32.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.981+0000 7f6c84ff9640 1 -- 172.21.15.63:0/999568217 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800e9b0 con 0x7f6c740047c0 2023-12-04T10:43:32.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.981+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c880cb1d0 con 0x7f6c740047c0 2023-12-04T10:43:32.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.981+0000 7f6c84ff9640 1 -- 172.21.15.63:0/999568217 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c7800c050 con 0x7f6c740047c0 2023-12-04T10:43:32.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.981+0000 7f6c84ff9640 1 -- 172.21.15.63:0/999568217 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c7800ed10 con 0x7f6c740047c0 2023-12-04T10:43:32.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.981+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c88160aa0 con 0x7f6c740047c0 2023-12-04T10:43:32.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.983+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c88068710 con 0x7f6c740047c0 2023-12-04T10:43:32.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.984+0000 7f6c84ff9640 1 -- 172.21.15.63:0/999568217 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6c7802a780 con 0x7f6c740047c0 2023-12-04T10:43:32.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.984+0000 7f6c84ff9640 1 -- 172.21.15.63:0/999568217 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f6c780209f0 con 0x7f6c740047c0 2023-12-04T10:43:32.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:32.987+0000 7f6c84ff9640 1 -- 172.21.15.63:0/999568217 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6c78025060 con 0x7f6c740047c0 2023-12-04T10:43:33.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.063+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f6c8806c210 con 0x7f6c740047c0 2023-12-04T10:43:33.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.066+0000 7f6c84ff9640 1 -- 172.21.15.63:0/999568217 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6c7801b070 con 0x7f6c740047c0 2023-12-04T10:43:33.067 INFO:teuthology.orchestra.run.smithi063.stderr:adjusted tunables profile to default 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c740047c0 msgr2=0x7f6c880cb9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 --2- 172.21.15.63:0/999568217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c740047c0 0x7f6c880cb9d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6c780126b0 tx=0x7f6c78012b70 comp rx=0 tx=0).stop 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 shutdown_connections 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 --2- 172.21.15.63:0/999568217 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6c88160620 0x7f6c88149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 --2- 172.21.15.63:0/999568217 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6c880ca390 0x7f6c881f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 --2- 172.21.15.63:0/999568217 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6c740047c0 0x7f6c880cb9d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 >> 172.21.15.63:0/999568217 conn(0x7f6c8809c600 msgr2=0x7f6c880d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 shutdown_connections 2023-12-04T10:43:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:33.068+0000 7f6c8daad640 1 -- 172.21.15.63:0/999568217 wait complete. 2023-12-04T10:43:33.089 INFO:tasks.ceph:check_enable_crimson: False 2023-12-04T10:43:33.089 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-04T10:43:33.089 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:33.089 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-04T10:43:33.176 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:33.177 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-04T10:43:33.305 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:33.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-04T10:43:33.390 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:43:33.390 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-04T10:43:33.523 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:33.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-04T10:43:33.562 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:33.561+0000 7f227202c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-04T10:43:33.566 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:33.565+0000 7fbed8c48040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-04T10:43:33.624 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:33.623+0000 7f227202c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-04T10:43:33.626 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:33.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-04T10:43:33.636 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:33.634+0000 7fbed8c48040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-04T10:43:33.728 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:33.728 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-04T10:43:33.817 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:43:33.818 DEBUG:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-04T10:43:33.967 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640 0 2023-12-04T10:43:34.171 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.170+0000 7f714c9d6640 1 Processor -- start 2023-12-04T10:43:34.172 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.170+0000 7f714c9d6640 1 -- start start 2023-12-04T10:43:34.173 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.172+0000 7f714c9d6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f714815a170 0x7f714806f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.173 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.172+0000 7f714c9d6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71480ceea0 0x7f71480711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.173 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.172+0000 7f714c9d6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71480ce9d0 con 0x7f7148071720 2023-12-04T10:43:34.173 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.172+0000 7f714c9d6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71480cf5a0 con 0x7f714815a170 2023-12-04T10:43:34.173 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.172+0000 7f714c9d6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480cb3a0 con 0x7f71480ceea0 2023-12-04T10:43:34.174 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.172+0000 7f7146d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f714815a170 0x7f714806f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.175 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.172+0000 7f7146d9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f714815a170 0x7f714806f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48696/0 (socket says 172.21.15.66:48696) 2023-12-04T10:43:34.175 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.173+0000 7f7146d9d640 1 -- 172.21.15.66:0/3252835179 learned_addr learned my addr 172.21.15.66:0/3252835179 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:34.175 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.173+0000 7f713ffff640 1 --2- 172.21.15.66:0/3252835179 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71480ceea0 0x7f71480711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.175 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.173+0000 7f7146d9d640 1 -- 172.21.15.66:0/3252835179 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71480ceea0 msgr2=0x7f71480711e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:34.175 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.173+0000 7f7146d9d640 1 --2- 172.21.15.66:0/3252835179 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71480ceea0 0x7f71480711e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.175 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.173+0000 7f7146d9d640 1 -- 172.21.15.66:0/3252835179 >> v1:172.21.15.66:6789/0 conn(0x7f7148071720 legacy=0x7f714815dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.175 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.173+0000 7f7146d9d640 1 -- 172.21.15.66:0/3252835179 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7148071b70 con 0x7f714815a170 2023-12-04T10:43:34.175 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.173+0000 7f714659c640 1 -- 172.21.15.66:0/3252835179 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3720610998 0 0) 0x7f71480ce9d0 con 0x7f7148071720 2023-12-04T10:43:34.176 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.174+0000 7f7146d9d640 1 --2- 172.21.15.66:0/3252835179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714815a170 0x7f714806f5e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f713800bb40 tx=0x7f713802e1e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f2b0115c42a36f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:34.176 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.174+0000 7f714659c640 1 -- 172.21.15.66:0/3252835179 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138036440 con 0x7f714815a170 2023-12-04T10:43:34.176 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714659c640 1 -- 172.21.15.66:0/3252835179 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71380365a0 con 0x7f714815a170 2023-12-04T10:43:34.176 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714659c640 1 -- 172.21.15.66:0/3252835179 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7138036930 con 0x7f714815a170 2023-12-04T10:43:34.177 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714c9d6640 1 -- 172.21.15.66:0/3252835179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714815a170 msgr2=0x7f714806f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.177 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714c9d6640 1 --2- 172.21.15.66:0/3252835179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714815a170 0x7f714806f5e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f713800bb40 tx=0x7f713802e1e0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.177 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714c9d6640 1 -- 172.21.15.66:0/3252835179 shutdown_connections 2023-12-04T10:43:34.177 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714c9d6640 1 --2- 172.21.15.66:0/3252835179 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71480ceea0 0x7f71480711e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.177 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714c9d6640 1 --2- 172.21.15.66:0/3252835179 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714815a170 0x7f714806f5e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.177 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714c9d6640 1 -- 172.21.15.66:0/3252835179 >> 172.21.15.66:0/3252835179 conn(0x7f71480cfdf0 msgr2=0x7f71480d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:34.177 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714c9d6640 1 -- 172.21.15.66:0/3252835179 shutdown_connections 2023-12-04T10:43:34.177 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.175+0000 7f714c9d6640 1 -- 172.21.15.66:0/3252835179 wait complete. 2023-12-04T10:43:34.178 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.177+0000 7f714c9d6640 1 Processor -- start 2023-12-04T10:43:34.178 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.177+0000 7f714c9d6640 1 -- start start 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.178+0000 7f714c9d6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7148071720 0x7f714806eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.178+0000 7f714c9d6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71480ceea0 0x7f71480c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.178+0000 7f714c9d6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f714815a170 0x7f71481542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.178+0000 7f714c9d6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480c7400 con 0x7f7148071720 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.178+0000 7f714c9d6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71480c7660 con 0x7f71480ceea0 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.178+0000 7f714c9d6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71480c7940 con 0x7f714815a170 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.178+0000 7f713ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71480ceea0 0x7f71480c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.178+0000 7f714759e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f714815a170 0x7f71481542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f713ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71480ceea0 0x7f71480c6ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48706/0 (socket says 172.21.15.66:48706) 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f713ffff640 1 -- 172.21.15.66:0/2022933140 learned_addr learned my addr 172.21.15.66:0/2022933140 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:34.180 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f7146d9d640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7148071720 0x7f714806eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f713ffff640 1 -- 172.21.15.66:0/2022933140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f714815a170 msgr2=0x7f71481542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f713ffff640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f714815a170 0x7f71481542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f713ffff640 1 -- 172.21.15.66:0/2022933140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7148071720 msgr2=0x7f714806eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f713ffff640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7148071720 0x7f714806eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f713ffff640 1 -- 172.21.15.66:0/2022933140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713800b770 con 0x7f71480ceea0 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f7146d9d640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7148071720 0x7f714806eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.179+0000 7f713ffff640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71480ceea0 0x7f71480c6ec0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f713000e930 tx=0x7f713000edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.180+0000 7f713f7fe640 1 -- 172.21.15.66:0/2022933140 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130009690 con 0x7f71480ceea0 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.180+0000 7f713f7fe640 1 -- 172.21.15.66:0/2022933140 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713000ca00 con 0x7f71480ceea0 2023-12-04T10:43:34.182 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.180+0000 7f713f7fe640 1 -- 172.21.15.66:0/2022933140 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713000cdb0 con 0x7f71480ceea0 2023-12-04T10:43:34.183 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.180+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71480c7c20 con 0x7f71480ceea0 2023-12-04T10:43:34.183 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.180+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714815c260 con 0x7f71480ceea0 2023-12-04T10:43:34.183 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.180+0000 7f713f7fe640 1 -- 172.21.15.66:0/2022933140 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7130005c90 con 0x7f71480ceea0 2023-12-04T10:43:34.183 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.180+0000 7f713f7fe640 1 -- 172.21.15.66:0/2022933140 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f7130013880 con 0x7f71480ceea0 2023-12-04T10:43:34.183 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.181+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714815c480 con 0x7f71480ceea0 2023-12-04T10:43:34.185 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.184+0000 7f713f7fe640 1 -- 172.21.15.66:0/2022933140 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7130021060 con 0x7f71480ceea0 2023-12-04T10:43:34.244 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.243+0000 7f227202c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-04T10:43:34.265 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.264+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640", "id": 0} v 0) v1 -- 0x7f714804e840 con 0x7f71480ceea0 2023-12-04T10:43:34.272 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.271+0000 7f713f7fe640 1 -- 172.21.15.66:0/2022933140 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7130017070 con 0x7f71480ceea0 2023-12-04T10:43:34.273 INFO:teuthology.orchestra.run.smithi066.stdout:0 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71480ceea0 msgr2=0x7f71480c6ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71480ceea0 0x7f71480c6ec0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f713000e930 tx=0x7f713000edf0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 shutdown_connections 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f714815a170 0x7f71481542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71480ceea0 0x7f71480c6ec0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 --2- 172.21.15.66:0/2022933140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7148071720 0x7f714806eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 >> 172.21.15.66:0/2022933140 conn(0x7f71480cfdf0 msgr2=0x7f71480b1180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 shutdown_connections 2023-12-04T10:43:34.275 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.273+0000 7f714c9d6640 1 -- 172.21.15.66:0/2022933140 wait complete. 2023-12-04T10:43:34.293 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d 1 2023-12-04T10:43:34.303 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.302+0000 7fbed8c48040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-04T10:43:34.309 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.308+0000 7f227202c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-04T10:43:34.362 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.361+0000 7f227202c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-04T10:43:34.370 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.369+0000 7fbed8c48040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-04T10:43:34.426 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.424+0000 7fbed8c48040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-04T10:43:34.427 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.427+0000 7f227202c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-04T10:43:34.479 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.478+0000 7f227202c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-04T10:43:34.494 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.492+0000 7fbed8c48040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-04T10:43:34.494 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.493+0000 7fb64390f640 1 Processor -- start 2023-12-04T10:43:34.494 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.493+0000 7fb64390f640 1 -- start start 2023-12-04T10:43:34.498 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.495+0000 7fb64390f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb63c0ce8e0 0x7fb63c0d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.498 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.495+0000 7fb64390f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb63c0d1de0 0x7fb63c0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.498 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.495+0000 7fb64390f640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb63c0b2710 con 0x7fb63c15d5d0 2023-12-04T10:43:34.498 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.495+0000 7fb64390f640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c0d2290 con 0x7fb63c0ce8e0 2023-12-04T10:43:34.498 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.495+0000 7fb64390f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb63c0d4150 con 0x7fb63c0d1de0 2023-12-04T10:43:34.498 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.495+0000 7fb641eac640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb63c0d1de0 0x7fb63c0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.499 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.496+0000 7fb641eac640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb63c0d1de0 0x7fb63c0b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48714/0 (socket says 172.21.15.66:48714) 2023-12-04T10:43:34.499 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.496+0000 7fb641eac640 1 -- 172.21.15.66:0/600822415 learned_addr learned my addr 172.21.15.66:0/600822415 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:34.499 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.496+0000 7fb640eaa640 1 --2- 172.21.15.66:0/600822415 >> v2:172.21.15.63:3300/0 conn(0x7fb63c0ce8e0 0x7fb63c0d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.499 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.496+0000 7fb641eac640 1 -- 172.21.15.66:0/600822415 >> v2:172.21.15.63:3300/0 conn(0x7fb63c0ce8e0 msgr2=0x7fb63c0d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:34.499 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.496+0000 7fb641eac640 1 --2- 172.21.15.66:0/600822415 >> v2:172.21.15.63:3300/0 conn(0x7fb63c0ce8e0 0x7fb63c0d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.499 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.496+0000 7fb641eac640 1 -- 172.21.15.66:0/600822415 >> v1:172.21.15.63:6789/0 conn(0x7fb63c15d5d0 legacy=0x7fb63c0d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.499 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.496+0000 7fb641eac640 1 -- 172.21.15.66:0/600822415 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb63c0ced70 con 0x7fb63c0d1de0 2023-12-04T10:43:34.499 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.497+0000 7fb641eac640 1 --2- 172.21.15.66:0/600822415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c0b3160 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb63c06b050 tx=0x7fb63402bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fecc5adbb994af17 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:34.500 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.497+0000 7fb633fff640 1 -- 172.21.15.66:0/600822415 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63402cb20 con 0x7fb63c0d1de0 2023-12-04T10:43:34.500 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.497+0000 7fb633fff640 1 -- 172.21.15.66:0/600822415 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63402cc80 con 0x7fb63c0d1de0 2023-12-04T10:43:34.500 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.497+0000 7fb633fff640 1 -- 172.21.15.66:0/600822415 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6340343f0 con 0x7fb63c0d1de0 2023-12-04T10:43:34.500 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.498+0000 7fb64390f640 1 -- 172.21.15.66:0/600822415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 msgr2=0x7fb63c0b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.500 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.498+0000 7fb64390f640 1 --2- 172.21.15.66:0/600822415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c0b3160 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb63c06b050 tx=0x7fb63402bf80 comp rx=0 tx=0).stop 2023-12-04T10:43:34.501 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.498+0000 7fb64390f640 1 -- 172.21.15.66:0/600822415 shutdown_connections 2023-12-04T10:43:34.501 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.498+0000 7fb64390f640 1 --2- 172.21.15.66:0/600822415 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c0b3160 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.501 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.498+0000 7fb64390f640 1 --2- 172.21.15.66:0/600822415 >> v2:172.21.15.63:3300/0 conn(0x7fb63c0ce8e0 0x7fb63c0d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.501 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.498+0000 7fb64390f640 1 -- 172.21.15.66:0/600822415 >> 172.21.15.66:0/600822415 conn(0x7fb63c09c600 msgr2=0x7fb63c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:34.501 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.498+0000 7fb64390f640 1 -- 172.21.15.66:0/600822415 shutdown_connections 2023-12-04T10:43:34.501 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.498+0000 7fb64390f640 1 -- 172.21.15.66:0/600822415 wait complete. 2023-12-04T10:43:34.501 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.500+0000 7fb64390f640 1 Processor -- start 2023-12-04T10:43:34.501 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.500+0000 7fb64390f640 1 -- start start 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb64390f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb64390f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb63c15d5d0 0x7fb63c15aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb64390f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb63c15af90 0x7fb63c0cbe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb64390f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c15b440 con 0x7fb63c15d5d0 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb64390f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c15de10 con 0x7fb63c0d1de0 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb64390f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb63c0cd190 con 0x7fb63c15af90 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb6416ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb641eac640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb63c15af90 0x7fb63c0cbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb6416ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48720/0 (socket says 172.21.15.66:48720) 2023-12-04T10:43:34.503 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb6416ab640 1 -- 172.21.15.66:0/1385564571 learned_addr learned my addr 172.21.15.66:0/1385564571 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:34.504 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.501+0000 7fb640eaa640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb63c15d5d0 0x7fb63c15aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.504 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb6416ab640 1 -- 172.21.15.66:0/1385564571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb63c15af90 msgr2=0x7fb63c0cbe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.504 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb6416ab640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb63c15af90 0x7fb63c0cbe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.504 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb6416ab640 1 -- 172.21.15.66:0/1385564571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb63c15d5d0 msgr2=0x7fb63c15aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.504 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb6416ab640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb63c15d5d0 0x7fb63c15aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.504 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb6416ab640 1 -- 172.21.15.66:0/1385564571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb634009b30 con 0x7fb63c0d1de0 2023-12-04T10:43:34.504 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb640eaa640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb63c15d5d0 0x7fb63c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb6416ab640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c151b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c430 tx=0x7fb63800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb631ffb640 1 -- 172.21.15.66:0/1385564571 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6380052d0 con 0x7fb63c0d1de0 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb631ffb640 1 -- 172.21.15.66:0/1385564571 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638005430 con 0x7fb63c0d1de0 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb631ffb640 1 -- 172.21.15.66:0/1385564571 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb638003830 con 0x7fb63c0d1de0 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.502+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb63c0ccbd0 con 0x7fb63c0d1de0 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.503+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb63c15e0b0 con 0x7fb63c0d1de0 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.503+0000 7fb631ffb640 1 -- 172.21.15.66:0/1385564571 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb638003c90 con 0x7fb63c0d1de0 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.503+0000 7fb631ffb640 1 -- 172.21.15.66:0/1385564571 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fb63801c440 con 0x7fb63c0d1de0 2023-12-04T10:43:34.505 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.504+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb63c068710 con 0x7fb63c0d1de0 2023-12-04T10:43:34.509 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.508+0000 7fb631ffb640 1 -- 172.21.15.66:0/1385564571 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb638017070 con 0x7fb63c0d1de0 2023-12-04T10:43:34.550 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.549+0000 7fbed8c48040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-04T10:43:34.587 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.586+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d", "id": 1} v 0) v1 -- 0x7fb63c15e270 con 0x7fb63c0d1de0 2023-12-04T10:43:34.594 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.592+0000 7fb631ffb640 1 -- 172.21.15.66:0/1385564571 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb638011590 con 0x7fb63c0d1de0 2023-12-04T10:43:34.594 INFO:teuthology.orchestra.run.smithi066.stdout:1 2023-12-04T10:43:34.595 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 msgr2=0x7fb63c151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.595 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c151b40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb63800c430 tx=0x7fb63800c8f0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.595 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 shutdown_connections 2023-12-04T10:43:34.595 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb63c15af90 0x7fb63c0cbe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.595 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb63c15d5d0 0x7fb63c15aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 --2- 172.21.15.66:0/1385564571 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb63c0d1de0 0x7fb63c151b40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 >> 172.21.15.66:0/1385564571 conn(0x7fb63c09c600 msgr2=0x7fb63c15c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:34.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 shutdown_connections 2023-12-04T10:43:34.596 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.594+0000 7fb64390f640 1 -- 172.21.15.66:0/1385564571 wait complete. 2023-12-04T10:43:34.599 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.598+0000 7f227202c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-04T10:43:34.611 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 135bb824-8a75-4b76-a657-a963288c2106 2 2023-12-04T10:43:34.674 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.673+0000 7fbed8c48040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-04T10:43:34.683 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.682+0000 7f227202c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-04T10:43:34.739 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.738+0000 7f227202c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-04T10:43:34.761 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.760+0000 7fbed8c48040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-04T10:43:34.802 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.801+0000 7f227202c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-04T10:43:34.819 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.817+0000 7fbed8c48040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-04T10:43:34.860 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:34.858+0000 7f227202c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-04T10:43:34.861 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.860+0000 7f419dbe6640 1 Processor -- start 2023-12-04T10:43:34.861 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.860+0000 7f419dbe6640 1 -- start start 2023-12-04T10:43:34.864 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419dbe6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f419815d200 0x7f41980cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.864 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419dbe6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f41980cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.864 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419dbe6640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41980d0e60 con 0x7f419815d5e0 2023-12-04T10:43:34.864 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419dbe6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41980b6f70 con 0x7f419815d200 2023-12-04T10:43:34.864 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419dbe6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41980d1140 con 0x7f41980ceed0 2023-12-04T10:43:34.864 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419d3e5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f41980cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.864 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419d3e5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f41980cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:40890/0 (socket says 172.21.15.66:40890) 2023-12-04T10:43:34.864 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419d3e5640 1 -- 172.21.15.66:0/2805724455 learned_addr learned my addr 172.21.15.66:0/2805724455 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:34.865 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.862+0000 7f419cbe4640 1 --2- 172.21.15.66:0/2805724455 >> v2:172.21.15.63:3300/0 conn(0x7f419815d200 0x7f41980cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.865 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.863+0000 7f419d3e5640 1 -- 172.21.15.66:0/2805724455 >> v2:172.21.15.63:3300/0 conn(0x7f419815d200 msgr2=0x7f41980cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:34.865 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.863+0000 7f419d3e5640 1 --2- 172.21.15.66:0/2805724455 >> v2:172.21.15.63:3300/0 conn(0x7f419815d200 0x7f41980cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.865 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.863+0000 7f419d3e5640 1 -- 172.21.15.66:0/2805724455 >> v1:172.21.15.63:6789/0 conn(0x7f419815d5e0 legacy=0x7f41980ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.865 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.863+0000 7f419d3e5640 1 -- 172.21.15.66:0/2805724455 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980d1420 con 0x7f41980ceed0 2023-12-04T10:43:34.866 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.865+0000 7f419d3e5640 1 --2- 172.21.15.66:0/2805724455 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f41980cffb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4190009e50 tx=0x7f419002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c4a28ae004327be server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:34.866 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.865+0000 7f41977fe640 1 -- 172.21.15.66:0/2805724455 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419002cb00 con 0x7f41980ceed0 2023-12-04T10:43:34.866 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.865+0000 7f41977fe640 1 -- 172.21.15.66:0/2805724455 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419002cc60 con 0x7f41980ceed0 2023-12-04T10:43:34.866 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.865+0000 7f41977fe640 1 -- 172.21.15.66:0/2805724455 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41900343f0 con 0x7f41980ceed0 2023-12-04T10:43:34.867 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.866+0000 7f419dbe6640 1 -- 172.21.15.66:0/2805724455 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 msgr2=0x7f41980cffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.867 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.866+0000 7f419dbe6640 1 --2- 172.21.15.66:0/2805724455 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f41980cffb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4190009e50 tx=0x7f419002bf60 comp rx=0 tx=0).stop 2023-12-04T10:43:34.867 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.866+0000 7f419dbe6640 1 -- 172.21.15.66:0/2805724455 shutdown_connections 2023-12-04T10:43:34.867 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.866+0000 7f419dbe6640 1 --2- 172.21.15.66:0/2805724455 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f41980cffb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.867 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.866+0000 7f419dbe6640 1 --2- 172.21.15.66:0/2805724455 >> v2:172.21.15.63:3300/0 conn(0x7f419815d200 0x7f41980cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.867 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.866+0000 7f419dbe6640 1 -- 172.21.15.66:0/2805724455 >> 172.21.15.66:0/2805724455 conn(0x7f419809c3e0 msgr2=0x7f41980d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:34.868 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.866+0000 7f419dbe6640 1 -- 172.21.15.66:0/2805724455 shutdown_connections 2023-12-04T10:43:34.868 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.866+0000 7f419dbe6640 1 -- 172.21.15.66:0/2805724455 wait complete. 2023-12-04T10:43:34.869 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.868+0000 7f419dbe6640 1 Processor -- start 2023-12-04T10:43:34.869 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.868+0000 7f419dbe6640 1 -- start start 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419dbe6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f419815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419dbe6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419815d200 0x7f419815b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419dbe6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f419815d5e0 0x7f41980c6c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419dbe6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980c7ff0 con 0x7f419815d200 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419dbe6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980c7160 con 0x7f419815d5e0 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419dbe6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41980c73e0 con 0x7f41980ceed0 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419cbe4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f419815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419cbe4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f419815ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:40894/0 (socket says 172.21.15.66:40894) 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419cbe4640 1 -- 172.21.15.66:0/4229843751 learned_addr learned my addr 172.21.15.66:0/4229843751 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419d3e5640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f419815d5e0 0x7f41980c6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f4197fff640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419815d200 0x7f419815b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.869+0000 7f419cbe4640 1 -- 172.21.15.66:0/4229843751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f419815d5e0 msgr2=0x7f41980c6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.872 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f419cbe4640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f419815d5e0 0x7f41980c6c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f419cbe4640 1 -- 172.21.15.66:0/4229843751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419815d200 msgr2=0x7f419815b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f419cbe4640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419815d200 0x7f419815b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f419cbe4640 1 -- 172.21.15.66:0/4229843751 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4190009b30 con 0x7f41980ceed0 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f4197fff640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419815d200 0x7f419815b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f419cbe4640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f419815ac70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f418c00e960 tx=0x7f418c00ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f41957fa640 1 -- 172.21.15.66:0/4229843751 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c009690 con 0x7f41980ceed0 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f41957fa640 1 -- 172.21.15.66:0/4229843751 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00ca00 con 0x7f41980ceed0 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f41957fa640 1 -- 172.21.15.66:0/4229843751 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00cdb0 con 0x7f41980ceed0 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41980d2080 con 0x7f41980ceed0 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.870+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41980c79a0 con 0x7f41980ceed0 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.871+0000 7f41957fa640 1 -- 172.21.15.66:0/4229843751 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f418c005c90 con 0x7f41980ceed0 2023-12-04T10:43:34.873 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.871+0000 7f41957fa640 1 -- 172.21.15.66:0/4229843751 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f418c006440 con 0x7f41980ceed0 2023-12-04T10:43:34.874 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.871+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419804e840 con 0x7f41980ceed0 2023-12-04T10:43:34.875 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.874+0000 7f41957fa640 1 -- 172.21.15.66:0/4229843751 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f418c021060 con 0x7f41980ceed0 2023-12-04T10:43:34.886 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.885+0000 7fbed8c48040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-04T10:43:34.945 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:34.944+0000 7fbed8c48040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-04T10:43:34.955 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.954+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "135bb824-8a75-4b76-a657-a963288c2106", "id": 2} v 0) v1 -- 0x7f41980cbe50 con 0x7f41980ceed0 2023-12-04T10:43:34.966 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.965+0000 7f41957fa640 1 -- 172.21.15.66:0/4229843751 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "135bb824-8a75-4b76-a657-a963288c2106", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f418c029020 con 0x7f41980ceed0 2023-12-04T10:43:34.966 INFO:teuthology.orchestra.run.smithi066.stdout:2 2023-12-04T10:43:34.967 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 msgr2=0x7f419815ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:34.967 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f419815ac70 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f418c00e960 tx=0x7f418c00ee20 comp rx=0 tx=0).stop 2023-12-04T10:43:34.968 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 shutdown_connections 2023-12-04T10:43:34.968 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f419815d5e0 0x7f41980c6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.968 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f419815d200 0x7f419815b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.968 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 --2- 172.21.15.66:0/4229843751 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f41980ceed0 0x7f419815ac70 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:34.968 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 >> 172.21.15.66:0/4229843751 conn(0x7f419809c3e0 msgr2=0x7f419806c580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:34.968 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 shutdown_connections 2023-12-04T10:43:34.968 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:34.966+0000 7f419dbe6640 1 -- 172.21.15.66:0/4229843751 wait complete. 2023-12-04T10:43:34.984 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 30168ef4-6572-4c1b-ac5b-5d6de73f7e78 3 2023-12-04T10:43:35.232 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.231+0000 7f8aef5d5640 1 Processor -- start 2023-12-04T10:43:35.232 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.231+0000 7f8aef5d5640 1 -- start start 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.232+0000 7f8aef5d5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae815d5d0 0x7f8ae80d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.232+0000 7f8aef5d5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8ae80d1fb0 0x7f8ae80b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.232+0000 7f8aef5d5640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae80b2710 con 0x7f8ae80ce8e0 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.232+0000 7f8aef5d5640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae80ced70 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.232+0000 7f8aef5d5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80cf050 con 0x7f8ae815d5d0 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aed371640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae815d5d0 0x7f8ae80d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aedb72640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8ae80d1fb0 0x7f8ae80b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aedb72640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8ae80d1fb0 0x7f8ae80b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48740/0 (socket says 172.21.15.66:48740) 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aedb72640 1 -- 172.21.15.66:0/1409600149 learned_addr learned my addr 172.21.15.66:0/1409600149 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:35.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aed371640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae815d5d0 0x7f8ae80d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:40896/0 (socket says 172.21.15.66:40896) 2023-12-04T10:43:35.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aedb72640 1 -- 172.21.15.66:0/1409600149 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae815d5d0 msgr2=0x7f8ae80d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:35.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aedb72640 1 --2- 172.21.15.66:0/1409600149 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae815d5d0 0x7f8ae80d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aedb72640 1 -- 172.21.15.66:0/1409600149 >> v1:172.21.15.63:6789/0 conn(0x7f8ae80ce8e0 legacy=0x7f8ae80d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aedb72640 1 -- 172.21.15.66:0/1409600149 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae80b2960 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.233+0000 7f8aed371640 1 --2- 172.21.15.66:0/1409600149 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae815d5d0 0x7f8ae80d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:43:35.236 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.234+0000 7f8aedb72640 1 --2- 172.21.15.66:0/1409600149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae80b3160 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009870 tx=0x7f8ae002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ed7848f1323dc66 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.235+0000 7f8ae7fff640 1 -- 172.21.15.66:0/1409600149 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0030840 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.235+0000 7f8ae7fff640 1 -- 172.21.15.66:0/1409600149 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae00309a0 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.235+0000 7f8ae7fff640 1 -- 172.21.15.66:0/1409600149 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0030d30 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.235+0000 7f8aef5d5640 1 -- 172.21.15.66:0/1409600149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 msgr2=0x7f8ae80b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.235+0000 7f8aef5d5640 1 --2- 172.21.15.66:0/1409600149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae80b3160 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8ae0009870 tx=0x7f8ae002b980 comp rx=0 tx=0).stop 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.236+0000 7f8aef5d5640 1 -- 172.21.15.66:0/1409600149 shutdown_connections 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.236+0000 7f8aef5d5640 1 --2- 172.21.15.66:0/1409600149 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae80b3160 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.236+0000 7f8aef5d5640 1 --2- 172.21.15.66:0/1409600149 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae815d5d0 0x7f8ae80d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.236+0000 7f8aef5d5640 1 -- 172.21.15.66:0/1409600149 >> 172.21.15.66:0/1409600149 conn(0x7f8ae809c600 msgr2=0x7f8ae80d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.236+0000 7f8aef5d5640 1 -- 172.21.15.66:0/1409600149 shutdown_connections 2023-12-04T10:43:35.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.236+0000 7f8aef5d5640 1 -- 172.21.15.66:0/1409600149 wait complete. 2023-12-04T10:43:35.238 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.237+0000 7f8aef5d5640 1 Processor -- start 2023-12-04T10:43:35.238 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.238+0000 7f8aef5d5640 1 -- start start 2023-12-04T10:43:35.240 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.238+0000 7f8aef5d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae815dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.240 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.238+0000 7f8aef5d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae815d5d0 0x7f8ae81f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.240 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.238+0000 7f8aef5d5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae81f59e0 0x7f8ae80b6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aef5d5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80b5ec0 con 0x7f8ae815d5d0 2023-12-04T10:43:35.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aef5d5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80b6a40 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aef5d5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae80b6110 con 0x7f8ae81f59e0 2023-12-04T10:43:35.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aed371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae815dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aedb72640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae81f59e0 0x7f8ae80b6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aed371640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae815dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48744/0 (socket says 172.21.15.66:48744) 2023-12-04T10:43:35.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aed371640 1 -- 172.21.15.66:0/4141299079 learned_addr learned my addr 172.21.15.66:0/4141299079 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:35.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aecb70640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae815d5d0 0x7f8ae81f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.242 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aed371640 1 -- 172.21.15.66:0/4141299079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae81f59e0 msgr2=0x7f8ae80b6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aed371640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae81f59e0 0x7f8ae80b6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aed371640 1 -- 172.21.15.66:0/4141299079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae815d5d0 msgr2=0x7f8ae81f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aed371640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae815d5d0 0x7f8ae81f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aed371640 1 -- 172.21.15.66:0/4141299079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad8009a70 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.239+0000 7f8aedb72640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae81f59e0 0x7f8ae80b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.240+0000 7f8aed371640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae815dfd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800efc0 tx=0x7f8ad800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.240+0000 7f8ae5ffb640 1 -- 172.21.15.66:0/4141299079 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8014680 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.240+0000 7f8ae5ffb640 1 -- 172.21.15.66:0/4141299079 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad800f040 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.240+0000 7f8ae5ffb640 1 -- 172.21.15.66:0/4141299079 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8014a00 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.240+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae00094d0 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.240+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae80b66d0 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.240+0000 7f8ae5ffb640 1 -- 172.21.15.66:0/4141299079 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8ad801d400 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.240+0000 7f8ae5ffb640 1 -- 172.21.15.66:0/4141299079 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f8ad801db40 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.243 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.241+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae81f5df0 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.245 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.244+0000 7f8ae5ffb640 1 -- 172.21.15.66:0/4141299079 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8ad803cce0 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.324 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.323+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "30168ef4-6572-4c1b-ac5b-5d6de73f7e78", "id": 3} v 0) v1 -- 0x7f8ae8068710 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.332 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.331+0000 7f8ae5ffb640 1 -- 172.21.15.66:0/4141299079 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "30168ef4-6572-4c1b-ac5b-5d6de73f7e78", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ad802b070 con 0x7f8ae80d1fb0 2023-12-04T10:43:35.332 INFO:teuthology.orchestra.run.smithi066.stdout:3 2023-12-04T10:43:35.333 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 msgr2=0x7f8ae815dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.333 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae815dfd0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f8ad800efc0 tx=0x7f8ad800c490 comp rx=0 tx=0).stop 2023-12-04T10:43:35.333 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 shutdown_connections 2023-12-04T10:43:35.333 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8ae81f59e0 0x7f8ae80b6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.333 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8ae815d5d0 0x7f8ae81f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.333 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 --2- 172.21.15.66:0/4141299079 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8ae80d1fb0 0x7f8ae815dfd0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.333 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 >> 172.21.15.66:0/4141299079 conn(0x7f8ae809c600 msgr2=0x7f8ae80b1580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:35.334 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 shutdown_connections 2023-12-04T10:43:35.334 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.332+0000 7f8aef5d5640 1 -- 172.21.15.66:0/4141299079 wait complete. 2023-12-04T10:43:35.335 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:35.334+0000 7f227202c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-04T10:43:35.351 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new d4080c3a-88e7-46a6-9e86-c2eca458c943 4 2023-12-04T10:43:35.442 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:35.441+0000 7fbed8c48040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-04T10:43:35.504 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:35.503+0000 7f227202c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-04T10:43:35.560 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.558+0000 7f7166343640 1 Processor -- start 2023-12-04T10:43:35.560 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.559+0000 7f7166343640 1 -- start start 2023-12-04T10:43:35.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.560+0000 7f7166343640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f71600d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.560+0000 7f7166343640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f71600d1af0 0x7f71600b03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.560+0000 7f7166343640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600aff10 con 0x7f71600b1fb0 2023-12-04T10:43:35.562 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7166343640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71600d11b0 con 0x7f71600d1af0 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7166343640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600ce800 con 0x7f71601608d0 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7165341640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f71600d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7164b40640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f71600b1fb0 0x7f71600d13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34216/0 (socket says 172.21.15.66:34216) 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7164b40640 1 -- 172.21.15.66:0/3464433246 learned_addr learned my addr 172.21.15.66:0/3464433246 (peer_addr_for_me v1:172.21.15.66:0/0) 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7165b42640 1 --2- 172.21.15.66:0/3464433246 >> v2:172.21.15.63:3300/0 conn(0x7f71600d1af0 0x7f71600b03a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7165341640 1 -- 172.21.15.66:0/3464433246 >> v2:172.21.15.63:3300/0 conn(0x7f71600d1af0 msgr2=0x7f71600b03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7165341640 1 --2- 172.21.15.66:0/3464433246 >> v2:172.21.15.63:3300/0 conn(0x7f71600d1af0 0x7f71600b03a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7165341640 1 -- 172.21.15.66:0/3464433246 >> v1:172.21.15.66:6789/0 conn(0x7f71600b1fb0 legacy=0x7f71600d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7157fff640 1 -- 172.21.15.66:0/3464433246 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530917759 0 0) 0x7f71600aff10 con 0x7f71600b1fb0 2023-12-04T10:43:35.563 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.561+0000 7f7165341640 1 -- 172.21.15.66:0/3464433246 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600ceaa0 con 0x7f71601608d0 2023-12-04T10:43:35.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.562+0000 7f7165341640 1 --2- 172.21.15.66:0/3464433246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f71600d3bd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f715c0097a0 tx=0x7f715c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e165b3b23263237 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:35.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.563+0000 7f7157fff640 1 -- 172.21.15.66:0/3464433246 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c02e070 con 0x7f71601608d0 2023-12-04T10:43:35.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.563+0000 7f7157fff640 1 -- 172.21.15.66:0/3464433246 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c0315a0 con 0x7f71601608d0 2023-12-04T10:43:35.564 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.563+0000 7f7157fff640 1 -- 172.21.15.66:0/3464433246 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c031930 con 0x7f71601608d0 2023-12-04T10:43:35.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.563+0000 7f7166343640 1 -- 172.21.15.66:0/3464433246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 msgr2=0x7f71600d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.563+0000 7f7166343640 1 --2- 172.21.15.66:0/3464433246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f71600d3bd0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f715c0097a0 tx=0x7f715c02b840 comp rx=0 tx=0).stop 2023-12-04T10:43:35.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.564+0000 7f7166343640 1 -- 172.21.15.66:0/3464433246 shutdown_connections 2023-12-04T10:43:35.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.564+0000 7f7166343640 1 --2- 172.21.15.66:0/3464433246 >> v2:172.21.15.63:3300/0 conn(0x7f71600d1af0 0x7f71600b03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.564+0000 7f7166343640 1 --2- 172.21.15.66:0/3464433246 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f71600d3bd0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.564+0000 7f7166343640 1 -- 172.21.15.66:0/3464433246 >> 172.21.15.66:0/3464433246 conn(0x7f71600d30b0 msgr2=0x7f71600d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:35.565 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.564+0000 7f7166343640 1 -- 172.21.15.66:0/3464433246 shutdown_connections 2023-12-04T10:43:35.566 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.564+0000 7f7166343640 1 -- 172.21.15.66:0/3464433246 wait complete. 2023-12-04T10:43:35.567 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.566+0000 7f7166343640 1 Processor -- start 2023-12-04T10:43:35.568 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.567+0000 7f7166343640 1 -- start start 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.568+0000 7f7166343640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71600b1fb0 0x7f71601f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.568+0000 7f7166343640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71600d1af0 0x7f7160153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.568+0000 7f7166343640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f7160154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.568+0000 7f7166343640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600b7e80 con 0x7f71600d1af0 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.568+0000 7f7166343640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600b7270 con 0x7f71600b1fb0 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.568+0000 7f7166343640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600b7550 con 0x7f71601608d0 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.568+0000 7f7165341640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71600b1fb0 0x7f71601f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165b42640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f7160154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165341640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71600b1fb0 0x7f71601f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48748/0 (socket says 172.21.15.66:48748) 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165341640 1 -- 172.21.15.66:0/1718413937 learned_addr learned my addr 172.21.15.66:0/1718413937 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:35.572 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7164b40640 1 --2- 172.21.15.66:0/1718413937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71600d1af0 0x7f7160153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165b42640 1 -- 172.21.15.66:0/1718413937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71600b1fb0 msgr2=0x7f71601f2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165b42640 1 --2- 172.21.15.66:0/1718413937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71600b1fb0 0x7f71601f2460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165b42640 1 -- 172.21.15.66:0/1718413937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71600d1af0 msgr2=0x7f7160153f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165b42640 1 --2- 172.21.15.66:0/1718413937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71600d1af0 0x7f7160153f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165b42640 1 -- 172.21.15.66:0/1718413937 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715c009400 con 0x7f71601608d0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.569+0000 7f7165b42640 1 --2- 172.21.15.66:0/1718413937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f7160154440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7158007d90 tx=0x7f715800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.570+0000 7f7155ffb640 1 -- 172.21.15.66:0/1718413937 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158018070 con 0x7f71601608d0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.570+0000 7f7155ffb640 1 -- 172.21.15.66:0/1718413937 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715800edd0 con 0x7f71601608d0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.570+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71600b7830 con 0x7f71601608d0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.570+0000 7f7155ffb640 1 -- 172.21.15.66:0/1718413937 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158003bb0 con 0x7f71601608d0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.570+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71601f29a0 con 0x7f71601608d0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.570+0000 7f7155ffb640 1 -- 172.21.15.66:0/1718413937 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7158004320 con 0x7f71601608d0 2023-12-04T10:43:35.573 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.570+0000 7f7155ffb640 1 -- 172.21.15.66:0/1718413937 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7158014d70 con 0x7f71601608d0 2023-12-04T10:43:35.574 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.571+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716004e840 con 0x7f71601608d0 2023-12-04T10:43:35.575 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.574+0000 7f7155ffb640 1 -- 172.21.15.66:0/1718413937 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f7158003d10 con 0x7f71601608d0 2023-12-04T10:43:35.652 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:35.651+0000 7fbed8c48040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-04T10:43:35.662 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:35.661+0000 7f227202c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-04T10:43:35.690 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.689+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d4080c3a-88e7-46a6-9e86-c2eca458c943", "id": 4} v 0) v1 -- 0x7f71600d0040 con 0x7f71601608d0 2023-12-04T10:43:35.697 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.696+0000 7f7155ffb640 1 -- 172.21.15.66:0/1718413937 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4080c3a-88e7-46a6-9e86-c2eca458c943", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f71580045d0 con 0x7f71601608d0 2023-12-04T10:43:35.697 INFO:teuthology.orchestra.run.smithi066.stdout:4 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.697+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 msgr2=0x7f7160154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.697+0000 7f7166343640 1 --2- 172.21.15.66:0/1718413937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f7160154440 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7158007d90 tx=0x7f715800e4b0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.697+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 shutdown_connections 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.697+0000 7f7166343640 1 --2- 172.21.15.66:0/1718413937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f71601608d0 0x7f7160154440 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.697+0000 7f7166343640 1 --2- 172.21.15.66:0/1718413937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f71600d1af0 0x7f7160153f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.697+0000 7f7166343640 1 --2- 172.21.15.66:0/1718413937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f71600b1fb0 0x7f71601f2460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.697+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 >> 172.21.15.66:0/1718413937 conn(0x7f71600d30b0 msgr2=0x7f71600d3490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.698+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 shutdown_connections 2023-12-04T10:43:35.699 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.698+0000 7f7166343640 1 -- 172.21.15.66:0/1718413937 wait complete. 2023-12-04T10:43:35.715 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 101d8e54-ffcf-489f-8d1e-731204c166e7 5 2023-12-04T10:43:35.718 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:35.717+0000 7f227202c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-04T10:43:35.793 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:35.792+0000 7fbed8c48040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-04T10:43:35.833 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:35.832+0000 7f227202c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-04T10:43:35.852 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:35.850+0000 7fbed8c48040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-04T10:43:35.910 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.908+0000 7fda5b23d640 1 Processor -- start 2023-12-04T10:43:35.910 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.909+0000 7fda5b23d640 1 -- start start 2023-12-04T10:43:35.911 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda5b23d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fda5406c310 0x7fda5406b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.911 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda5b23d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda540b25f0 0x7fda540b09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.911 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda5b23d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda5415d860 con 0x7fda5415d480 2023-12-04T10:43:35.912 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda5b23d640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda5406ba80 con 0x7fda5406c310 2023-12-04T10:43:35.912 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda5b23d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540b0720 con 0x7fda540b25f0 2023-12-04T10:43:35.912 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda597da640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda540b25f0 0x7fda540b09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.912 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda58fd9640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fda5415d480 0x7fda5406bc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34220/0 (socket says 172.21.15.66:34220) 2023-12-04T10:43:35.912 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda58fd9640 1 -- 172.21.15.66:0/1443158002 learned_addr learned my addr 172.21.15.66:0/1443158002 (peer_addr_for_me v1:172.21.15.66:0/0) 2023-12-04T10:43:35.912 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.910+0000 7fda53fff640 1 --2- 172.21.15.66:0/1443158002 >> v2:172.21.15.63:3300/0 conn(0x7fda5406c310 0x7fda5406b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.913 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.911+0000 7fda537fe640 1 -- 172.21.15.66:0/1443158002 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 366225798 0 0) 0x7fda5415d860 con 0x7fda5415d480 2023-12-04T10:43:35.913 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.911+0000 7fda597da640 1 -- 172.21.15.66:0/1443158002 >> v2:172.21.15.63:3300/0 conn(0x7fda5406c310 msgr2=0x7fda5406b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:35.913 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.911+0000 7fda597da640 1 --2- 172.21.15.66:0/1443158002 >> v2:172.21.15.63:3300/0 conn(0x7fda5406c310 0x7fda5406b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.913 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.911+0000 7fda597da640 1 -- 172.21.15.66:0/1443158002 >> v1:172.21.15.66:6789/0 conn(0x7fda5415d480 legacy=0x7fda5406bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.913 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.911+0000 7fda597da640 1 -- 172.21.15.66:0/1443158002 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda540cf240 con 0x7fda540b25f0 2023-12-04T10:43:35.913 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.911+0000 7fda53fff640 1 --2- 172.21.15.66:0/1443158002 >> v2:172.21.15.63:3300/0 conn(0x7fda5406c310 0x7fda5406b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:35.914 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.912+0000 7fda597da640 1 --2- 172.21.15.66:0/1443158002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda540b25f0 0x7fda540b09b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009d90 tx=0x7fda4c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=281d2cb9065244ec server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:35.914 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda537fe640 1 -- 172.21.15.66:0/1443158002 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c02cc50 con 0x7fda540b25f0 2023-12-04T10:43:35.914 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda537fe640 1 -- 172.21.15.66:0/1443158002 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4c02cdb0 con 0x7fda540b25f0 2023-12-04T10:43:35.914 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda537fe640 1 -- 172.21.15.66:0/1443158002 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c034660 con 0x7fda540b25f0 2023-12-04T10:43:35.915 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda5b23d640 1 -- 172.21.15.66:0/1443158002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda540b25f0 msgr2=0x7fda540b09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.915 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda5b23d640 1 --2- 172.21.15.66:0/1443158002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda540b25f0 0x7fda540b09b0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009d90 tx=0x7fda4c02bea0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.915 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda5b23d640 1 -- 172.21.15.66:0/1443158002 shutdown_connections 2023-12-04T10:43:35.915 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda5b23d640 1 --2- 172.21.15.66:0/1443158002 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda540b25f0 0x7fda540b09b0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.915 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda5b23d640 1 --2- 172.21.15.66:0/1443158002 >> v2:172.21.15.63:3300/0 conn(0x7fda5406c310 0x7fda5406b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.915 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.913+0000 7fda5b23d640 1 -- 172.21.15.66:0/1443158002 >> 172.21.15.66:0/1443158002 conn(0x7fda540d1050 msgr2=0x7fda540d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:35.915 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.914+0000 7fda5b23d640 1 -- 172.21.15.66:0/1443158002 shutdown_connections 2023-12-04T10:43:35.915 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.914+0000 7fda5b23d640 1 -- 172.21.15.66:0/1443158002 wait complete. 2023-12-04T10:43:35.916 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.915+0000 7fda5b23d640 1 Processor -- start 2023-12-04T10:43:35.916 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.916+0000 7fda5b23d640 1 -- start start 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.916+0000 7fda5b23d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5406c310 0x7fda541f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.916+0000 7fda5b23d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda540b25f0 0x7fda541f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda5b23d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5415d480 0x7fda5415da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda5b23d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c9bb0 con 0x7fda540b25f0 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda5b23d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda541f38f0 con 0x7fda5415d480 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda5b23d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda540c9210 con 0x7fda5406c310 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5406c310 0x7fda541f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5406c310 0x7fda541f3b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:40946/0 (socket says 172.21.15.66:40946) 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 -- 172.21.15.66:0/3319834652 learned_addr learned my addr 172.21.15.66:0/3319834652 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda597da640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5415d480 0x7fda5415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda53fff640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda540b25f0 0x7fda541f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 -- 172.21.15.66:0/3319834652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5415d480 msgr2=0x7fda5415da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.920 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5415d480 0x7fda5415da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 -- 172.21.15.66:0/3319834652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda540b25f0 msgr2=0x7fda541f2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda540b25f0 0x7fda541f2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 -- 172.21.15.66:0/3319834652 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c009a70 con 0x7fda5406c310 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.917+0000 7fda58fd9640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5406c310 0x7fda541f3b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda4800c430 tx=0x7fda4800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.918+0000 7fda517fa640 1 -- 172.21.15.66:0/3319834652 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda480074e0 con 0x7fda5406c310 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.918+0000 7fda517fa640 1 -- 172.21.15.66:0/3319834652 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda48007660 con 0x7fda5406c310 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.918+0000 7fda517fa640 1 -- 172.21.15.66:0/3319834652 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48004a20 con 0x7fda5406c310 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.918+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda540c94f0 con 0x7fda5406c310 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.918+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda541f40a0 con 0x7fda5406c310 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.918+0000 7fda517fa640 1 -- 172.21.15.66:0/3319834652 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fda4801d3f0 con 0x7fda5406c310 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.918+0000 7fda517fa640 1 -- 172.21.15.66:0/3319834652 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7fda48013940 con 0x7fda5406c310 2023-12-04T10:43:35.921 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.919+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda54068710 con 0x7fda5406c310 2023-12-04T10:43:35.922 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:35.921+0000 7fda517fa640 1 -- 172.21.15.66:0/3319834652 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fda48013b50 con 0x7fda5406c310 2023-12-04T10:43:35.949 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:35.948+0000 7f227202c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-04T10:43:35.976 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:35.975+0000 7fbed8c48040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-04T10:43:36.003 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.002+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd new", "uuid": "101d8e54-ffcf-489f-8d1e-731204c166e7", "id": 5} v 0) v1 -- 0x7fda540b1710 con 0x7fda5406c310 2023-12-04T10:43:36.009 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.008+0000 7fda517fa640 1 -- 172.21.15.66:0/3319834652 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "101d8e54-ffcf-489f-8d1e-731204c166e7", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda48013e20 con 0x7fda5406c310 2023-12-04T10:43:36.009 INFO:teuthology.orchestra.run.smithi066.stdout:5 2023-12-04T10:43:36.010 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.009+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5406c310 msgr2=0x7fda541f3b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.010 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.009+0000 7fda5b23d640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5406c310 0x7fda541f3b60 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fda4800c430 tx=0x7fda4800c8f0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.011 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.009+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 shutdown_connections 2023-12-04T10:43:36.011 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.009+0000 7fda5b23d640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fda5415d480 0x7fda5415da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.011 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.009+0000 7fda5b23d640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fda540b25f0 0x7fda541f2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.011 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.009+0000 7fda5b23d640 1 --2- 172.21.15.66:0/3319834652 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fda5406c310 0x7fda541f3b60 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.011 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.009+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 >> 172.21.15.66:0/3319834652 conn(0x7fda540d1050 msgr2=0x7fda540cda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:36.011 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.010+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 shutdown_connections 2023-12-04T10:43:36.011 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.010+0000 7fda5b23d640 1 -- 172.21.15.66:0/3319834652 wait complete. 2023-12-04T10:43:36.027 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 24066ac9-70ea-4495-b31a-7b5487b36920 6 2023-12-04T10:43:36.097 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:36.096+0000 7fbed8c48040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-04T10:43:36.117 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:36.116+0000 7f227202c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-04T10:43:36.169 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:36.168+0000 7f227202c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-04T10:43:36.226 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.224+0000 7f1aa4db6640 1 Processor -- start 2023-12-04T10:43:36.226 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.225+0000 7f1aa4db6640 1 -- start start 2023-12-04T10:43:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.226+0000 7f1aa4db6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1aa015d370 0x7f1aa00ca710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.226+0000 7f1aa4db6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1aa00c6730 0x7f1aa006a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.226+0000 7f1aa4db6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa00c6bb0 0x7f1aa006a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1aa4db6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa0161400 con 0x7f1aa00c6730 2023-12-04T10:43:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1aa4db6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aa01616e0 con 0x7f1aa015d370 2023-12-04T10:43:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1aa4db6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa01619c0 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9ed9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa00c6bb0 0x7f1aa006a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.228 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9e59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1aa015d370 0x7f1aa00ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9ed9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa00c6bb0 0x7f1aa006a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.66:40960/0 (socket says 172.21.15.66:40960) 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9ed9d640 1 -- 172.21.15.66:0/1966037282 learned_addr learned my addr 172.21.15.66:0/1966037282 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a97fff640 1 --2- 172.21.15.66:0/1966037282 >> v2:172.21.15.63:3300/0 conn(0x7f1aa00c6730 0x7f1aa006a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9e59c640 1 -- 172.21.15.66:0/1966037282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa00c6bb0 msgr2=0x7f1aa006a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9e59c640 1 --2- 172.21.15.66:0/1966037282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa00c6bb0 0x7f1aa006a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9e59c640 1 -- 172.21.15.66:0/1966037282 >> v2:172.21.15.63:3300/0 conn(0x7f1aa00c6730 msgr2=0x7f1aa006a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9e59c640 1 --2- 172.21.15.66:0/1966037282 >> v2:172.21.15.63:3300/0 conn(0x7f1aa00c6730 0x7f1aa006a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9e59c640 1 -- 172.21.15.66:0/1966037282 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aa0161ca0 con 0x7f1aa015d370 2023-12-04T10:43:36.229 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.227+0000 7f1a9ed9d640 1 --2- 172.21.15.66:0/1966037282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa00c6bb0 0x7f1aa006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:43:36.230 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.229+0000 7f1a9e59c640 1 --2- 172.21.15.66:0/1966037282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa015d370 0x7f1aa00ca710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00d0ec0 tx=0x7f1a9002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cef2e7441eb77b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:36.230 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.229+0000 7f1a9dd9b640 1 -- 172.21.15.66:0/1966037282 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9002e070 con 0x7f1aa015d370 2023-12-04T10:43:36.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1a9dd9b640 1 -- 172.21.15.66:0/1966037282 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a900315a0 con 0x7f1aa015d370 2023-12-04T10:43:36.231 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1a9dd9b640 1 -- 172.21.15.66:0/1966037282 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a90031930 con 0x7f1aa015d370 2023-12-04T10:43:36.233 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1966037282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa015d370 msgr2=0x7f1aa00ca710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 --2- 172.21.15.66:0/1966037282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa015d370 0x7f1aa00ca710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f1aa00d0ec0 tx=0x7f1a9002b840 comp rx=0 tx=0).stop 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1966037282 shutdown_connections 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 --2- 172.21.15.66:0/1966037282 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa00c6bb0 0x7f1aa006a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 --2- 172.21.15.66:0/1966037282 >> v2:172.21.15.63:3300/0 conn(0x7f1aa00c6730 0x7f1aa006a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 --2- 172.21.15.66:0/1966037282 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa015d370 0x7f1aa00ca710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1966037282 >> 172.21.15.66:0/1966037282 conn(0x7f1aa00b1bb0 msgr2=0x7f1aa00b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1966037282 shutdown_connections 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.230+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1966037282 wait complete. 2023-12-04T10:43:36.234 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.233+0000 7f1aa4db6640 1 Processor -- start 2023-12-04T10:43:36.235 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.233+0000 7f1aa4db6640 1 -- start start 2023-12-04T10:43:36.236 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1aa4db6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1aa00c6730 0x7f1aa00b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.236 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1aa4db6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa00c6bb0 0x7f1aa00c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.236 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1aa4db6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa015d370 0x7f1aa014c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1aa4db6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa015df10 con 0x7f1aa00c6730 2023-12-04T10:43:36.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1aa4db6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa015e1f0 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1aa4db6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aa015e4d0 con 0x7f1aa015d370 2023-12-04T10:43:36.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1a97fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa00c6bb0 0x7f1aa00c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1a9ed9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa015d370 0x7f1aa014c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1a97fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa00c6bb0 0x7f1aa00c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48768/0 (socket says 172.21.15.66:48768) 2023-12-04T10:43:36.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1a97fff640 1 -- 172.21.15.66:0/1339643562 learned_addr learned my addr 172.21.15.66:0/1339643562 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:36.237 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.235+0000 7f1a9e59c640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1aa00c6730 0x7f1aa00b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a97fff640 1 -- 172.21.15.66:0/1339643562 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa015d370 msgr2=0x7f1aa014c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a97fff640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa015d370 0x7f1aa014c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a97fff640 1 -- 172.21.15.66:0/1339643562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1aa00c6730 msgr2=0x7f1aa00b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a97fff640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1aa00c6730 0x7f1aa00b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a97fff640 1 -- 172.21.15.66:0/1339643562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a98009b30 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a9ed9d640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa015d370 0x7f1aa014c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a97fff640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa00c6bb0 0x7f1aa00c92d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800d800 tx=0x7f1a8800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a96ffd640 1 -- 172.21.15.66:0/1339643562 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a880096a0 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a96ffd640 1 -- 172.21.15.66:0/1339643562 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a88009800 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a90009400 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1a96ffd640 1 -- 172.21.15.66:0/1339643562 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a88009990 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.236+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aa015ea90 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.237+0000 7f1a96ffd640 1 -- 172.21.15.66:0/1339643562 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1a8801d410 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.239 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.237+0000 7f1a96ffd640 1 -- 172.21.15.66:0/1339643562 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f1a8801dcb0 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.240 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.238+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa0068710 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.241 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.240+0000 7f1a96ffd640 1 -- 172.21.15.66:0/1339643562 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1a88018030 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.275 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:36.273+0000 7fbed8c48040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-04T10:43:36.318 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.317+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "24066ac9-70ea-4495-b31a-7b5487b36920", "id": 6} v 0) v1 -- 0x7f1aa00b5f00 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.325 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.323+0000 7f1a96ffd640 1 -- 172.21.15.66:0/1339643562 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "24066ac9-70ea-4495-b31a-7b5487b36920", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1a8801d6c0 con 0x7f1aa00c6bb0 2023-12-04T10:43:36.325 INFO:teuthology.orchestra.run.smithi066.stdout:6 2023-12-04T10:43:36.326 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa00c6bb0 msgr2=0x7f1aa00c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.326 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa00c6bb0 0x7f1aa00c92d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f1a8800d800 tx=0x7f1a8800dcc0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.326 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 shutdown_connections 2023-12-04T10:43:36.326 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1aa015d370 0x7f1aa014c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.326 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1aa00c6bb0 0x7f1aa00c92d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.327 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 --2- 172.21.15.66:0/1339643562 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1aa00c6730 0x7f1aa00b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.327 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 >> 172.21.15.66:0/1339643562 conn(0x7f1aa00b1bb0 msgr2=0x7f1aa00cae60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:36.327 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 shutdown_connections 2023-12-04T10:43:36.327 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.325+0000 7f1aa4db6640 1 -- 172.21.15.66:0/1339643562 wait complete. 2023-12-04T10:43:36.328 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:36.327+0000 7fbed8c48040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-04T10:43:36.335 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:36.334+0000 7f227202c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-04T10:43:36.341 DEBUG:teuthology.orchestra.run.smithi066:> sudo ceph --cluster ceph osd new 97512e73-0b5a-42e4-87a6-2b54302d79c1 7 2023-12-04T10:43:36.499 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:36.498+0000 7fbed8c48040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-04T10:43:36.539 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.537+0000 7f17e7ad7640 1 Processor -- start 2023-12-04T10:43:36.539 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.538+0000 7f17e7ad7640 1 -- start start 2023-12-04T10:43:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.539+0000 7f17e7ad7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f17e00701b0 0x7f17e00705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.539+0000 7f17e7ad7640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17e00ca290 0x7f17e00ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.539+0000 7f17e7ad7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e0070b00 con 0x7f17e0144a00 2023-12-04T10:43:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.539+0000 7f17e7ad7640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e00cabe0 con 0x7f17e00ca290 2023-12-04T10:43:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.539+0000 7f17e7ad7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e00cae80 con 0x7f17e00701b0 2023-12-04T10:43:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e5072640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f17e00701b0 0x7f17e00705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e5873640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f17e0144a00 0x7f17e00b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.66:34230/0 (socket says 172.21.15.66:34230) 2023-12-04T10:43:36.541 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e5873640 1 -- 172.21.15.66:0/2338124582 learned_addr learned my addr 172.21.15.66:0/2338124582 (peer_addr_for_me v1:172.21.15.66:0/0) 2023-12-04T10:43:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e6074640 1 --2- 172.21.15.66:0/2338124582 >> v2:172.21.15.63:3300/0 conn(0x7f17e00ca290 0x7f17e00ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e5072640 1 -- 172.21.15.66:0/2338124582 >> v2:172.21.15.63:3300/0 conn(0x7f17e00ca290 msgr2=0x7f17e00ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e5072640 1 --2- 172.21.15.66:0/2338124582 >> v2:172.21.15.63:3300/0 conn(0x7f17e00ca290 0x7f17e00ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e4871640 1 -- 172.21.15.66:0/2338124582 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104673053 0 0) 0x7f17e0070b00 con 0x7f17e0144a00 2023-12-04T10:43:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e5072640 1 -- 172.21.15.66:0/2338124582 >> v1:172.21.15.66:6789/0 conn(0x7f17e0144a00 legacy=0x7f17e00b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.542 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.540+0000 7f17e5072640 1 -- 172.21.15.66:0/2338124582 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e006c460 con 0x7f17e00701b0 2023-12-04T10:43:36.543 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.542+0000 7f17e5072640 1 --2- 172.21.15.66:0/2338124582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00701b0 0x7f17e00705c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f17e00cb3d0 tx=0x7f17d002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98c9c8e4ec23a976 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:36.543 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.542+0000 7f17e4871640 1 -- 172.21.15.66:0/2338124582 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0031830 con 0x7f17e00701b0 2023-12-04T10:43:36.543 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.542+0000 7f17e4871640 1 -- 172.21.15.66:0/2338124582 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d0031990 con 0x7f17e00701b0 2023-12-04T10:43:36.543 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.542+0000 7f17e4871640 1 -- 172.21.15.66:0/2338124582 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0031d20 con 0x7f17e00701b0 2023-12-04T10:43:36.544 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.543+0000 7f17e7ad7640 1 -- 172.21.15.66:0/2338124582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00701b0 msgr2=0x7f17e00705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.544 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.543+0000 7f17e7ad7640 1 --2- 172.21.15.66:0/2338124582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00701b0 0x7f17e00705c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f17e00cb3d0 tx=0x7f17d002b8d0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.544 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.543+0000 7f17e7ad7640 1 -- 172.21.15.66:0/2338124582 shutdown_connections 2023-12-04T10:43:36.544 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.543+0000 7f17e7ad7640 1 --2- 172.21.15.66:0/2338124582 >> v2:172.21.15.63:3300/0 conn(0x7f17e00ca290 0x7f17e00ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.543+0000 7f17e7ad7640 1 --2- 172.21.15.66:0/2338124582 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00701b0 0x7f17e00705c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.543+0000 7f17e7ad7640 1 -- 172.21.15.66:0/2338124582 >> 172.21.15.66:0/2338124582 conn(0x7f17e00cee80 msgr2=0x7f17e00cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.543+0000 7f17e7ad7640 1 -- 172.21.15.66:0/2338124582 shutdown_connections 2023-12-04T10:43:36.545 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.543+0000 7f17e7ad7640 1 -- 172.21.15.66:0/2338124582 wait complete. 2023-12-04T10:43:36.546 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.545+0000 7f17e7ad7640 1 Processor -- start 2023-12-04T10:43:36.546 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.545+0000 7f17e7ad7640 1 -- start start 2023-12-04T10:43:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e7ad7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e00701b0 0x7f17e00c8910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e7ad7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00ca290 0x7f17e015ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e7ad7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17e0144a00 0x7f17e015de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e7ad7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e0140c00 con 0x7f17e00701b0 2023-12-04T10:43:36.547 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e7ad7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e00c7870 con 0x7f17e00ca290 2023-12-04T10:43:36.548 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e7ad7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e00c7b50 con 0x7f17e0144a00 2023-12-04T10:43:36.548 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e5072640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00ca290 0x7f17e015ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.548 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e5072640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00ca290 0x7f17e015ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.66:48796/0 (socket says 172.21.15.66:48796) 2023-12-04T10:43:36.548 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e5072640 1 -- 172.21.15.66:0/3442473731 learned_addr learned my addr 172.21.15.66:0/3442473731 (peer_addr_for_me v2:172.21.15.66:0/0) 2023-12-04T10:43:36.548 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e6074640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17e0144a00 0x7f17e015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.548 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.546+0000 7f17e5873640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e00701b0 0x7f17e00c8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.549 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e5072640 1 -- 172.21.15.66:0/3442473731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17e0144a00 msgr2=0x7f17e015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.549 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e5072640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17e0144a00 0x7f17e015de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.549 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e5072640 1 -- 172.21.15.66:0/3442473731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e00701b0 msgr2=0x7f17e00c8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.549 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e5072640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e00701b0 0x7f17e00c8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e5072640 1 -- 172.21.15.66:0/3442473731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d0009400 con 0x7f17e00ca290 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e5873640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e00701b0 0x7f17e00c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e5072640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00ca290 0x7f17e015ae40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f17d0000c00 tx=0x7f17d00046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17d67fc640 1 -- 172.21.15.66:0/3442473731 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0004230 con 0x7f17e00ca290 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17d67fc640 1 -- 172.21.15.66:0/3442473731 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d00043b0 con 0x7f17e00ca290 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17d67fc640 1 -- 172.21.15.66:0/3442473731 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0004520 con 0x7f17e00ca290 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e00c7e30 con 0x7f17e00ca290 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.547+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e00c83f0 con 0x7f17e00ca290 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.548+0000 7f17d67fc640 1 -- 172.21.15.66:0/3442473731 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f17d003aba0 con 0x7f17e00ca290 2023-12-04T10:43:36.550 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.548+0000 7f17d67fc640 1 -- 172.21.15.66:0/3442473731 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f17d0045440 con 0x7f17e00ca290 2023-12-04T10:43:36.551 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.549+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e0068710 con 0x7f17e00ca290 2023-12-04T10:43:36.552 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.551+0000 7f17d67fc640 1 -- 172.21.15.66:0/3442473731 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f17d0035020 con 0x7f17e00ca290 2023-12-04T10:43:36.628 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.627+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd new", "uuid": "97512e73-0b5a-42e4-87a6-2b54302d79c1", "id": 7} v 0) v1 -- 0x7f17e00c92b0 con 0x7f17e00ca290 2023-12-04T10:43:36.636 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.635+0000 7f17d67fc640 1 -- 172.21.15.66:0/3442473731 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97512e73-0b5a-42e4-87a6-2b54302d79c1", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f17d003ae50 con 0x7f17e00ca290 2023-12-04T10:43:36.636 INFO:teuthology.orchestra.run.smithi066.stdout:7 2023-12-04T10:43:36.638 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.636+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00ca290 msgr2=0x7f17e015ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.638 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.636+0000 7f17e7ad7640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00ca290 0x7f17e015ae40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f17d0000c00 tx=0x7f17d00046c0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.638 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.636+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 shutdown_connections 2023-12-04T10:43:36.638 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.636+0000 7f17e7ad7640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17e0144a00 0x7f17e015de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.636+0000 7f17e7ad7640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17e00ca290 0x7f17e015ae40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.636+0000 7f17e7ad7640 1 --2- 172.21.15.66:0/3442473731 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17e00701b0 0x7f17e00c8910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.636+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 >> 172.21.15.66:0/3442473731 conn(0x7f17e00cee80 msgr2=0x7f17e01413a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.637+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 shutdown_connections 2023-12-04T10:43:36.639 INFO:teuthology.orchestra.run.smithi066.stderr:2023-12-04T10:43:36.637+0000 7f17e7ad7640 1 -- 172.21.15.66:0/3442473731 wait complete. 2023-12-04T10:43:36.655 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-04T10:43:36.655 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-04T10:43:36.664 INFO:tasks.ceph.osd.0:Started 2023-12-04T10:43:36.664 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-04T10:43:36.664 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-04T10:43:36.672 INFO:tasks.ceph.osd.1:Started 2023-12-04T10:43:36.672 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-04T10:43:36.672 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-04T10:43:36.677 INFO:tasks.ceph.osd.2:Started 2023-12-04T10:43:36.678 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-04T10:43:36.678 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-04T10:43:36.683 INFO:tasks.ceph.osd.3:Started 2023-12-04T10:43:36.683 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-04T10:43:36.683 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-04T10:43:36.689 INFO:tasks.ceph.osd.4:Started 2023-12-04T10:43:36.690 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-04T10:43:36.690 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-04T10:43:36.696 INFO:tasks.ceph.osd.5:Started 2023-12-04T10:43:36.696 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-04T10:43:36.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-04T10:43:36.702 INFO:tasks.ceph.osd.6:Started 2023-12-04T10:43:36.703 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-04T10:43:36.703 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-04T10:43:36.707 INFO:tasks.ceph.osd.7:Started 2023-12-04T10:43:36.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:43:36.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.944+0000 7f29d9c48640 1 Processor -- start 2023-12-04T10:43:36.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.944+0000 7f29d9c48640 1 -- start start 2023-12-04T10:43:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.945+0000 7f29d9c48640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d415d5d0 0x7f29d40d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.945+0000 7f29d9c48640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29d40ce8e0 0x7f29d40d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.945+0000 7f29d9c48640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29d40b2710 con 0x7f29d40d1de0 2023-12-04T10:43:36.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.945+0000 7f29d9c48640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29d40d2290 con 0x7f29d40ce8e0 2023-12-04T10:43:36.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.945+0000 7f29d9c48640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d40ced70 con 0x7f29d415d5d0 2023-12-04T10:43:36.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.945+0000 7f29d3fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f29d40d1de0 0x7f29d40cf8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:34018/0 (socket says 172.21.15.63:34018) 2023-12-04T10:43:36.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.945+0000 7f29d3fff640 1 -- 172.21.15.63:0/3584976736 learned_addr learned my addr 172.21.15.63:0/3584976736 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:43:36.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.945+0000 7f29d37fe640 1 --2- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d415d5d0 0x7f29d40d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.946+0000 7f29d2ffd640 1 --2- 172.21.15.63:0/3584976736 >> v2:172.21.15.66:3300/0 conn(0x7f29d40ce8e0 0x7f29d40d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.946+0000 7f29d27fc640 1 -- 172.21.15.63:0/3584976736 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192997323 0 0) 0x7f29d40b2710 con 0x7f29d40d1de0 2023-12-04T10:43:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.946+0000 7f29d27fc640 1 -- 172.21.15.63:0/3584976736 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f29bc003520 con 0x7f29d40d1de0 2023-12-04T10:43:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.946+0000 7f29d2ffd640 1 -- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d415d5d0 msgr2=0x7f29d40d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.946+0000 7f29d2ffd640 1 --2- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d415d5d0 0x7f29d40d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.946+0000 7f29d2ffd640 1 -- 172.21.15.63:0/3584976736 >> v1:172.21.15.63:6789/0 conn(0x7f29d40d1de0 legacy=0x7f29d40cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.946+0000 7f29d2ffd640 1 -- 172.21.15.63:0/3584976736 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29d40cf050 con 0x7f29d40ce8e0 2023-12-04T10:43:36.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.946+0000 7f29d37fe640 1 --2- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d415d5d0 0x7f29d40d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:43:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.947+0000 7f29d2ffd640 1 --2- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d40ce8e0 0x7f29d40d18a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29c80097a0 tx=0x7f29c802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f38f0fb29c8ca2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d27fc640 1 -- 172.21.15.63:0/3584976736 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c802d040 con 0x7f29d40ce8e0 2023-12-04T10:43:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d27fc640 1 -- 172.21.15.63:0/3584976736 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c8031810 con 0x7f29d40ce8e0 2023-12-04T10:43:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d27fc640 1 -- 172.21.15.63:0/3584976736 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c8031ba0 con 0x7f29d40ce8e0 2023-12-04T10:43:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d9c48640 1 -- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d40ce8e0 msgr2=0x7f29d40d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d9c48640 1 --2- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d40ce8e0 0x7f29d40d18a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f29c80097a0 tx=0x7f29c802b8b0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d9c48640 1 -- 172.21.15.63:0/3584976736 shutdown_connections 2023-12-04T10:43:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d9c48640 1 --2- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d40ce8e0 0x7f29d40d18a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d9c48640 1 --2- 172.21.15.63:0/3584976736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d415d5d0 0x7f29d40d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d9c48640 1 -- 172.21.15.63:0/3584976736 >> 172.21.15.63:0/3584976736 conn(0x7f29d409c600 msgr2=0x7f29d40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d9c48640 1 -- 172.21.15.63:0/3584976736 shutdown_connections 2023-12-04T10:43:36.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.948+0000 7f29d9c48640 1 -- 172.21.15.63:0/3584976736 wait complete. 2023-12-04T10:43:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.950+0000 7f29d9c48640 1 Processor -- start 2023-12-04T10:43:36.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.950+0000 7f29d9c48640 1 -- start start 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d9c48640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40d1de0 0x7f29d41f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d9c48640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d415d5d0 0x7f29d41f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d9c48640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d4142de0 0x7f29d40ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d9c48640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d415fb40 con 0x7f29d40d1de0 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d9c48640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29d41f2e40 con 0x7f29d415d5d0 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d9c48640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29d41435c0 con 0x7f29d4142de0 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40d1de0 0x7f29d41f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40d1de0 0x7f29d41f7040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58672/0 (socket says 172.21.15.63:58672) 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d37fe640 1 -- 172.21.15.63:0/1336026893 learned_addr learned my addr 172.21.15.63:0/1336026893 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d2ffd640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d415d5d0 0x7f29d41f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.951+0000 7f29d3fff640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d4142de0 0x7f29d40ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29d37fe640 1 -- 172.21.15.63:0/1336026893 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d4142de0 msgr2=0x7f29d40ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29d37fe640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d4142de0 0x7f29d40ca3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29d37fe640 1 -- 172.21.15.63:0/1336026893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d415d5d0 msgr2=0x7f29d41f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29d37fe640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d415d5d0 0x7f29d41f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29d37fe640 1 -- 172.21.15.63:0/1336026893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29c4009400 con 0x7f29d40d1de0 2023-12-04T10:43:36.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29d37fe640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40d1de0 0x7f29d41f7040 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29c400ebe0 tx=0x7f29c400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29bbfff640 1 -- 172.21.15.63:0/1336026893 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c4009760 con 0x7f29d40d1de0 2023-12-04T10:43:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29bbfff640 1 -- 172.21.15.63:0/1336026893 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29c400cc30 con 0x7f29d40d1de0 2023-12-04T10:43:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29c8009400 con 0x7f29d40d1de0 2023-12-04T10:43:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.952+0000 7f29bbfff640 1 -- 172.21.15.63:0/1336026893 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29c400eee0 con 0x7f29d40d1de0 2023-12-04T10:43:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.953+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29d4143b80 con 0x7f29d40d1de0 2023-12-04T10:43:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.953+0000 7f29bbfff640 1 -- 172.21.15.63:0/1336026893 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f29c4005c90 con 0x7f29d40d1de0 2023-12-04T10:43:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.953+0000 7f29bbfff640 1 -- 172.21.15.63:0/1336026893 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f29c4013b40 con 0x7f29d40d1de0 2023-12-04T10:43:36.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.954+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29d4143d70 con 0x7f29d40d1de0 2023-12-04T10:43:36.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:36.957+0000 7f29bbfff640 1 -- 172.21.15.63:0/1336026893 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f29d4143d70 con 0x7f29d40d1de0 2023-12-04T10:43:37.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.022+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29d40cd670 con 0x7f29d40d1de0 2023-12-04T10:43:37.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.023+0000 7f29bbfff640 1 -- 172.21.15.63:0/1336026893 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f29c4021060 con 0x7f29d40d1de0 2023-12-04T10:43:37.024 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:43:37.024 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":10,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:36.629767+0000","last_up_change":"0.000000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:43:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40d1de0 msgr2=0x7f29d41f7040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40d1de0 0x7f29d41f7040 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f29c400ebe0 tx=0x7f29c400c520 comp rx=0 tx=0).stop 2023-12-04T10:43:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 shutdown_connections 2023-12-04T10:43:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29d4142de0 0x7f29d40ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f29d415d5d0 0x7f29d41f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:37.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 --2- 172.21.15.63:0/1336026893 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29d40d1de0 0x7f29d41f7040 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 >> 172.21.15.63:0/1336026893 conn(0x7f29d409c600 msgr2=0x7f29d40b0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 shutdown_connections 2023-12-04T10:43:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:37.024+0000 7f29d9c48640 1 -- 172.21.15.63:0/1336026893 wait complete. 2023-12-04T10:43:37.041 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-04T10:43:37.041 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-04T10:43:37.388 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T10:43:37.386+0000 7fdcbbca7500 -1 Falling back to public interface 2023-12-04T10:43:37.388 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T10:43:37.387+0000 7fdfd1613500 -1 Falling back to public interface 2023-12-04T10:43:37.392 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T10:43:37.390+0000 7fa505211500 -1 Falling back to public interface 2023-12-04T10:43:37.392 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T10:43:37.391+0000 7f6a6c40c500 -1 Falling back to public interface 2023-12-04T10:43:37.409 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T10:43:37.408+0000 7f6ff7ad6500 -1 Falling back to public interface 2023-12-04T10:43:37.412 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T10:43:37.412+0000 7faa982be500 -1 Falling back to public interface 2023-12-04T10:43:37.432 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T10:43:37.431+0000 7f113dbfb500 -1 Falling back to public interface 2023-12-04T10:43:37.434 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T10:43:37.433+0000 7feca559f500 -1 Falling back to public interface 2023-12-04T10:43:37.436 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T10:43:37.435+0000 7feca4548640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6818/0: (98) Address already in use 2023-12-04T10:43:37.437 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:37.437+0000 7f227202c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-04T10:43:37.716 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:37.714+0000 7fbed8c48040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-04T10:43:37.759 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:37.758+0000 7f227202c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-04T10:43:37.821 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:37.820+0000 7f227202c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-04T10:43:37.847 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-04T10:43:37.941 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:37.940+0000 7f227202c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-04T10:43:38.015 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.014+0000 7f10c00ca640 1 Processor -- start 2023-12-04T10:43:38.015 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.014+0000 7f10c00ca640 1 -- start start 2023-12-04T10:43:38.017 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.015+0000 7f10c00ca640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f10b814b0d0 0x7f10b8070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:38.017 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.015+0000 7f10c00ca640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b806d420 0x7f10b806d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:38.017 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.015+0000 7f10c00ca640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b80b3d80 con 0x7f10b8072020 2023-12-04T10:43:38.018 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.015+0000 7f10c00ca640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b806de10 con 0x7f10b814b0d0 2023-12-04T10:43:38.018 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.015+0000 7f10c00ca640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8071160 con 0x7f10b806d420 2023-12-04T10:43:38.018 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10bde66640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f10b814b0d0 0x7f10b8070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:38.018 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10bde66640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f10b814b0d0 0x7f10b8070250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58748/0 (socket says 172.21.15.63:58748) 2023-12-04T10:43:38.018 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10bde66640 1 -- 172.21.15.63:0/4173432060 learned_addr learned my addr 172.21.15.63:0/4173432060 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:38.018 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10be667640 1 --2- 172.21.15.63:0/4173432060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b806d420 0x7f10b806d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:38.019 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10bde66640 1 -- 172.21.15.63:0/4173432060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b806d420 msgr2=0x7f10b806d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:38.019 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10bde66640 1 --2- 172.21.15.63:0/4173432060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b806d420 0x7f10b806d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:38.019 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10bde66640 1 -- 172.21.15.63:0/4173432060 >> v1:172.21.15.66:6789/0 conn(0x7f10b8072020 legacy=0x7f10b80b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:38.019 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10bde66640 1 -- 172.21.15.63:0/4173432060 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b8070ba0 con 0x7f10b814b0d0 2023-12-04T10:43:38.019 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.016+0000 7f10be667640 1 --2- 172.21.15.63:0/4173432060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b806d420 0x7f10b806d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:38.020 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.017+0000 7f10bde66640 1 --2- 172.21.15.63:0/4173432060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b814b0d0 0x7f10b8070250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009870 tx=0x7f10b402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b07667a79949be0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:38.020 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.017+0000 7f10bce64640 1 -- 172.21.15.63:0/4173432060 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4030840 con 0x7f10b814b0d0 2023-12-04T10:43:38.020 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10bce64640 1 -- 172.21.15.63:0/4173432060 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b40309a0 con 0x7f10b814b0d0 2023-12-04T10:43:38.020 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10bce64640 1 -- 172.21.15.63:0/4173432060 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4030d30 con 0x7f10b814b0d0 2023-12-04T10:43:38.020 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10c00ca640 1 -- 172.21.15.63:0/4173432060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b814b0d0 msgr2=0x7f10b8070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:38.020 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10c00ca640 1 --2- 172.21.15.63:0/4173432060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b814b0d0 0x7f10b8070250 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f10b4009870 tx=0x7f10b402b980 comp rx=0 tx=0).stop 2023-12-04T10:43:38.021 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10c00ca640 1 -- 172.21.15.63:0/4173432060 shutdown_connections 2023-12-04T10:43:38.021 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10c00ca640 1 --2- 172.21.15.63:0/4173432060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b806d420 0x7f10b806d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:38.021 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10c00ca640 1 --2- 172.21.15.63:0/4173432060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b814b0d0 0x7f10b8070250 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:38.021 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10c00ca640 1 -- 172.21.15.63:0/4173432060 >> 172.21.15.63:0/4173432060 conn(0x7f10b80b0b30 msgr2=0x7f10b80b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:38.021 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10c00ca640 1 -- 172.21.15.63:0/4173432060 shutdown_connections 2023-12-04T10:43:38.021 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.018+0000 7f10c00ca640 1 -- 172.21.15.63:0/4173432060 wait complete. 2023-12-04T10:43:38.022 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.020+0000 7f10c00ca640 1 Processor -- start 2023-12-04T10:43:38.022 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.020+0000 7f10c00ca640 1 -- start start 2023-12-04T10:43:38.022 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10c00ca640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10b806d420 0x7f10b8140d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:38.022 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10c00ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b8072020 0x7f10b81f73a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:38.022 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10c00ca640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b814b0d0 0x7f10b815a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:38.022 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10c00ca640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b81f78e0 con 0x7f10b8072020 2023-12-04T10:43:38.022 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10c00ca640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b8149f40 con 0x7f10b806d420 2023-12-04T10:43:38.022 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10c00ca640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b81f7af0 con 0x7f10b814b0d0 2023-12-04T10:43:38.023 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10bde66640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10b806d420 0x7f10b8140d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:38.023 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10bde66640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10b806d420 0x7f10b8140d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:56552/0 (socket says 172.21.15.63:56552) 2023-12-04T10:43:38.023 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10bde66640 1 -- 172.21.15.63:0/3960326218 learned_addr learned my addr 172.21.15.63:0/3960326218 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:38.023 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10bd665640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b8072020 0x7f10b81f73a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:38.023 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.021+0000 7f10be667640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b814b0d0 0x7f10b815a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10bde66640 1 -- 172.21.15.63:0/3960326218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b814b0d0 msgr2=0x7f10b815a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10bde66640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b814b0d0 0x7f10b815a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10bde66640 1 -- 172.21.15.63:0/3960326218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b8072020 msgr2=0x7f10b81f73a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10bde66640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b8072020 0x7f10b81f73a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10bde66640 1 -- 172.21.15.63:0/3960326218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b40094d0 con 0x7f10b806d420 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10bde66640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10b806d420 0x7f10b8140d80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000c00 tx=0x7f10b4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10ae7fc640 1 -- 172.21.15.63:0/3960326218 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4030810 con 0x7f10b806d420 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10ae7fc640 1 -- 172.21.15.63:0/3960326218 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b4039d90 con 0x7f10b806d420 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10ae7fc640 1 -- 172.21.15.63:0/3960326218 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b4043670 con 0x7f10b806d420 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b81f7dd0 con 0x7f10b806d420 2023-12-04T10:43:38.024 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.022+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b81f8390 con 0x7f10b806d420 2023-12-04T10:43:38.025 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.023+0000 7f10ae7fc640 1 -- 172.21.15.63:0/3960326218 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 2) v1 ==== 44567+0+0 (secure 0 0 0) 0x7f10b402f390 con 0x7f10b806d420 2023-12-04T10:43:38.025 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.023+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10b80686a0 con 0x7f10b806d420 2023-12-04T10:43:38.025 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.024+0000 7f10ae7fc640 1 -- 172.21.15.63:0/3960326218 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f10b406b8c0 con 0x7f10b806d420 2023-12-04T10:43:38.028 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.027+0000 7f10ae7fc640 1 -- 172.21.15.63:0/3960326218 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f10b404a310 con 0x7f10b806d420 2023-12-04T10:43:38.065 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:38.063+0000 7fbed8c48040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-04T10:43:38.092 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.091+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10b8158610 con 0x7f10b806d420 2023-12-04T10:43:38.094 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.093+0000 7f10ae7fc640 1 -- 172.21.15.63:0/3960326218 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f10b4048020 con 0x7f10b806d420 2023-12-04T10:43:38.094 INFO:teuthology.misc.health.smithi063.stdout: 2023-12-04T10:43:38.094 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":10,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:36.629767+0000","last_up_change":"0.000000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:43:38.095 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10b806d420 msgr2=0x7f10b8140d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:38.095 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10b806d420 0x7f10b8140d80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f10b4000c00 tx=0x7f10b4004730 comp rx=0 tx=0).stop 2023-12-04T10:43:38.096 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 shutdown_connections 2023-12-04T10:43:38.096 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10b814b0d0 0x7f10b815a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:38.096 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10b8072020 0x7f10b81f73a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:38.096 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 --2- 172.21.15.63:0/3960326218 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f10b806d420 0x7f10b8140d80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:38.096 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 >> 172.21.15.63:0/3960326218 conn(0x7f10b80b0b30 msgr2=0x7f10b80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:38.096 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 shutdown_connections 2023-12-04T10:43:38.096 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:38.094+0000 7f10c00ca640 1 -- 172.21.15.63:0/3960326218 wait complete. 2023-12-04T10:43:38.108 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-04T10:43:38.127 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:38.126+0000 7fbed8c48040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-04T10:43:38.247 INFO:tasks.ceph.mgr.x.smithi066.stderr:2023-12-04T10:43:38.246+0000 7fbed8c48040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-04T10:43:39.014 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:39.013+0000 7f2212b82640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-04T10:43:39.016 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T10:43:39.015+0000 7f2212b82640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-04T10:43:40.469 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T10:43:40.468+0000 7faa982be500 -1 osd.1 0 log_to_monitors true 2023-12-04T10:43:40.978 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T10:43:40.977+0000 7f113dbfb500 -1 osd.4 0 log_to_monitors true 2023-12-04T10:43:40.995 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T10:43:40.994+0000 7f6ff7ad6500 -1 osd.2 0 log_to_monitors true 2023-12-04T10:43:41.001 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T10:43:41.000+0000 7feca559f500 -1 osd.6 0 log_to_monitors true 2023-12-04T10:43:41.191 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T10:43:41.190+0000 7fa505211500 -1 osd.0 0 log_to_monitors true 2023-12-04T10:43:41.193 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T10:43:41.192+0000 7f6a6c40c500 -1 osd.3 0 log_to_monitors true 2023-12-04T10:43:41.195 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T10:43:41.194+0000 7fdcbbca7500 -1 osd.7 0 log_to_monitors true 2023-12-04T10:43:41.227 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T10:43:41.226+0000 7fdfd1613500 -1 osd.5 0 log_to_monitors true 2023-12-04T10:43:43.259 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T10:43:43.258+0000 7f1139b89640 -1 osd.4 0 waiting for initial osdmap 2023-12-04T10:43:43.308 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T10:43:43.307+0000 7f11319af640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T10:43:43.791 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T10:43:43.791+0000 7f6ff3a64640 -1 osd.2 0 waiting for initial osdmap 2023-12-04T10:43:43.817 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T10:43:43.816+0000 7f6feb88a640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T10:43:43.838 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T10:43:43.837+0000 7faa9424c640 -1 osd.1 0 waiting for initial osdmap 2023-12-04T10:43:43.883 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T10:43:43.882+0000 7faa8c072640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T10:43:44.516 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:43:44.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:43:44.601 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T10:43:44.600+0000 7fa501483640 -1 osd.0 0 waiting for initial osdmap 2023-12-04T10:43:44.606 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T10:43:44.606+0000 7f6a67ddc640 -1 osd.3 0 waiting for initial osdmap 2023-12-04T10:43:44.617 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T10:43:44.616+0000 7f6a5fc02640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T10:43:44.618 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T10:43:44.617+0000 7fa4f8a95640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T10:43:44.914 DEBUG:teuthology.orchestra.run.smithi063:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-04T10:43:44.938 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T10:43:44.937+0000 7fdfcd6e2640 -1 osd.5 0 waiting for initial osdmap 2023-12-04T10:43:44.949 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T10:43:44.948+0000 7fdfc4cf4640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T10:43:44.994 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T10:43:44.993+0000 7feca1d43640 -1 osd.6 0 waiting for initial osdmap 2023-12-04T10:43:45.003 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T10:43:45.002+0000 7fec99355640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T10:43:45.032 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T10:43:45.031+0000 7fdcb7c35640 -1 osd.7 0 waiting for initial osdmap 2023-12-04T10:43:45.037 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T10:43:45.036+0000 7fdcafa5b640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-04T10:43:45.118 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.117+0000 7f9845fe6640 1 Processor -- start 2023-12-04T10:43:45.118 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.117+0000 7f9845fe6640 1 -- start start 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.118+0000 7f9845fe6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f984015b000 0x7f984015c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.118+0000 7f9845fe6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9840072240 0x7f9840070fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.118+0000 7f9845fe6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f984006c100 0x7f984006c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.118+0000 7f9845fe6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98400ac560 con 0x7f984006c100 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.118+0000 7f9845fe6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98400abd50 con 0x7f9840072240 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.118+0000 7f9845fe6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984015c560 con 0x7f984015b000 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f98457e5640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f984006c100 0x7f984006c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f9844fe4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f984015b000 0x7f984015c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f98457e5640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f984006c100 0x7f984006c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57884/0 (socket says 172.21.15.63:57884) 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f98457e5640 1 -- 172.21.15.63:0/2827793557 learned_addr learned my addr 172.21.15.63:0/2827793557 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:45.120 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f983ffff640 1 --2- 172.21.15.63:0/2827793557 >> v2:172.21.15.66:3300/0 conn(0x7f9840072240 0x7f9840070fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.121 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f98457e5640 1 -- 172.21.15.63:0/2827793557 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f984015b000 msgr2=0x7f984015c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:45.121 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f98457e5640 1 --2- 172.21.15.63:0/2827793557 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f984015b000 0x7f984015c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.121 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f98457e5640 1 -- 172.21.15.63:0/2827793557 >> v2:172.21.15.66:3300/0 conn(0x7f9840072240 msgr2=0x7f9840070fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:45.121 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f98457e5640 1 --2- 172.21.15.63:0/2827793557 >> v2:172.21.15.66:3300/0 conn(0x7f9840072240 0x7f9840070fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.121 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f98457e5640 1 -- 172.21.15.63:0/2827793557 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984015b3e0 con 0x7f984006c100 2023-12-04T10:43:45.121 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.119+0000 7f983ffff640 1 --2- 172.21.15.63:0/2827793557 >> v2:172.21.15.66:3300/0 conn(0x7f9840072240 0x7f9840070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:45.121 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.121+0000 7f98457e5640 1 --2- 172.21.15.63:0/2827793557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984006c100 0x7f984006c540 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f984006b360 tx=0x7f983802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1533f4b5b7734c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:45.122 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.121+0000 7f983f7fe640 1 -- 172.21.15.63:0/2827793557 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983802c9e0 con 0x7f984006c100 2023-12-04T10:43:45.122 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.121+0000 7f983f7fe640 1 -- 172.21.15.63:0/2827793557 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983802cb40 con 0x7f984006c100 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.121+0000 7f983f7fe640 1 -- 172.21.15.63:0/2827793557 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98380343f0 con 0x7f984006c100 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.121+0000 7f9845fe6640 1 -- 172.21.15.63:0/2827793557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984006c100 msgr2=0x7f984006c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.121+0000 7f9845fe6640 1 --2- 172.21.15.63:0/2827793557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984006c100 0x7f984006c540 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f984006b360 tx=0x7f983802be40 comp rx=0 tx=0).stop 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.121+0000 7f9845fe6640 1 -- 172.21.15.63:0/2827793557 shutdown_connections 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.122+0000 7f9845fe6640 1 --2- 172.21.15.63:0/2827793557 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984006c100 0x7f984006c540 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.122+0000 7f9845fe6640 1 --2- 172.21.15.63:0/2827793557 >> v2:172.21.15.66:3300/0 conn(0x7f9840072240 0x7f9840070fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.122+0000 7f9845fe6640 1 --2- 172.21.15.63:0/2827793557 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f984015b000 0x7f984015c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.122+0000 7f9845fe6640 1 -- 172.21.15.63:0/2827793557 >> 172.21.15.63:0/2827793557 conn(0x7f98400b0a00 msgr2=0x7f98400b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.122+0000 7f9845fe6640 1 -- 172.21.15.63:0/2827793557 shutdown_connections 2023-12-04T10:43:45.123 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.122+0000 7f9845fe6640 1 -- 172.21.15.63:0/2827793557 wait complete. 2023-12-04T10:43:45.124 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.123+0000 7f9845fe6640 1 Processor -- start 2023-12-04T10:43:45.125 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.123+0000 7f9845fe6640 1 -- start start 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.124+0000 7f9845fe6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f984006c100 0x7f984009c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.124+0000 7f9845fe6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9840072240 0x7f984009a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.124+0000 7f9845fe6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984015b000 0x7f9840152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.124+0000 7f9845fe6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984014d4b0 con 0x7f984015b000 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.124+0000 7f9845fe6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984009cee0 con 0x7f984006c100 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.124+0000 7f9845fe6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984014d690 con 0x7f9840072240 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984015b000 0x7f9840152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984015b000 0x7f9840152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57892/0 (socket says 172.21.15.63:57892) 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 -- 172.21.15.63:0/3063096625 learned_addr learned my addr 172.21.15.63:0/3063096625 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f9844fe4640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f984006c100 0x7f984009c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f983ffff640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9840072240 0x7f984009a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 -- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9840072240 msgr2=0x7f984009a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.127 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9840072240 0x7f984009a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 -- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f984006c100 msgr2=0x7f984009c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f984006c100 0x7f984009c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 -- 172.21.15.63:0/3063096625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9838009b30 con 0x7f984015b000 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f983ffff640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9840072240 0x7f984009a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f9844fe4640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f984006c100 0x7f984009c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.125+0000 7f98457e5640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984015b000 0x7f9840152ba0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9838036040 tx=0x7f9838004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.126+0000 7f983d7fa640 1 -- 172.21.15.63:0/3063096625 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9838009510 con 0x7f984015b000 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.126+0000 7f983d7fa640 1 -- 172.21.15.63:0/3063096625 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f983803e450 con 0x7f984015b000 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.126+0000 7f983d7fa640 1 -- 172.21.15.63:0/3063096625 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f983803e800 con 0x7f984015b000 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.126+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984014d970 con 0x7f984015b000 2023-12-04T10:43:45.128 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.126+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984014df30 con 0x7f984015b000 2023-12-04T10:43:45.129 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.127+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9840067900 con 0x7f984015b000 2023-12-04T10:43:45.129 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.128+0000 7f983d7fa640 1 -- 172.21.15.63:0/3063096625 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f983803e960 con 0x7f984015b000 2023-12-04T10:43:45.129 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.129+0000 7f983d7fa640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f982406adb0 0x7f982406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.129 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.129+0000 7f983d7fa640 1 -- 172.21.15.63:0/3063096625 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3071+0+0 (secure 0 0 0) 0x7f98380ab8b0 con 0x7f984015b000 2023-12-04T10:43:45.130 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.129+0000 7f9844fe4640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f982406adb0 0x7f982406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.130 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.130+0000 7f9844fe4640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f982406adb0 0x7f982406d270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9834009ac0 tx=0x7f9834008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:45.134 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.134+0000 7f983d7fa640 1 -- 172.21.15.63:0/3063096625 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f98380773f0 con 0x7f984015b000 2023-12-04T10:43:45.332 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.331+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f984004e8b0 con 0x7f984015b000 2023-12-04T10:43:45.333 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.332+0000 7f983d7fa640 1 -- 172.21.15.63:0/3063096625 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10905 (secure 0 0 0) 0x7f983807aa10 con 0x7f984015b000 2023-12-04T10:43:45.333 INFO:teuthology.misc.health.smithi063.stdout: 2023-12-04T10:43:45.334 INFO:teuthology.misc.health.smithi063.stdout:{"epoch":15,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:45.304569+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.335+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f982406adb0 msgr2=0x7f982406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.335+0000 7f9845fe6640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f982406adb0 0x7f982406d270 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9834009ac0 tx=0x7f9834008040 comp rx=0 tx=0).stop 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.335+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984015b000 msgr2=0x7f9840152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.335+0000 7f9845fe6640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984015b000 0x7f9840152ba0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9838036040 tx=0x7f9838004a40 comp rx=0 tx=0).stop 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.336+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 shutdown_connections 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.336+0000 7f9845fe6640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f982406adb0 0x7f982406d270 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.336+0000 7f9845fe6640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9840072240 0x7f984009a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.336+0000 7f9845fe6640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f984015b000 0x7f9840152ba0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.336+0000 7f9845fe6640 1 --2- 172.21.15.63:0/3063096625 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f984006c100 0x7f984009c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.336+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 >> 172.21.15.63:0/3063096625 conn(0x7f98400b0a00 msgr2=0x7f98400ad9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.336+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 shutdown_connections 2023-12-04T10:43:45.337 INFO:teuthology.misc.health.smithi063.stderr:2023-12-04T10:43:45.336+0000 7f9845fe6640 1 -- 172.21.15.63:0/3063096625 wait complete. 2023-12-04T10:43:45.350 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-04T10:43:45.350 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-04T10:43:45.350 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-04T10:43:45.351 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-04T10:43:45.356 INFO:tasks.ceph.mds.a:Started 2023-12-04T10:43:45.356 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-04T10:43:45.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-04T10:43:45.361 INFO:tasks.ceph.mds.c:Started 2023-12-04T10:43:45.361 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-04T10:43:45.361 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-04T10:43:45.370 INFO:tasks.ceph.mds.b:Started 2023-12-04T10:43:45.370 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-04T10:43:45.370 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-04T10:43:45.378 INFO:tasks.ceph.mds.d:Started 2023-12-04T10:43:45.379 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-04T10:43:45.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:43:45.509 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2023-12-04T10:43:45.510 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2023-12-04T10:43:45.512 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T10:43:45.511+0000 7fc270233640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-12-04T10:43:45.540 INFO:tasks.ceph.mds.d.smithi066.stdout:starting mds.d at 2023-12-04T10:43:45.540 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2023-12-04T10:43:45.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.567+0000 7f25bc5c9640 1 Processor -- start 2023-12-04T10:43:45.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.567+0000 7f25bc5c9640 1 -- start start 2023-12-04T10:43:45.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25bc5c9640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25b4144a00 0x7f25b40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25bc5c9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f25b40ca290 0x7f25b40ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25bc5c9640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b40b2370 con 0x7f25b40701b0 2023-12-04T10:43:45.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25bc5c9640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40cabe0 con 0x7f25b4144a00 2023-12-04T10:43:45.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25bc5c9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b40cae80 con 0x7f25b40ca290 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25ba365640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f25b4144a00 0x7f25b40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25bab66640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f25b40ca290 0x7f25b40ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25b9b64640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f25b40701b0 0x7f25b40705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54610/0 (socket says 172.21.15.63:54610) 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.568+0000 7f25b9b64640 1 -- 172.21.15.63:0/2727100268 learned_addr learned my addr 172.21.15.63:0/2727100268 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.569+0000 7f25b9363640 1 -- 172.21.15.63:0/2727100268 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3619190385 0 0) 0x7f25b40b2370 con 0x7f25b40701b0 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.569+0000 7f25ba365640 1 -- 172.21.15.63:0/2727100268 >> v2:172.21.15.66:3300/0 conn(0x7f25b40ca290 msgr2=0x7f25b40ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.569+0000 7f25ba365640 1 --2- 172.21.15.63:0/2727100268 >> v2:172.21.15.66:3300/0 conn(0x7f25b40ca290 0x7f25b40ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.569+0000 7f25ba365640 1 -- 172.21.15.63:0/2727100268 >> v1:172.21.15.63:6789/0 conn(0x7f25b40701b0 legacy=0x7f25b40705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.569+0000 7f25ba365640 1 -- 172.21.15.63:0/2727100268 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b406c460 con 0x7f25b4144a00 2023-12-04T10:43:45.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.570+0000 7f25ba365640 1 --2- 172.21.15.63:0/2727100268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b4144a00 0x7f25b40b1e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25b4071990 tx=0x7f25b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d016f5ace65df0f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:45.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.570+0000 7f25b9363640 1 -- 172.21.15.63:0/2727100268 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0031830 con 0x7f25b4144a00 2023-12-04T10:43:45.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.570+0000 7f25b9363640 1 -- 172.21.15.63:0/2727100268 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b0031990 con 0x7f25b4144a00 2023-12-04T10:43:45.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.570+0000 7f25b9363640 1 -- 172.21.15.63:0/2727100268 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b0031d20 con 0x7f25b4144a00 2023-12-04T10:43:45.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.571+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2727100268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b4144a00 msgr2=0x7f25b40b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.571+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2727100268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b4144a00 0x7f25b40b1e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f25b4071990 tx=0x7f25b002b8d0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.571+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2727100268 shutdown_connections 2023-12-04T10:43:45.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.571+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2727100268 >> v2:172.21.15.66:3300/0 conn(0x7f25b40ca290 0x7f25b40ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.571+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2727100268 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b4144a00 0x7f25b40b1e30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.571+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2727100268 >> 172.21.15.63:0/2727100268 conn(0x7f25b40cee80 msgr2=0x7f25b40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:45.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.571+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2727100268 shutdown_connections 2023-12-04T10:43:45.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.571+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2727100268 wait complete. 2023-12-04T10:43:45.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.573+0000 7f25bc5c9640 1 Processor -- start 2023-12-04T10:43:45.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.573+0000 7f25bc5c9640 1 -- start start 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25bc5c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25b40701b0 0x7f25b415acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25bc5c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b40ca290 0x7f25b40ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25bc5c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25b4144a00 0x7f25b40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25bc5c9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b415b1f0 con 0x7f25b40ca290 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25bc5c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40a8620 con 0x7f25b40701b0 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25bc5c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40a88c0 con 0x7f25b4144a00 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25b9b64640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b40ca290 0x7f25b40ccbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25ba365640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25b40701b0 0x7f25b415acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25b9b64640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b40ca290 0x7f25b40ccbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57944/0 (socket says 172.21.15.63:57944) 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25b9b64640 1 -- 172.21.15.63:0/2992487316 learned_addr learned my addr 172.21.15.63:0/2992487316 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.574+0000 7f25bab66640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25b4144a00 0x7f25b40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25b9b64640 1 -- 172.21.15.63:0/2992487316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25b4144a00 msgr2=0x7f25b40c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25b9b64640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25b4144a00 0x7f25b40c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25b9b64640 1 -- 172.21.15.63:0/2992487316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25b40701b0 msgr2=0x7f25b415acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25b9b64640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25b40701b0 0x7f25b415acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25b9b64640 1 -- 172.21.15.63:0/2992487316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b0009400 con 0x7f25b40ca290 2023-12-04T10:43:45.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25ba365640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25b40701b0 0x7f25b415acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:43:45.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25b9b64640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b40ca290 0x7f25b40ccbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c4d0 tx=0x7f25a400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:45.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25aaffd640 1 -- 172.21.15.63:0/2992487316 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a40074e0 con 0x7f25b40ca290 2023-12-04T10:43:45.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25aaffd640 1 -- 172.21.15.63:0/2992487316 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a4007660 con 0x7f25b40ca290 2023-12-04T10:43:45.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25aaffd640 1 -- 172.21.15.63:0/2992487316 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a4004a20 con 0x7f25b40ca290 2023-12-04T10:43:45.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.575+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b40a8ba0 con 0x7f25b40ca290 2023-12-04T10:43:45.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.576+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b40a9160 con 0x7f25b40ca290 2023-12-04T10:43:45.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.577+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b40a9350 con 0x7f25b40ca290 2023-12-04T10:43:45.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.578+0000 7f25aaffd640 1 -- 172.21.15.63:0/2992487316 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f25a4004b80 con 0x7f25b40ca290 2023-12-04T10:43:45.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.578+0000 7f25aaffd640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f259806adb0 0x7f259806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:45.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.579+0000 7f25aaffd640 1 -- 172.21.15.63:0/2992487316 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f25a4088180 con 0x7f25b40ca290 2023-12-04T10:43:45.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.579+0000 7f25ba365640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f259806adb0 0x7f259806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:45.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.580+0000 7f25ba365640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f259806adb0 0x7f259806d270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f25b0036000 tx=0x7f25b003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:45.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.584+0000 7f25aaffd640 1 -- 172.21.15.63:0/2992487316 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f25a4053880 con 0x7f25b40ca290 2023-12-04T10:43:45.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.781+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25b4068710 con 0x7f25b40ca290 2023-12-04T10:43:45.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.783+0000 7f25aaffd640 1 -- 172.21.15.63:0/2992487316 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+10905 (secure 0 0 0) 0x7f25a4018090 con 0x7f25b40ca290 2023-12-04T10:43:45.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:43:45.784 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":15,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:45.304569+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:43:45.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.785+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f259806adb0 msgr2=0x7f259806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.785+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f259806adb0 0x7f259806d270 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f25b0036000 tx=0x7f25b003c040 comp rx=0 tx=0).stop 2023-12-04T10:43:45.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.785+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b40ca290 msgr2=0x7f25b40ccbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:45.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.785+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b40ca290 0x7f25b40ccbe0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25a400c4d0 tx=0x7f25a400c990 comp rx=0 tx=0).stop 2023-12-04T10:43:45.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.786+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 shutdown_connections 2023-12-04T10:43:45.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.786+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f259806adb0 0x7f259806d270 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.786+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f25b4144a00 0x7f25b40c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.786+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f25b40ca290 0x7f25b40ccbe0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.786+0000 7f25bc5c9640 1 --2- 172.21.15.63:0/2992487316 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f25b40701b0 0x7f25b415acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:45.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.786+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 >> 172.21.15.63:0/2992487316 conn(0x7f25b40cee80 msgr2=0x7f25b415b860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:45.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.786+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 shutdown_connections 2023-12-04T10:43:45.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:45.786+0000 7f25bc5c9640 1 -- 172.21.15.63:0/2992487316 wait complete. 2023-12-04T10:43:45.805 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-12-04T10:43:45.805 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:43:46.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.029+0000 7f4f36b27640 1 Processor -- start 2023-12-04T10:43:46.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.029+0000 7f4f36b27640 1 -- start start 2023-12-04T10:43:46.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f36b27640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4f3015a000 0x7f4f300ae900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f36b27640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4f300ca440 0x7f4f300ca890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f36b27640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f300ce1b0 con 0x7f4f300cf680 2023-12-04T10:43:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f36b27640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3015a3e0 con 0x7f4f3015a000 2023-12-04T10:43:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f36b27640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f300cfae0 con 0x7f4f300ca440 2023-12-04T10:43:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f35b25640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4f3015a000 0x7f4f300ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f36326640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4f300ca440 0x7f4f300ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:46.032 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f36326640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4f300ca440 0x7f4f300ca890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:52680/0 (socket says 172.21.15.63:52680) 2023-12-04T10:43:46.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.031+0000 7f4f36326640 1 -- 172.21.15.63:0/2960279203 learned_addr learned my addr 172.21.15.63:0/2960279203 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:46.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.032+0000 7f4f36326640 1 -- 172.21.15.63:0/2960279203 >> v2:172.21.15.63:3300/0 conn(0x7f4f3015a000 msgr2=0x7f4f300ae900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:46.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.032+0000 7f4f36326640 1 --2- 172.21.15.63:0/2960279203 >> v2:172.21.15.63:3300/0 conn(0x7f4f3015a000 0x7f4f300ae900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.032+0000 7f4f36326640 1 -- 172.21.15.63:0/2960279203 >> v1:172.21.15.63:6789/0 conn(0x7f4f300cf680 legacy=0x7f4f300ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:46.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.032+0000 7f4f36326640 1 -- 172.21.15.63:0/2960279203 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300aefe0 con 0x7f4f300ca440 2023-12-04T10:43:46.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.034+0000 7f4f36326640 1 --2- 172.21.15.63:0/2960279203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 0x7f4f300ca890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f300b5f40 tx=0x7f4f2802bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44b601c6ff86a59a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.034+0000 7f4f34b23640 1 -- 172.21.15.63:0/2960279203 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2802cb20 con 0x7f4f300ca440 2023-12-04T10:43:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.034+0000 7f4f34b23640 1 -- 172.21.15.63:0/2960279203 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2802cc80 con 0x7f4f300ca440 2023-12-04T10:43:46.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.034+0000 7f4f34b23640 1 -- 172.21.15.63:0/2960279203 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280343f0 con 0x7f4f300ca440 2023-12-04T10:43:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.035+0000 7f4f36b27640 1 -- 172.21.15.63:0/2960279203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 msgr2=0x7f4f300ca890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.035+0000 7f4f36b27640 1 --2- 172.21.15.63:0/2960279203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 0x7f4f300ca890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f4f300b5f40 tx=0x7f4f2802bf80 comp rx=0 tx=0).stop 2023-12-04T10:43:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.035+0000 7f4f36b27640 1 -- 172.21.15.63:0/2960279203 shutdown_connections 2023-12-04T10:43:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.035+0000 7f4f36b27640 1 --2- 172.21.15.63:0/2960279203 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 0x7f4f300ca890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.035+0000 7f4f36b27640 1 --2- 172.21.15.63:0/2960279203 >> v2:172.21.15.63:3300/0 conn(0x7f4f3015a000 0x7f4f300ae900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.035+0000 7f4f36b27640 1 -- 172.21.15.63:0/2960279203 >> 172.21.15.63:0/2960279203 conn(0x7f4f3006b560 msgr2=0x7f4f3006b970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:46.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.035+0000 7f4f36b27640 1 -- 172.21.15.63:0/2960279203 shutdown_connections 2023-12-04T10:43:46.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.035+0000 7f4f36b27640 1 -- 172.21.15.63:0/2960279203 wait complete. 2023-12-04T10:43:46.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.037+0000 7f4f36b27640 1 Processor -- start 2023-12-04T10:43:46.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.037+0000 7f4f36b27640 1 -- start start 2023-12-04T10:43:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.038+0000 7f4f36b27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 0x7f4f30147270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.038+0000 7f4f36b27640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f300cf680 0x7f4f3006e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.038+0000 7f4f36b27640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f3015a000 0x7f4f3015a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.038+0000 7f4f36b27640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3006d360 con 0x7f4f300cf680 2023-12-04T10:43:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.038+0000 7f4f36b27640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3006d640 con 0x7f4f300ca440 2023-12-04T10:43:46.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.038+0000 7f4f36b27640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3006d920 con 0x7f4f3015a000 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f300cf680 0x7f4f3006e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f300cf680 0x7f4f3006e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57964/0 (socket says 172.21.15.63:57964) 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 -- 172.21.15.63:0/3132879143 learned_addr learned my addr 172.21.15.63:0/3132879143 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35b25640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 0x7f4f30147270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f36326640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f3015a000 0x7f4f3015a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 -- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f3015a000 msgr2=0x7f4f3015a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f3015a000 0x7f4f3015a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 -- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 msgr2=0x7f4f30147270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:46.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 0x7f4f30147270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 -- 172.21.15.63:0/3132879143 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28009b30 con 0x7f4f300cf680 2023-12-04T10:43:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35b25640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 0x7f4f30147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.039+0000 7f4f35324640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f300cf680 0x7f4f3006e400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c400 tx=0x7f4f2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.040+0000 7f4f267fc640 1 -- 172.21.15.63:0/3132879143 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200052d0 con 0x7f4f300cf680 2023-12-04T10:43:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.040+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3006dc00 con 0x7f4f300cf680 2023-12-04T10:43:46.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.040+0000 7f4f267fc640 1 -- 172.21.15.63:0/3132879143 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20005430 con 0x7f4f300cf680 2023-12-04T10:43:46.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.040+0000 7f4f267fc640 1 -- 172.21.15.63:0/3132879143 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20007240 con 0x7f4f300cf680 2023-12-04T10:43:46.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.040+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3006ced0 con 0x7f4f300cf680 2023-12-04T10:43:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.041+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3006e120 con 0x7f4f300cf680 2023-12-04T10:43:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.043+0000 7f4f267fc640 1 -- 172.21.15.63:0/3132879143 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f4f200073a0 con 0x7f4f300cf680 2023-12-04T10:43:46.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.044+0000 7f4f267fc640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4f1406adb0 0x7f4f1406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.044+0000 7f4f267fc640 1 -- 172.21.15.63:0/3132879143 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f4f200884d0 con 0x7f4f300cf680 2023-12-04T10:43:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.044+0000 7f4f35b25640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4f1406adb0 0x7f4f1406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:46.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.045+0000 7f4f35b25640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4f1406adb0 0x7f4f1406d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009af0 tx=0x7f4f2c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:46.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.049+0000 7f4f267fc640 1 -- 172.21.15.63:0/3132879143 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f3006e120 con 0x7f4f300cf680 2023-12-04T10:43:46.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.281+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4f3006e120 con 0x7f4f300cf680 2023-12-04T10:43:46.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.282+0000 7f4f267fc640 1 -- 172.21.15.63:0/3132879143 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f4f3006e120 con 0x7f4f300cf680 2023-12-04T10:43:46.283 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:43:46.284 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-04T10:43:46.284 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 2 2023-12-04T10:43:46.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.284+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4f1406adb0 msgr2=0x7f4f1406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:46.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.284+0000 7f4f36b27640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4f1406adb0 0x7f4f1406d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c009af0 tx=0x7f4f2c008040 comp rx=0 tx=0).stop 2023-12-04T10:43:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.284+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f300cf680 msgr2=0x7f4f3006e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.284+0000 7f4f36b27640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f300cf680 0x7f4f3006e400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000c400 tx=0x7f4f2000c8c0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.285+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 shutdown_connections 2023-12-04T10:43:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.285+0000 7f4f36b27640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4f1406adb0 0x7f4f1406d270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.285+0000 7f4f36b27640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4f3015a000 0x7f4f3015a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.285+0000 7f4f36b27640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4f300cf680 0x7f4f3006e400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.285+0000 7f4f36b27640 1 --2- 172.21.15.63:0/3132879143 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4f300ca440 0x7f4f30147270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.285+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 >> 172.21.15.63:0/3132879143 conn(0x7f4f3006b560 msgr2=0x7f4f300b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.285+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 shutdown_connections 2023-12-04T10:43:46.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:46.285+0000 7f4f36b27640 1 -- 172.21.15.63:0/3132879143 wait complete. 2023-12-04T10:43:48.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:43:48.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.521+0000 7f14074b4640 1 Processor -- start 2023-12-04T10:43:48.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.522+0000 7f14074b4640 1 -- start start 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.523+0000 7f14074b4640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f140015d5d0 0x7f14000d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.523+0000 7f14074b4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000ce8e0 0x7f14000d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.523+0000 7f14074b4640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14000b2710 con 0x7f14000d1de0 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.523+0000 7f14074b4640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14000d2290 con 0x7f140015d5d0 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.523+0000 7f14074b4640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14000ced70 con 0x7f14000ce8e0 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.523+0000 7f1405250640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f140015d5d0 0x7f14000d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.523+0000 7f1405250640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f140015d5d0 0x7f14000d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57990/0 (socket says 172.21.15.63:57990) 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.523+0000 7f1405250640 1 -- 172.21.15.63:0/2031444015 learned_addr learned my addr 172.21.15.63:0/2031444015 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.524+0000 7f1404a4f640 1 --2- 172.21.15.63:0/2031444015 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000ce8e0 0x7f14000d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.524+0000 7f1405250640 1 -- 172.21.15.63:0/2031444015 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000ce8e0 msgr2=0x7f14000d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.524+0000 7f1405250640 1 --2- 172.21.15.63:0/2031444015 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000ce8e0 0x7f14000d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.524+0000 7f1405250640 1 -- 172.21.15.63:0/2031444015 >> v1:172.21.15.66:6789/0 conn(0x7f14000d1de0 legacy=0x7f14000cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:48.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.524+0000 7f1405250640 1 -- 172.21.15.63:0/2031444015 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14000cf050 con 0x7f140015d5d0 2023-12-04T10:43:48.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.525+0000 7f1405250640 1 --2- 172.21.15.63:0/2031444015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f140015d5d0 0x7f14000d3a40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009870 tx=0x7f13fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6b384cc8ce602c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:48.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.525+0000 7f13f7fff640 1 -- 172.21.15.63:0/2031444015 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc031640 con 0x7f140015d5d0 2023-12-04T10:43:48.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.525+0000 7f13f7fff640 1 -- 172.21.15.63:0/2031444015 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13fc0317a0 con 0x7f140015d5d0 2023-12-04T10:43:48.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.525+0000 7f13f7fff640 1 -- 172.21.15.63:0/2031444015 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13fc031b30 con 0x7f140015d5d0 2023-12-04T10:43:48.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.526+0000 7f14074b4640 1 -- 172.21.15.63:0/2031444015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f140015d5d0 msgr2=0x7f14000d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:48.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.526+0000 7f14074b4640 1 --2- 172.21.15.63:0/2031444015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f140015d5d0 0x7f14000d3a40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f13fc009870 tx=0x7f13fc02b8f0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.526+0000 7f14074b4640 1 -- 172.21.15.63:0/2031444015 shutdown_connections 2023-12-04T10:43:48.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.526+0000 7f14074b4640 1 --2- 172.21.15.63:0/2031444015 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000ce8e0 0x7f14000d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.526+0000 7f14074b4640 1 --2- 172.21.15.63:0/2031444015 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f140015d5d0 0x7f14000d3a40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.526+0000 7f14074b4640 1 -- 172.21.15.63:0/2031444015 >> 172.21.15.63:0/2031444015 conn(0x7f140009c600 msgr2=0x7f14000d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:48.527 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.526+0000 7f14074b4640 1 -- 172.21.15.63:0/2031444015 shutdown_connections 2023-12-04T10:43:48.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.526+0000 7f14074b4640 1 -- 172.21.15.63:0/2031444015 wait complete. 2023-12-04T10:43:48.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.528+0000 7f14074b4640 1 Processor -- start 2023-12-04T10:43:48.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.528+0000 7f14074b4640 1 -- start start 2023-12-04T10:43:48.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f14074b4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14000d1de0 0x7f1400150b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f14074b4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000b0b60 0x7f14000b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f14074b4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14000b8540 0x7f14000b89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f14074b4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000cb5d0 con 0x7f14000b8540 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f14074b4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14000cafe0 con 0x7f14000d1de0 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f14074b4640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14000b1520 con 0x7f14000b0b60 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f1405a51640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14000b8540 0x7f14000b89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f1405a51640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14000b8540 0x7f14000b89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:57998/0 (socket says 172.21.15.63:57998) 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.529+0000 7f1405a51640 1 -- 172.21.15.63:0/4121437073 learned_addr learned my addr 172.21.15.63:0/4121437073 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f1405250640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14000d1de0 0x7f1400150b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f1404a4f640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000b0b60 0x7f14000b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f1405a51640 1 -- 172.21.15.63:0/4121437073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000b0b60 msgr2=0x7f14000b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f1405a51640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000b0b60 0x7f14000b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f1405a51640 1 -- 172.21.15.63:0/4121437073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14000d1de0 msgr2=0x7f1400150b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:48.532 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f1405a51640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14000d1de0 0x7f1400150b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f1405a51640 1 -- 172.21.15.63:0/4121437073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13fc0094d0 con 0x7f14000b8540 2023-12-04T10:43:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f1405a51640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14000b8540 0x7f14000b89f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f13f800c7b0 tx=0x7f13f800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f13f5ffb640 1 -- 172.21.15.63:0/4121437073 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f8004b60 con 0x7f14000b8540 2023-12-04T10:43:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.530+0000 7f13f5ffb640 1 -- 172.21.15.63:0/4121437073 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f8004cc0 con 0x7f14000b8540 2023-12-04T10:43:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.531+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14000ca690 con 0x7f14000b8540 2023-12-04T10:43:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.531+0000 7f13f5ffb640 1 -- 172.21.15.63:0/4121437073 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f800aa90 con 0x7f14000b8540 2023-12-04T10:43:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.531+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14000b1a20 con 0x7f14000b8540 2023-12-04T10:43:48.533 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.532+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14000cb710 con 0x7f14000b8540 2023-12-04T10:43:48.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.533+0000 7f13f5ffb640 1 -- 172.21.15.63:0/4121437073 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f13f800abf0 con 0x7f14000b8540 2023-12-04T10:43:48.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.534+0000 7f13f5ffb640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f13e406ae00 0x7f13e406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:48.534 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.534+0000 7f13f5ffb640 1 -- 172.21.15.63:0/4121437073 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f13f80895a0 con 0x7f14000b8540 2023-12-04T10:43:48.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.534+0000 7f1405250640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f13e406ae00 0x7f13e406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:48.535 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.535+0000 7f1405250640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f13e406ae00 0x7f13e406d2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13fc036000 tx=0x7f13fc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:48.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.539+0000 7f13f5ffb640 1 -- 172.21.15.63:0/4121437073 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14000cb710 con 0x7f14000b8540 2023-12-04T10:43:48.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.784+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f14000cb710 con 0x7f14000b8540 2023-12-04T10:43:48.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.785+0000 7f13f5ffb640 1 -- 172.21.15.63:0/4121437073 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3694 (secure 0 0 0) 0x7f14000cb710 con 0x7f14000b8540 2023-12-04T10:43:48.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:43:48.786 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4267,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-04T10:43:48.786 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 3 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.787+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f13e406ae00 msgr2=0x7f13e406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.787+0000 7f14074b4640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f13e406ae00 0x7f13e406d2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f13fc036000 tx=0x7f13fc03c040 comp rx=0 tx=0).stop 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.787+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14000b8540 msgr2=0x7f14000b89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.787+0000 7f14074b4640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14000b8540 0x7f14000b89f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f13f800c7b0 tx=0x7f13f800cc70 comp rx=0 tx=0).stop 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.788+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 shutdown_connections 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.788+0000 7f14074b4640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f13e406ae00 0x7f13e406d2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.788+0000 7f14074b4640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f14000b0b60 0x7f14000b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.788+0000 7f14074b4640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f14000b8540 0x7f14000b89f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.788+0000 7f14074b4640 1 --2- 172.21.15.63:0/4121437073 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f14000d1de0 0x7f1400150b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.788+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 >> 172.21.15.63:0/4121437073 conn(0x7f140009c600 msgr2=0x7f140006c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.788+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 shutdown_connections 2023-12-04T10:43:48.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:48.788+0000 7f14074b4640 1 -- 172.21.15.63:0/4121437073 wait complete. 2023-12-04T10:43:48.808 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:43:49.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.012+0000 7ff8f5c83640 1 Processor -- start 2023-12-04T10:43:49.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.012+0000 7ff8f5c83640 1 -- start start 2023-12-04T10:43:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.013+0000 7ff8f5c83640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff8f015d5d0 0x7ff8f00d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.013+0000 7ff8f5c83640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00b2710 con 0x7ff8f00ce8e0 2023-12-04T10:43:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.013+0000 7ff8f5c83640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8f00ced70 con 0x7ff8f00d1fb0 2023-12-04T10:43:49.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.013+0000 7ff8f5c83640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8f00cf050 con 0x7ff8f015d5d0 2023-12-04T10:43:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.014+0000 7ff8e7fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff8f00ce8e0 0x7ff8f00d18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54634/0 (socket says 172.21.15.63:54634) 2023-12-04T10:43:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.014+0000 7ff8e7fff640 1 -- 172.21.15.63:0/2111441216 learned_addr learned my addr 172.21.15.63:0/2111441216 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:43:49.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.014+0000 7ff8ef7fe640 1 --2- 172.21.15.63:0/2111441216 >> v2:172.21.15.66:3300/0 conn(0x7ff8f015d5d0 0x7ff8f00d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.014+0000 7ff8eeffd640 1 -- 172.21.15.63:0/2111441216 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333875496 0 0) 0x7ff8f00b2710 con 0x7ff8f00ce8e0 2023-12-04T10:43:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.014+0000 7ff8eeffd640 1 -- 172.21.15.63:0/2111441216 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8dc003520 con 0x7ff8f00ce8e0 2023-12-04T10:43:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.015+0000 7ff8eeffd640 1 -- 172.21.15.63:0/2111441216 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4142197156 0 0) 0x7ff8dc003520 con 0x7ff8f00ce8e0 2023-12-04T10:43:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.015+0000 7ff8ef7fe640 1 -- 172.21.15.63:0/2111441216 >> v1:172.21.15.66:6789/0 conn(0x7ff8f00d1fb0 legacy=0x7ff8f00b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.015+0000 7ff8ef7fe640 1 -- 172.21.15.63:0/2111441216 >> v1:172.21.15.63:6789/0 conn(0x7ff8f00ce8e0 legacy=0x7ff8f00d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.015+0000 7ff8ef7fe640 1 -- 172.21.15.63:0/2111441216 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8f00b2960 con 0x7ff8f015d5d0 2023-12-04T10:43:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.016+0000 7ff8ef7fe640 1 --2- 172.21.15.63:0/2111441216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 0x7ff8f00d3a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009d90 tx=0x7ff8e002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=69458d390560b1b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8eeffd640 1 -- 172.21.15.63:0/2111441216 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d8001670 con 0x7ff8f015d5d0 2023-12-04T10:43:49.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8eeffd640 1 -- 172.21.15.63:0/2111441216 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e002c940 con 0x7ff8f015d5d0 2023-12-04T10:43:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8eeffd640 1 -- 172.21.15.63:0/2111441216 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e002ccd0 con 0x7ff8f015d5d0 2023-12-04T10:43:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8f5c83640 1 -- 172.21.15.63:0/2111441216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 msgr2=0x7ff8f00d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8f5c83640 1 --2- 172.21.15.63:0/2111441216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 0x7ff8f00d3a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0009d90 tx=0x7ff8e002be10 comp rx=0 tx=0).stop 2023-12-04T10:43:49.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8f5c83640 1 -- 172.21.15.63:0/2111441216 shutdown_connections 2023-12-04T10:43:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8f5c83640 1 --2- 172.21.15.63:0/2111441216 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 0x7ff8f00d3a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8f5c83640 1 -- 172.21.15.63:0/2111441216 >> 172.21.15.63:0/2111441216 conn(0x7ff8f009c600 msgr2=0x7ff8f00d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8f5c83640 1 -- 172.21.15.63:0/2111441216 shutdown_connections 2023-12-04T10:43:49.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.017+0000 7ff8f5c83640 1 -- 172.21.15.63:0/2111441216 wait complete. 2023-12-04T10:43:49.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.019+0000 7ff8f5c83640 1 Processor -- start 2023-12-04T10:43:49.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.019+0000 7ff8f5c83640 1 -- start start 2023-12-04T10:43:49.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.020+0000 7ff8f5c83640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8f00d1fb0 0x7ff8f00b8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.020+0000 7ff8f5c83640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 0x7ff8f00cf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.020+0000 7ff8f5c83640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9560 0x7ff8f00b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.020+0000 7ff8f5c83640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00cf900 con 0x7ff8f00c9560 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.020+0000 7ff8f5c83640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f0147450 con 0x7ff8f015d5d0 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.020+0000 7ff8f5c83640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8f00d03e0 con 0x7ff8f00d1fb0 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9560 0x7ff8f00b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9560 0x7ff8f00b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58002/0 (socket says 172.21.15.63:58002) 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 -- 172.21.15.63:0/1670572236 learned_addr learned my addr 172.21.15.63:0/1670572236 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8e7fff640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 0x7ff8f00cf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8ef7fe640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8f00d1fb0 0x7ff8f00b8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 -- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8f00d1fb0 msgr2=0x7ff8f00b8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8f00d1fb0 0x7ff8f00b8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 -- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 msgr2=0x7ff8f00cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 0x7ff8f00cf3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 -- 172.21.15.63:0/1670572236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8e0009a70 con 0x7ff8f00c9560 2023-12-04T10:43:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8e7fff640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 0x7ff8f00cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.021+0000 7ff8effff640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9560 0x7ff8f00b5ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c3c0 tx=0x7ff8e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.022+0000 7ff8ecff9640 1 -- 172.21.15.63:0/1670572236 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e80052d0 con 0x7ff8f00c9560 2023-12-04T10:43:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.022+0000 7ff8ecff9640 1 -- 172.21.15.63:0/1670572236 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8e8005430 con 0x7ff8f00c9560 2023-12-04T10:43:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.022+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8f00cfb40 con 0x7ff8f00c9560 2023-12-04T10:43:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.022+0000 7ff8ecff9640 1 -- 172.21.15.63:0/1670572236 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8e8003830 con 0x7ff8f00c9560 2023-12-04T10:43:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.022+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8f00d0100 con 0x7ff8f00c9560 2023-12-04T10:43:49.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.023+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8f0068710 con 0x7ff8f00c9560 2023-12-04T10:43:49.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.024+0000 7ff8ecff9640 1 -- 172.21.15.63:0/1670572236 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7ff8e8003990 con 0x7ff8f00c9560 2023-12-04T10:43:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.025+0000 7ff8ecff9640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff8d006adb0 0x7ff8d006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.026+0000 7ff8ecff9640 1 -- 172.21.15.63:0/1670572236 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7ff8e80886b0 con 0x7ff8f00c9560 2023-12-04T10:43:49.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.026+0000 7ff8ef7fe640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff8d006adb0 0x7ff8d006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.026+0000 7ff8ef7fe640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff8d006adb0 0x7ff8d006d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0036000 tx=0x7ff8e0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.030+0000 7ff8ecff9640 1 -- 172.21.15.63:0/1670572236 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8e8053b90 con 0x7ff8f00c9560 2023-12-04T10:43:49.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.227+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8f0147590 con 0x7ff8f00c9560 2023-12-04T10:43:49.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.229+0000 7ff8ecff9640 1 -- 172.21.15.63:0/1670572236 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12778 (secure 0 0 0) 0x7ff8e80571b0 con 0x7ff8f00c9560 2023-12-04T10:43:49.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:43:49.230 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:48.689321+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:43:49.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff8d006adb0 msgr2=0x7ff8d006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff8d006adb0 0x7ff8d006d270 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff8e0036000 tx=0x7ff8e0030000 comp rx=0 tx=0).stop 2023-12-04T10:43:49.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9560 msgr2=0x7ff8f00b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9560 0x7ff8f00b5ec0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff8e800c3c0 tx=0x7ff8e800c880 comp rx=0 tx=0).stop 2023-12-04T10:43:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 shutdown_connections 2023-12-04T10:43:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff8d006adb0 0x7ff8d006d270 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8f00c9560 0x7ff8f00b5ec0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8f015d5d0 0x7ff8f00cf3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 --2- 172.21.15.63:0/1670572236 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8f00d1fb0 0x7ff8f00b8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.231+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 >> 172.21.15.63:0/1670572236 conn(0x7ff8f009c600 msgr2=0x7ff8f00afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.232+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 shutdown_connections 2023-12-04T10:43:49.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.232+0000 7ff8f5c83640 1 -- 172.21.15.63:0/1670572236 wait complete. 2023-12-04T10:43:49.253 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T10:43:49.253 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:43:49.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.447+0000 7fd60b59e640 1 Processor -- start 2023-12-04T10:43:49.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.447+0000 7fd60b59e640 1 -- start start 2023-12-04T10:43:49.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.449+0000 7fd60b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd60c1608d0 0x7fd60c0d3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.449+0000 7fd60b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.449+0000 7fd60b59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd60c0aff10 con 0x7fd60c0d1920 2023-12-04T10:43:49.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.449+0000 7fd60b59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd60c0d11b0 con 0x7fd60c1608d0 2023-12-04T10:43:49.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.449+0000 7fd60b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c0d1db0 con 0x7fd60c0b1fb0 2023-12-04T10:43:49.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.450+0000 7fd60a59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd60c1608d0 0x7fd60c0d3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.450+0000 7fd603fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.450+0000 7fd60a59c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd60c1608d0 0x7fd60c0d3bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:52760/0 (socket says 172.21.15.63:52760) 2023-12-04T10:43:49.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.450+0000 7fd60a59c640 1 -- 172.21.15.63:0/1748421741 learned_addr learned my addr 172.21.15.63:0/1748421741 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:49.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.450+0000 7fd60a59c640 1 -- 172.21.15.63:0/1748421741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 msgr2=0x7fd60c0d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:49.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.450+0000 7fd60a59c640 1 --2- 172.21.15.63:0/1748421741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.450+0000 7fd60a59c640 1 -- 172.21.15.63:0/1748421741 >> v1:172.21.15.66:6789/0 conn(0x7fd60c0d1920 legacy=0x7fd60c0cf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.450+0000 7fd60a59c640 1 -- 172.21.15.63:0/1748421741 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd60c0ce800 con 0x7fd60c1608d0 2023-12-04T10:43:49.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.452+0000 7fd60a59c640 1 --2- 172.21.15.63:0/1748421741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 0x7fd60c0d3bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc02b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b83875c7a49a2df8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.452+0000 7fd609d9b640 1 -- 172.21.15.63:0/1748421741 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc031640 con 0x7fd60c1608d0 2023-12-04T10:43:49.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.452+0000 7fd609d9b640 1 -- 172.21.15.63:0/1748421741 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5fc0317a0 con 0x7fd60c1608d0 2023-12-04T10:43:49.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.452+0000 7fd609d9b640 1 -- 172.21.15.63:0/1748421741 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc031b30 con 0x7fd60c1608d0 2023-12-04T10:43:49.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.453+0000 7fd60b59e640 1 -- 172.21.15.63:0/1748421741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 msgr2=0x7fd60c0d3bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.453+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1748421741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 0x7fd60c0d3bd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc009870 tx=0x7fd5fc02b8f0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.453+0000 7fd60b59e640 1 -- 172.21.15.63:0/1748421741 shutdown_connections 2023-12-04T10:43:49.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.453+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1748421741 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.453+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1748421741 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 0x7fd60c0d3bd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.453+0000 7fd60b59e640 1 -- 172.21.15.63:0/1748421741 >> 172.21.15.63:0/1748421741 conn(0x7fd60c0d30b0 msgr2=0x7fd60c0d34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:49.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.453+0000 7fd60b59e640 1 -- 172.21.15.63:0/1748421741 shutdown_connections 2023-12-04T10:43:49.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.453+0000 7fd60b59e640 1 -- 172.21.15.63:0/1748421741 wait complete. 2023-12-04T10:43:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.455+0000 7fd60b59e640 1 Processor -- start 2023-12-04T10:43:49.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.455+0000 7fd60b59e640 1 -- start start 2023-12-04T10:43:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd60b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd60b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd60c0d1920 0x7fd60c0c97f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd60b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 0x7fd60c14d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd60b59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c09ce60 con 0x7fd60c0d1920 2023-12-04T10:43:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd60b59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c09d070 con 0x7fd60c1608d0 2023-12-04T10:43:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd60b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd60c09d350 con 0x7fd60c0b1fb0 2023-12-04T10:43:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd603fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd60c0d1920 0x7fd60c0c97f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd603fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd60c0d1920 0x7fd60c0c97f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58012/0 (socket says 172.21.15.63:58012) 2023-12-04T10:43:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.456+0000 7fd603fff640 1 -- 172.21.15.63:0/1448026693 learned_addr learned my addr 172.21.15.63:0/1448026693 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd60a59c640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd60ad9d640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 0x7fd60c14d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd603fff640 1 -- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 msgr2=0x7fd60c0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd603fff640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0cc6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd603fff640 1 -- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 msgr2=0x7fd60c14d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd603fff640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 0x7fd60c14d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd603fff640 1 -- 172.21.15.63:0/1448026693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5fc0094d0 con 0x7fd60c0d1920 2023-12-04T10:43:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd60ad9d640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 0x7fd60c14d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:49.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd60a59c640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.457+0000 7fd603fff640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd60c0d1920 0x7fd60c0c97f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400e9b0 tx=0x7fd5f400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.458+0000 7fd602ffd640 1 -- 172.21.15.63:0/1448026693 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4009670 con 0x7fd60c0d1920 2023-12-04T10:43:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.458+0000 7fd602ffd640 1 -- 172.21.15.63:0/1448026693 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5f400c9a0 con 0x7fd60c0d1920 2023-12-04T10:43:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.458+0000 7fd602ffd640 1 -- 172.21.15.63:0/1448026693 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5f400cd50 con 0x7fd60c0d1920 2023-12-04T10:43:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.458+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd60c0cbec0 con 0x7fd60c0d1920 2023-12-04T10:43:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.458+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd60c0cbbb0 con 0x7fd60c0d1920 2023-12-04T10:43:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.459+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd60c04e840 con 0x7fd60c0d1920 2023-12-04T10:43:49.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.460+0000 7fd602ffd640 1 -- 172.21.15.63:0/1448026693 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fd5f4013470 con 0x7fd60c0d1920 2023-12-04T10:43:49.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.461+0000 7fd602ffd640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5ec06adb0 0x7fd5ec06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.461+0000 7fd602ffd640 1 -- 172.21.15.63:0/1448026693 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5f40893d0 con 0x7fd60c0d1920 2023-12-04T10:43:49.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.461+0000 7fd60a59c640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5ec06adb0 0x7fd5ec06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.462+0000 7fd60a59c640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5ec06adb0 0x7fd5ec06d270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc036000 tx=0x7fd5fc03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.465+0000 7fd602ffd640 1 -- 172.21.15.63:0/1448026693 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5f40548a0 con 0x7fd60c0d1920 2023-12-04T10:43:49.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.657+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd60c09d510 con 0x7fd60c0d1920 2023-12-04T10:43:49.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.658+0000 7fd602ffd640 1 -- 172.21.15.63:0/1448026693 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5f4057ec0 con 0x7fd60c0d1920 2023-12-04T10:43:49.659 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:43:49.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.660+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5ec06adb0 msgr2=0x7fd5ec06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.660+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5ec06adb0 0x7fd5ec06d270 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc036000 tx=0x7fd5fc03c040 comp rx=0 tx=0).stop 2023-12-04T10:43:49.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.660+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd60c0d1920 msgr2=0x7fd60c0c97f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.660+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd60c0d1920 0x7fd60c0c97f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd5f400e9b0 tx=0x7fd5f400ee70 comp rx=0 tx=0).stop 2023-12-04T10:43:49.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.660+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 shutdown_connections 2023-12-04T10:43:49.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.661+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5ec06adb0 0x7fd5ec06d270 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.661+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd60c1608d0 0x7fd60c14d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.661+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd60c0d1920 0x7fd60c0c97f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.661+0000 7fd60b59e640 1 --2- 172.21.15.63:0/1448026693 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd60c0b1fb0 0x7fd60c0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.661+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 >> 172.21.15.63:0/1448026693 conn(0x7fd60c0d30b0 msgr2=0x7fd60c15e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:49.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.661+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 shutdown_connections 2023-12-04T10:43:49.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.661+0000 7fd60b59e640 1 -- 172.21.15.63:0/1448026693 wait complete. 2023-12-04T10:43:49.678 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T10:43:49.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.900+0000 7fe46b59e640 1 Processor -- start 2023-12-04T10:43:49.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.900+0000 7fe46b59e640 1 -- start start 2023-12-04T10:43:49.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46b59e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe46c0d16b0 0x7fe46c0d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c15d710 0x7fe46c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe46c0d3cd0 0x7fe46c0cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46b59e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46c0d1fd0 con 0x7fe46c0d16b0 2023-12-04T10:43:49.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46b59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe46c0cef40 con 0x7fe46c0d3cd0 2023-12-04T10:43:49.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c0b25c0 con 0x7fe46c15d710 2023-12-04T10:43:49.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46a59c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe46c0d16b0 0x7fe46c0d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46a59c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe46c0d16b0 0x7fe46c0d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58026/0 (socket says 172.21.15.63:58026) 2023-12-04T10:43:49.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46a59c640 1 -- 172.21.15.63:0/583704534 learned_addr learned my addr 172.21.15.63:0/583704534 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:49.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.902+0000 7fe46ad9d640 1 --2- 172.21.15.63:0/583704534 >> v2:172.21.15.66:3300/0 conn(0x7fe46c0d3cd0 0x7fe46c0cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.903+0000 7fe469d9b640 1 --2- 172.21.15.63:0/583704534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c15d710 0x7fe46c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.903+0000 7fe46a59c640 1 -- 172.21.15.63:0/583704534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c15d710 msgr2=0x7fe46c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:49.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.903+0000 7fe46a59c640 1 --2- 172.21.15.63:0/583704534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c15d710 0x7fe46c0ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.903+0000 7fe46a59c640 1 -- 172.21.15.63:0/583704534 >> v2:172.21.15.66:3300/0 conn(0x7fe46c0d3cd0 msgr2=0x7fe46c0cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:49.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.903+0000 7fe46a59c640 1 --2- 172.21.15.63:0/583704534 >> v2:172.21.15.66:3300/0 conn(0x7fe46c0d3cd0 0x7fe46c0cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.903+0000 7fe46a59c640 1 -- 172.21.15.63:0/583704534 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe46c0b28a0 con 0x7fe46c0d16b0 2023-12-04T10:43:49.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.904+0000 7fe46a59c640 1 --2- 172.21.15.63:0/583704534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c0d16b0 0x7fe46c0d1a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe46c08d560 tx=0x7fe45c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8548e380d3b950c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.904+0000 7fe46959a640 1 -- 172.21.15.63:0/583704534 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c0317e0 con 0x7fe46c0d16b0 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46959a640 1 -- 172.21.15.63:0/583704534 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe45c031940 con 0x7fe46c0d16b0 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46959a640 1 -- 172.21.15.63:0/583704534 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe45c031cd0 con 0x7fe46c0d16b0 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46b59e640 1 -- 172.21.15.63:0/583704534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c0d16b0 msgr2=0x7fe46c0d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46b59e640 1 --2- 172.21.15.63:0/583704534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c0d16b0 0x7fe46c0d1a90 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe46c08d560 tx=0x7fe45c02b880 comp rx=0 tx=0).stop 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46b59e640 1 -- 172.21.15.63:0/583704534 shutdown_connections 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46b59e640 1 --2- 172.21.15.63:0/583704534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c15d710 0x7fe46c0ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46b59e640 1 --2- 172.21.15.63:0/583704534 >> v2:172.21.15.66:3300/0 conn(0x7fe46c0d3cd0 0x7fe46c0cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46b59e640 1 --2- 172.21.15.63:0/583704534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c0d16b0 0x7fe46c0d1a90 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.905+0000 7fe46b59e640 1 -- 172.21.15.63:0/583704534 >> 172.21.15.63:0/583704534 conn(0x7fe46c0d30d0 msgr2=0x7fe46c0d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.906+0000 7fe46b59e640 1 -- 172.21.15.63:0/583704534 shutdown_connections 2023-12-04T10:43:49.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.906+0000 7fe46b59e640 1 -- 172.21.15.63:0/583704534 wait complete. 2023-12-04T10:43:49.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.907+0000 7fe46b59e640 1 Processor -- start 2023-12-04T10:43:49.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.908+0000 7fe46b59e640 1 -- start start 2023-12-04T10:43:49.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c0d16b0 0x7fe46c157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe46c0d3cd0 0x7fe46c156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c15d710 0x7fe46c0b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46b59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c0c8e20 con 0x7fe46c15d710 2023-12-04T10:43:49.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46b59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c0b61d0 con 0x7fe46c0d3cd0 2023-12-04T10:43:49.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe46c0b7010 con 0x7fe46c0d16b0 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c15d710 0x7fe46c0b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c15d710 0x7fe46c0b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58036/0 (socket says 172.21.15.63:58036) 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46ad9d640 1 -- 172.21.15.63:0/2079969097 learned_addr learned my addr 172.21.15.63:0/2079969097 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe469d9b640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe46c0d3cd0 0x7fe46c156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46a59c640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c0d16b0 0x7fe46c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.909+0000 7fe46ad9d640 1 -- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c0d16b0 msgr2=0x7fe46c157530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe46ad9d640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c0d16b0 0x7fe46c157530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe46ad9d640 1 -- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe46c0d3cd0 msgr2=0x7fe46c156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe46ad9d640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe46c0d3cd0 0x7fe46c156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe46ad9d640 1 -- 172.21.15.63:0/2079969097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe45c0094d0 con 0x7fe46c15d710 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe469d9b640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe46c0d3cd0 0x7fe46c156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe46ad9d640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c15d710 0x7fe46c0b5c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe46400eed0 tx=0x7fe46400b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe45affd640 1 -- 172.21.15.63:0/2079969097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe464010040 con 0x7fe46c15d710 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe45affd640 1 -- 172.21.15.63:0/2079969097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe464014400 con 0x7fe46c15d710 2023-12-04T10:43:49.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe46c0b6400 con 0x7fe46c15d710 2023-12-04T10:43:49.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe45affd640 1 -- 172.21.15.63:0/2079969097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4640147b0 con 0x7fe46c15d710 2023-12-04T10:43:49.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.910+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe46c0b69c0 con 0x7fe46c15d710 2023-12-04T10:43:49.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.911+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe46c0b7180 con 0x7fe46c15d710 2023-12-04T10:43:49.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.913+0000 7fe45affd640 1 -- 172.21.15.63:0/2079969097 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fe464014910 con 0x7fe46c15d710 2023-12-04T10:43:49.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.914+0000 7fe45affd640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe44c06adb0 0x7fe44c06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:49.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.914+0000 7fe45affd640 1 -- 172.21.15.63:0/2079969097 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe464089c40 con 0x7fe46c15d710 2023-12-04T10:43:49.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.914+0000 7fe46a59c640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe44c06adb0 0x7fe44c06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:49.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.915+0000 7fe46a59c640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe44c06adb0 0x7fe44c06d270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe45c036000 tx=0x7fe45c03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:49.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:49.919+0000 7fe45affd640 1 -- 172.21.15.63:0/2079969097 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe464090080 con 0x7fe46c15d710 2023-12-04T10:43:50.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.119+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe46c04e840 con 0x7fe46c15d710 2023-12-04T10:43:50.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.120+0000 7fe45affd640 1 -- 172.21.15.63:0/2079969097 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe464018090 con 0x7fe46c15d710 2023-12-04T10:43:50.121 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:43:50.121 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2023-12-04T10:43:50.121 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:43:50.121 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2023-12-04T10:43:50.121 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2023-12-04T10:43:50.121 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:43:50.121 INFO:teuthology.orchestra.run.smithi063.stdout:] 2023-12-04T10:43:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe44c06adb0 msgr2=0x7fe44c06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe44c06adb0 0x7fe44c06d270 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe45c036000 tx=0x7fe45c03d040 comp rx=0 tx=0).stop 2023-12-04T10:43:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c15d710 msgr2=0x7fe46c0b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c15d710 0x7fe46c0b5c90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe46400eed0 tx=0x7fe46400b480 comp rx=0 tx=0).stop 2023-12-04T10:43:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 shutdown_connections 2023-12-04T10:43:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe44c06adb0 0x7fe44c06d270 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe46c15d710 0x7fe46c0b5c90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe46c0d3cd0 0x7fe46c156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 --2- 172.21.15.63:0/2079969097 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe46c0d16b0 0x7fe46c157530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 >> 172.21.15.63:0/2079969097 conn(0x7fe46c0d30d0 msgr2=0x7fe46c0ce410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 shutdown_connections 2023-12-04T10:43:50.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.123+0000 7fe46b59e640 1 -- 172.21.15.63:0/2079969097 wait complete. 2023-12-04T10:43:50.142 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-04T10:43:50.142 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-04T10:43:50.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.365+0000 7fa30730f640 1 Processor -- start 2023-12-04T10:43:50.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.366+0000 7fa30730f640 1 -- start start 2023-12-04T10:43:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.367+0000 7fa30730f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa3000726f0 0x7fa300070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.367+0000 7fa30730f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000b2a20 0x7fa3000b2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.367+0000 7fa30730f640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000b3380 con 0x7fa300157980 2023-12-04T10:43:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.367+0000 7fa30730f640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa300070b70 con 0x7fa3000726f0 2023-12-04T10:43:50.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.367+0000 7fa30730f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30015dcd0 con 0x7fa3000b2a20 2023-12-04T10:43:50.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3050ab640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa300157980 0x7fa300071fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:54640/0 (socket says 172.21.15.63:54640) 2023-12-04T10:43:50.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3050ab640 1 -- 172.21.15.63:0/3323246111 learned_addr learned my addr 172.21.15.63:0/3323246111 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:43:50.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3048aa640 1 --2- 172.21.15.63:0/3323246111 >> v2:172.21.15.63:3300/0 conn(0x7fa3000726f0 0x7fa300070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3058ac640 1 --2- 172.21.15.63:0/3323246111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000b2a20 0x7fa3000b2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa2f7fff640 1 -- 172.21.15.63:0/3323246111 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631174288 0 0) 0x7fa3000b3380 con 0x7fa300157980 2023-12-04T10:43:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa2f7fff640 1 -- 172.21.15.63:0/3323246111 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2ec003520 con 0x7fa300157980 2023-12-04T10:43:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3048aa640 1 -- 172.21.15.63:0/3323246111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000b2a20 msgr2=0x7fa3000b2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3048aa640 1 --2- 172.21.15.63:0/3323246111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000b2a20 0x7fa3000b2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3048aa640 1 -- 172.21.15.63:0/3323246111 >> v1:172.21.15.63:6789/0 conn(0x7fa300157980 legacy=0x7fa300071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3048aa640 1 -- 172.21.15.63:0/3323246111 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30015dfb0 con 0x7fa3000726f0 2023-12-04T10:43:50.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.368+0000 7fa3058ac640 1 --2- 172.21.15.63:0/3323246111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000b2a20 0x7fa3000b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.369+0000 7fa3048aa640 1 --2- 172.21.15.63:0/3323246111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3000726f0 0x7fa300070630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00097a0 tx=0x7fa2f002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7712547ccd4d4c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa2f7fff640 1 -- 172.21.15.63:0/3323246111 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0031830 con 0x7fa3000726f0 2023-12-04T10:43:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa2f7fff640 1 -- 172.21.15.63:0/3323246111 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f0031990 con 0x7fa3000726f0 2023-12-04T10:43:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa2f7fff640 1 -- 172.21.15.63:0/3323246111 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f0031d20 con 0x7fa3000726f0 2023-12-04T10:43:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa30730f640 1 -- 172.21.15.63:0/3323246111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3000726f0 msgr2=0x7fa300070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:50.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa30730f640 1 --2- 172.21.15.63:0/3323246111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3000726f0 0x7fa300070630 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa2f00097a0 tx=0x7fa2f002b8d0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa30730f640 1 -- 172.21.15.63:0/3323246111 shutdown_connections 2023-12-04T10:43:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa30730f640 1 --2- 172.21.15.63:0/3323246111 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000b2a20 0x7fa3000b2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa30730f640 1 --2- 172.21.15.63:0/3323246111 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa3000726f0 0x7fa300070630 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa30730f640 1 -- 172.21.15.63:0/3323246111 >> 172.21.15.63:0/3323246111 conn(0x7fa30006a450 msgr2=0x7fa30006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.370+0000 7fa30730f640 1 -- 172.21.15.63:0/3323246111 shutdown_connections 2023-12-04T10:43:50.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.371+0000 7fa30730f640 1 -- 172.21.15.63:0/3323246111 wait complete. 2023-12-04T10:43:50.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.372+0000 7fa30730f640 1 Processor -- start 2023-12-04T10:43:50.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.372+0000 7fa30730f640 1 -- start start 2023-12-04T10:43:50.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.373+0000 7fa30730f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000726f0 0x7fa30015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.373+0000 7fa30730f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3000b2a20 0x7fa3001f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.373+0000 7fa30730f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa300157980 0x7fa30015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.373+0000 7fa30730f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30015bf60 con 0x7fa300157980 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.373+0000 7fa30730f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30015c240 con 0x7fa3000b2a20 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.373+0000 7fa30730f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30015c520 con 0x7fa3000726f0 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa300157980 0x7fa30015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa300157980 0x7fa30015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58052/0 (socket says 172.21.15.63:58052) 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 -- 172.21.15.63:0/2461679620 learned_addr learned my addr 172.21.15.63:0/2461679620 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3048aa640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3000b2a20 0x7fa3001f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3050ab640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000726f0 0x7fa30015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 -- 172.21.15.63:0/2461679620 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000726f0 msgr2=0x7fa30015d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000726f0 0x7fa30015d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 -- 172.21.15.63:0/2461679620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3000b2a20 msgr2=0x7fa3001f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:50.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3000b2a20 0x7fa3001f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:50.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 -- 172.21.15.63:0/2461679620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f0009400 con 0x7fa300157980 2023-12-04T10:43:50.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa3058ac640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa300157980 0x7fa30015b680 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8007ef0 tx=0x7fa2f800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.374+0000 7fa2f5ffb640 1 -- 172.21.15.63:0/2461679620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8003b90 con 0x7fa300157980 2023-12-04T10:43:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.375+0000 7fa2f5ffb640 1 -- 172.21.15.63:0/2461679620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f800f040 con 0x7fa300157980 2023-12-04T10:43:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.375+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30015c800 con 0x7fa300157980 2023-12-04T10:43:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.375+0000 7fa2f5ffb640 1 -- 172.21.15.63:0/2461679620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800de80 con 0x7fa300157980 2023-12-04T10:43:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.375+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3001f2920 con 0x7fa300157980 2023-12-04T10:43:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.376+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa300068710 con 0x7fa300157980 2023-12-04T10:43:50.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.377+0000 7fa2f5ffb640 1 -- 172.21.15.63:0/2461679620 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fa2f8004030 con 0x7fa300157980 2023-12-04T10:43:50.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.378+0000 7fa2f5ffb640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa2e406adb0 0x7fa2e406d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:50.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.378+0000 7fa2f5ffb640 1 -- 172.21.15.63:0/2461679620 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa2f8089440 con 0x7fa300157980 2023-12-04T10:43:50.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.378+0000 7fa3050ab640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa2e406adb0 0x7fa2e406d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:50.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.379+0000 7fa3050ab640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa2e406adb0 0x7fa2e406d270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc005880 tx=0x7fa2fc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:50.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.383+0000 7fa2f5ffb640 1 -- 172.21.15.63:0/2461679620 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa2f80549c0 con 0x7fa300157980 2023-12-04T10:43:50.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:50.577+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa3000aca40 con 0x7fa300157980 2023-12-04T10:43:51.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.213+0000 7fa2f5ffb640 1 -- 172.21.15.63:0/2461679620 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa2f801a0b0 con 0x7fa300157980 2023-12-04T10:43:51.214 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2023-12-04T10:43:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa2e406adb0 msgr2=0x7fa2e406d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa2e406adb0 0x7fa2e406d270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc005880 tx=0x7fa2fc009040 comp rx=0 tx=0).stop 2023-12-04T10:43:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa300157980 msgr2=0x7fa30015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa300157980 0x7fa30015b680 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2f8007ef0 tx=0x7fa2f800d4a0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 shutdown_connections 2023-12-04T10:43:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa2e406adb0 0x7fa2e406d270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.217 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa300157980 0x7fa30015b680 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3000b2a20 0x7fa3001f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 --2- 172.21.15.63:0/2461679620 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3000726f0 0x7fa30015d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 >> 172.21.15.63:0/2461679620 conn(0x7fa30006a450 msgr2=0x7fa30006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 shutdown_connections 2023-12-04T10:43:51.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.216+0000 7fa30730f640 1 -- 172.21.15.63:0/2461679620 wait complete. 2023-12-04T10:43:51.240 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-04T10:43:51.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.445+0000 7f39e8cda640 1 Processor -- start 2023-12-04T10:43:51.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.445+0000 7f39e8cda640 1 -- start start 2023-12-04T10:43:51.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.447+0000 7f39e8cda640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f39e4144a00 0x7f39e40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:51.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.447+0000 7f39e8cda640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40701b0 0x7f39e40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:51.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.447+0000 7f39e8cda640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39e40b2370 con 0x7f39e40ca290 2023-12-04T10:43:51.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.447+0000 7f39e8cda640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39e4070b00 con 0x7f39e4144a00 2023-12-04T10:43:51.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.447+0000 7f39e8cda640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40cae80 con 0x7f39e40701b0 2023-12-04T10:43:51.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.448+0000 7f39e1d9b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40701b0 0x7f39e40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:51.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.448+0000 7f39e1d9b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40701b0 0x7f39e40705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:46846/0 (socket says 172.21.15.63:46846) 2023-12-04T10:43:51.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.448+0000 7f39e1d9b640 1 -- 172.21.15.63:0/1248004492 learned_addr learned my addr 172.21.15.63:0/1248004492 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:51.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.449+0000 7f39e259c640 1 --2- 172.21.15.63:0/1248004492 >> v2:172.21.15.66:3300/0 conn(0x7f39e4144a00 0x7f39e40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:51.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.449+0000 7f39e1d9b640 1 -- 172.21.15.63:0/1248004492 >> v2:172.21.15.66:3300/0 conn(0x7f39e4144a00 msgr2=0x7f39e40b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:51.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.449+0000 7f39e1d9b640 1 --2- 172.21.15.63:0/1248004492 >> v2:172.21.15.66:3300/0 conn(0x7f39e4144a00 0x7f39e40b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.449+0000 7f39e1d9b640 1 -- 172.21.15.63:0/1248004492 >> v1:172.21.15.66:6789/0 conn(0x7f39e40ca290 legacy=0x7f39e406d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:51.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.449+0000 7f39e1d9b640 1 -- 172.21.15.63:0/1248004492 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39e406c460 con 0x7f39e40701b0 2023-12-04T10:43:51.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.450+0000 7f39e1d9b640 1 --2- 172.21.15.63:0/1248004492 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40701b0 0x7f39e40705c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009870 tx=0x7f39d802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1c6f036b0711d64 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.451+0000 7f39e159a640 1 -- 172.21.15.63:0/1248004492 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8031640 con 0x7f39e40701b0 2023-12-04T10:43:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.451+0000 7f39e159a640 1 -- 172.21.15.63:0/1248004492 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39d80317a0 con 0x7f39e40701b0 2023-12-04T10:43:51.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.451+0000 7f39e159a640 1 -- 172.21.15.63:0/1248004492 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39d8031b30 con 0x7f39e40701b0 2023-12-04T10:43:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.452+0000 7f39e8cda640 1 -- 172.21.15.63:0/1248004492 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40701b0 msgr2=0x7f39e40705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.452+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1248004492 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40701b0 0x7f39e40705c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f39d8009870 tx=0x7f39d802b8f0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.452+0000 7f39e8cda640 1 -- 172.21.15.63:0/1248004492 shutdown_connections 2023-12-04T10:43:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.452+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1248004492 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40701b0 0x7f39e40705c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.452+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1248004492 >> v2:172.21.15.66:3300/0 conn(0x7f39e4144a00 0x7f39e40b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.452+0000 7f39e8cda640 1 -- 172.21.15.63:0/1248004492 >> 172.21.15.63:0/1248004492 conn(0x7f39e40cee80 msgr2=0x7f39e40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:51.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.452+0000 7f39e8cda640 1 -- 172.21.15.63:0/1248004492 shutdown_connections 2023-12-04T10:43:51.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.452+0000 7f39e8cda640 1 -- 172.21.15.63:0/1248004492 wait complete. 2023-12-04T10:43:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.455+0000 7f39e8cda640 1 Processor -- start 2023-12-04T10:43:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.455+0000 7f39e8cda640 1 -- start start 2023-12-04T10:43:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.456+0000 7f39e8cda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39e40701b0 0x7f39e41379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.456+0000 7f39e8cda640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40ca290 0x7f39e40c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:51.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.456+0000 7f39e8cda640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39e4144a00 0x7f39e40c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.456+0000 7f39e8cda640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e4137f00 con 0x7f39e4144a00 2023-12-04T10:43:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.456+0000 7f39e8cda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40ce500 con 0x7f39e40701b0 2023-12-04T10:43:51.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.456+0000 7f39e8cda640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39e40cd8f0 con 0x7f39e40ca290 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39e4144a00 0x7f39e40c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39e4144a00 0x7f39e40c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58068/0 (socket says 172.21.15.63:58068) 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 -- 172.21.15.63:0/1503312130 learned_addr learned my addr 172.21.15.63:0/1503312130 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e1d9b640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40ca290 0x7f39e40c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e259c640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39e40701b0 0x7f39e41379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 -- 172.21.15.63:0/1503312130 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40ca290 msgr2=0x7f39e40c81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40ca290 0x7f39e40c81b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 -- 172.21.15.63:0/1503312130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39e40701b0 msgr2=0x7f39e41379c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39e40701b0 0x7f39e41379c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 -- 172.21.15.63:0/1503312130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39d80094d0 con 0x7f39e4144a00 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.457+0000 7f39e2d9d640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39e4144a00 0x7f39e40c86f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00c780 tx=0x7f39dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:51.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.458+0000 7f39d2ffd640 1 -- 172.21.15.63:0/1503312130 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc003d80 con 0x7f39e4144a00 2023-12-04T10:43:51.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.458+0000 7f39d2ffd640 1 -- 172.21.15.63:0/1503312130 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39dc00ce90 con 0x7f39e4144a00 2023-12-04T10:43:51.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.458+0000 7f39d2ffd640 1 -- 172.21.15.63:0/1503312130 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39dc0052b0 con 0x7f39e4144a00 2023-12-04T10:43:51.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.458+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39e40cdbd0 con 0x7f39e4144a00 2023-12-04T10:43:51.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.458+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e40ce190 con 0x7f39e4144a00 2023-12-04T10:43:51.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.459+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39e40ce670 con 0x7f39e4144a00 2023-12-04T10:43:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.460+0000 7f39d2ffd640 1 -- 172.21.15.63:0/1503312130 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f39dc005410 con 0x7f39e4144a00 2023-12-04T10:43:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.461+0000 7f39d2ffd640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f39c406ae40 0x7f39c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.461+0000 7f39d2ffd640 1 -- 172.21.15.63:0/1503312130 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f39dc088870 con 0x7f39e4144a00 2023-12-04T10:43:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.461+0000 7f39e259c640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f39c406ae40 0x7f39c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:51.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.462+0000 7f39e259c640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f39c406ae40 0x7f39c406d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f39d4006fd0 tx=0x7f39d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:51.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.466+0000 7f39d2ffd640 1 -- 172.21.15.63:0/1503312130 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f39dc053b90 con 0x7f39e4144a00 2023-12-04T10:43:51.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:51.663+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7f39e40ce350 con 0x7f39e4144a00 2023-12-04T10:43:52.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.219+0000 7f39d2ffd640 1 -- 172.21.15.63:0/1503312130 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v20) v1 ==== 171+0+0 (secure 0 0 0) 0x7f39dc017020 con 0x7f39e4144a00 2023-12-04T10:43:52.220 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2023-12-04T10:43:52.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f39c406ae40 msgr2=0x7f39c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:52.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f39c406ae40 0x7f39c406d300 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f39d4006fd0 tx=0x7f39d4008040 comp rx=0 tx=0).stop 2023-12-04T10:43:52.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39e4144a00 msgr2=0x7f39e40c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:52.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39e4144a00 0x7f39e40c86f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f39dc00c780 tx=0x7f39dc00cc40 comp rx=0 tx=0).stop 2023-12-04T10:43:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 shutdown_connections 2023-12-04T10:43:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f39c406ae40 0x7f39c406d300 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f39e40ca290 0x7f39e40c81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f39e4144a00 0x7f39e40c86f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 --2- 172.21.15.63:0/1503312130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39e40701b0 0x7f39e41379c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.224+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 >> 172.21.15.63:0/1503312130 conn(0x7f39e40cee80 msgr2=0x7f39e40caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:52.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.225+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 shutdown_connections 2023-12-04T10:43:52.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.225+0000 7f39e8cda640 1 -- 172.21.15.63:0/1503312130 wait complete. 2023-12-04T10:43:52.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-04T10:43:52.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.453+0000 7f9ce2687640 1 Processor -- start 2023-12-04T10:43:52.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.454+0000 7f9ce2687640 1 -- start start 2023-12-04T10:43:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.455+0000 7f9ce2687640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc144a00 0x7f9cdc0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.455+0000 7f9ce2687640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9cdc0701b0 0x7f9cdc070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.455+0000 7f9ce2687640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9cdc0ca290 0x7f9cdc0ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.455+0000 7f9ce2687640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc0b2370 con 0x7f9cdc0701b0 2023-12-04T10:43:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.455+0000 7f9ce2687640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cdc0cac00 con 0x7f9cdc0ca290 2023-12-04T10:43:52.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.455+0000 7f9ce2687640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc070ad0 con 0x7f9cdc144a00 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cd3fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9cdc0701b0 0x7f9cdc070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cd3fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f9cdc0701b0 0x7f9cdc070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58082/0 (socket says 172.21.15.63:58082) 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cd3fff640 1 -- 172.21.15.63:0/1879357452 learned_addr learned my addr 172.21.15.63:0/1879357452 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cdbfff640 1 --2- 172.21.15.63:0/1879357452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc144a00 0x7f9cdc0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cd3fff640 1 -- 172.21.15.63:0/1879357452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc144a00 msgr2=0x7f9cdc0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cd3fff640 1 --2- 172.21.15.63:0/1879357452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc144a00 0x7f9cdc0b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cd3fff640 1 -- 172.21.15.63:0/1879357452 >> v2:172.21.15.66:3300/0 conn(0x7f9cdc0ca290 msgr2=0x7f9cdc0ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9ce0c24640 1 --2- 172.21.15.63:0/1879357452 >> v2:172.21.15.66:3300/0 conn(0x7f9cdc0ca290 0x7f9cdc0ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cd3fff640 1 --2- 172.21.15.63:0/1879357452 >> v2:172.21.15.66:3300/0 conn(0x7f9cdc0ca290 0x7f9cdc0ca6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cd3fff640 1 -- 172.21.15.63:0/1879357452 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cdc0cae80 con 0x7f9cdc0701b0 2023-12-04T10:43:52.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.456+0000 7f9cdbfff640 1 --2- 172.21.15.63:0/1879357452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc144a00 0x7f9cdc0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:52.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.457+0000 7f9cd3fff640 1 --2- 172.21.15.63:0/1879357452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc0701b0 0x7f9cdc070590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc072820 tx=0x7f9cc402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900d11e853f38603 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.458+0000 7f9cdb7fe640 1 -- 172.21.15.63:0/1879357452 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4031860 con 0x7f9cdc0701b0 2023-12-04T10:43:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.458+0000 7f9cdb7fe640 1 -- 172.21.15.63:0/1879357452 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc40319c0 con 0x7f9cdc0701b0 2023-12-04T10:43:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.458+0000 7f9cdb7fe640 1 -- 172.21.15.63:0/1879357452 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4031d50 con 0x7f9cdc0701b0 2023-12-04T10:43:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.458+0000 7f9ce2687640 1 -- 172.21.15.63:0/1879357452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc0701b0 msgr2=0x7f9cdc070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.458+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1879357452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc0701b0 0x7f9cdc070590 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9cdc072820 tx=0x7f9cc402b900 comp rx=0 tx=0).stop 2023-12-04T10:43:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.459+0000 7f9ce2687640 1 -- 172.21.15.63:0/1879357452 shutdown_connections 2023-12-04T10:43:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.459+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1879357452 >> v2:172.21.15.66:3300/0 conn(0x7f9cdc0ca290 0x7f9cdc0ca6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.459+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1879357452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc0701b0 0x7f9cdc070590 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.459+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1879357452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc144a00 0x7f9cdc0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.459+0000 7f9ce2687640 1 -- 172.21.15.63:0/1879357452 >> 172.21.15.63:0/1879357452 conn(0x7f9cdc0cee80 msgr2=0x7f9cdc0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:52.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.459+0000 7f9ce2687640 1 -- 172.21.15.63:0/1879357452 shutdown_connections 2023-12-04T10:43:52.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.459+0000 7f9ce2687640 1 -- 172.21.15.63:0/1879357452 wait complete. 2023-12-04T10:43:52.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.460+0000 7f9ce2687640 1 Processor -- start 2023-12-04T10:43:52.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.461+0000 7f9ce2687640 1 -- start start 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.461+0000 7f9ce2687640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cdc0701b0 0x7f9cdc13d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.461+0000 7f9ce2687640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc0ca290 0x7f9cdc13cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce2687640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc144a00 0x7f9cdc0c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce2687640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1f7490 con 0x7f9cdc144a00 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce2687640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc13d4a0 con 0x7f9cdc0701b0 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce2687640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cdc1f6910 con 0x7f9cdc0ca290 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce0c24640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc144a00 0x7f9cdc0c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce0c24640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc144a00 0x7f9cdc0c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:58086/0 (socket says 172.21.15.63:58086) 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce0c24640 1 -- 172.21.15.63:0/1656312758 learned_addr learned my addr 172.21.15.63:0/1656312758 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:52.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9cd3fff640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc0ca290 0x7f9cdc13cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9cdbfff640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cdc0701b0 0x7f9cdc13d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce0c24640 1 -- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc0ca290 msgr2=0x7f9cdc13cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce0c24640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc0ca290 0x7f9cdc13cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce0c24640 1 -- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cdc0701b0 msgr2=0x7f9cdc13d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce0c24640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cdc0701b0 0x7f9cdc13d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9ce0c24640 1 -- 172.21.15.63:0/1656312758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc40094d0 con 0x7f9cdc144a00 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.462+0000 7f9cdbfff640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cdc0701b0 0x7f9cdc13d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.463+0000 7f9ce0c24640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc144a00 0x7f9cdc0c81b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400cd20 tx=0x7f9cd400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.463+0000 7f9cd97fa640 1 -- 172.21.15.63:0/1656312758 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4003b90 con 0x7f9cdc144a00 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.463+0000 7f9cd97fa640 1 -- 172.21.15.63:0/1656312758 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd4003cf0 con 0x7f9cdc144a00 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.463+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cdc1f6bf0 con 0x7f9cdc144a00 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.463+0000 7f9cd97fa640 1 -- 172.21.15.63:0/1656312758 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4004240 con 0x7f9cdc144a00 2023-12-04T10:43:52.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.463+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cdc1f71b0 con 0x7f9cdc144a00 2023-12-04T10:43:52.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.464+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cdc068710 con 0x7f9cdc144a00 2023-12-04T10:43:52.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.465+0000 7f9cd97fa640 1 -- 172.21.15.63:0/1656312758 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9cd40043a0 con 0x7f9cdc144a00 2023-12-04T10:43:52.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.466+0000 7f9cd97fa640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9cbc06ae40 0x7f9cbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:52.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.466+0000 7f9cd97fa640 1 -- 172.21.15.63:0/1656312758 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9cd4012070 con 0x7f9cdc144a00 2023-12-04T10:43:52.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.466+0000 7f9cdbfff640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9cbc06ae40 0x7f9cbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:52.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.467+0000 7f9cdbfff640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9cbc06ae40 0x7f9cbc06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc006fd0 tx=0x7f9ccc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:52.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.472+0000 7f9cd97fa640 1 -- 172.21.15.63:0/1656312758 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9cd4055000 con 0x7f9cdc144a00 2023-12-04T10:43:52.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:52.703+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9cdc13ed00 con 0x7f9cdc144a00 2023-12-04T10:43:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.693+0000 7f9cd97fa640 1 -- 172.21.15.63:0/1656312758 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f9cd4058620 con 0x7f9cdc144a00 2023-12-04T10:43:53.694 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 2 and data pool 3 2023-12-04T10:43:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9cbc06ae40 msgr2=0x7f9cbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9cbc06ae40 0x7f9cbc06d300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc006fd0 tx=0x7f9ccc008040 comp rx=0 tx=0).stop 2023-12-04T10:43:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc144a00 msgr2=0x7f9cdc0c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:53.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc144a00 0x7f9cdc0c81b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9cd400cd20 tx=0x7f9cd400a660 comp rx=0 tx=0).stop 2023-12-04T10:43:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 shutdown_connections 2023-12-04T10:43:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9cbc06ae40 0x7f9cbc06d300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9cdc0ca290 0x7f9cdc13cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9cdc144a00 0x7f9cdc0c81b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 --2- 172.21.15.63:0/1656312758 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9cdc0701b0 0x7f9cdc13d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.697+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 >> 172.21.15.63:0/1656312758 conn(0x7f9cdc0cee80 msgr2=0x7f9cdc15b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.698+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 shutdown_connections 2023-12-04T10:43:53.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.698+0000 7f9ce2687640 1 -- 172.21.15.63:0/1656312758 wait complete. 2023-12-04T10:43:53.722 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-04T10:43:53.723 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-04T10:43:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.934+0000 7f3b7dbae640 1 Processor -- start 2023-12-04T10:43:53.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.934+0000 7f3b7dbae640 1 -- start start 2023-12-04T10:43:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.936+0000 7f3b7dbae640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b780aec80 0x7f3b7806a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.936+0000 7f3b7dbae640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b781407e0 0x7f3b78140c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.936+0000 7f3b7dbae640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b780ce5e0 con 0x7f3b7815c360 2023-12-04T10:43:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.936+0000 7f3b7dbae640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b780af060 con 0x7f3b780aec80 2023-12-04T10:43:53.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.936+0000 7f3b7dbae640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b780cb820 con 0x7f3b781407e0 2023-12-04T10:43:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.936+0000 7f3b7cbac640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3b780aec80 0x7f3b7806a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.936+0000 7f3b6ffff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3b7815c360 0x7f3b780cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33268/0 (socket says 172.21.15.63:33268) 2023-12-04T10:43:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.936+0000 7f3b6ffff640 1 -- 172.21.15.63:0/3652009276 learned_addr learned my addr 172.21.15.63:0/3652009276 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:43:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.937+0000 7f3b7d3ad640 1 --2- 172.21.15.63:0/3652009276 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b781407e0 0x7f3b78140c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.937+0000 7f3b7cbac640 1 -- 172.21.15.63:0/3652009276 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b781407e0 msgr2=0x7f3b78140c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.937+0000 7f3b7cbac640 1 --2- 172.21.15.63:0/3652009276 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b781407e0 0x7f3b78140c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.937+0000 7f3b7cbac640 1 -- 172.21.15.63:0/3652009276 >> v1:172.21.15.63:6789/0 conn(0x7f3b7815c360 legacy=0x7f3b780cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:53.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.937+0000 7f3b7cbac640 1 -- 172.21.15.63:0/3652009276 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b780ce8b0 con 0x7f3b780aec80 2023-12-04T10:43:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.938+0000 7f3b7cbac640 1 --2- 172.21.15.63:0/3652009276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780aec80 0x7f3b7806a450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009790 tx=0x7f3b6802b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d5e32977149fd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.938+0000 7f3b6f7fe640 1 -- 172.21.15.63:0/3652009276 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68031770 con 0x7f3b780aec80 2023-12-04T10:43:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.938+0000 7f3b6f7fe640 1 -- 172.21.15.63:0/3652009276 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b680318d0 con 0x7f3b780aec80 2023-12-04T10:43:53.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.938+0000 7f3b6f7fe640 1 -- 172.21.15.63:0/3652009276 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b68031c60 con 0x7f3b780aec80 2023-12-04T10:43:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.939+0000 7f3b7dbae640 1 -- 172.21.15.63:0/3652009276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780aec80 msgr2=0x7f3b7806a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.939+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/3652009276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780aec80 0x7f3b7806a450 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b68009790 tx=0x7f3b6802b810 comp rx=0 tx=0).stop 2023-12-04T10:43:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.939+0000 7f3b7dbae640 1 -- 172.21.15.63:0/3652009276 shutdown_connections 2023-12-04T10:43:53.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.939+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/3652009276 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b781407e0 0x7f3b78140c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.939+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/3652009276 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b780aec80 0x7f3b7806a450 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.939+0000 7f3b7dbae640 1 -- 172.21.15.63:0/3652009276 >> 172.21.15.63:0/3652009276 conn(0x7f3b780b1860 msgr2=0x7f3b780cf520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.939+0000 7f3b7dbae640 1 -- 172.21.15.63:0/3652009276 shutdown_connections 2023-12-04T10:43:53.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.939+0000 7f3b7dbae640 1 -- 172.21.15.63:0/3652009276 wait complete. 2023-12-04T10:43:53.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.943+0000 7f3b7dbae640 1 Processor -- start 2023-12-04T10:43:53.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.943+0000 7f3b7dbae640 1 -- start start 2023-12-04T10:43:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.945+0000 7f3b7dbae640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b780aec80 0x7f3b7813d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.945+0000 7f3b7dbae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b781407e0 0x7f3b7815dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.945+0000 7f3b7dbae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b7815c360 0x7f3b7806a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.945+0000 7f3b7dbae640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b78153200 con 0x7f3b781407e0 2023-12-04T10:43:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.945+0000 7f3b7dbae640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7813e430 con 0x7f3b7815c360 2023-12-04T10:43:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.945+0000 7f3b7dbae640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b7813df00 con 0x7f3b780aec80 2023-12-04T10:43:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b781407e0 0x7f3b7815dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:53.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b781407e0 0x7f3b7815dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39666/0 (socket says 172.21.15.63:39666) 2023-12-04T10:43:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b6ffff640 1 -- 172.21.15.63:0/300689343 learned_addr learned my addr 172.21.15.63:0/300689343 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b7cbac640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b780aec80 0x7f3b7813d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b7d3ad640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b7815c360 0x7f3b7806a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b6ffff640 1 -- 172.21.15.63:0/300689343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b780aec80 msgr2=0x7f3b7813d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b6ffff640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b780aec80 0x7f3b7813d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b6ffff640 1 -- 172.21.15.63:0/300689343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b7815c360 msgr2=0x7f3b7806a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b6ffff640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b7815c360 0x7f3b7806a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:53.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.946+0000 7f3b6ffff640 1 -- 172.21.15.63:0/300689343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b680093a0 con 0x7f3b781407e0 2023-12-04T10:43:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.947+0000 7f3b6ffff640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b781407e0 0x7f3b7815dde0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400c3c0 tx=0x7f3b7400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.947+0000 7f3b6d7fa640 1 -- 172.21.15.63:0/300689343 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b74005ce0 con 0x7f3b781407e0 2023-12-04T10:43:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.947+0000 7f3b6d7fa640 1 -- 172.21.15.63:0/300689343 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b74005e40 con 0x7f3b781407e0 2023-12-04T10:43:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.947+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b7815d3c0 con 0x7f3b781407e0 2023-12-04T10:43:53.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.947+0000 7f3b6d7fa640 1 -- 172.21.15.63:0/300689343 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b740072d0 con 0x7f3b781407e0 2023-12-04T10:43:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.947+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b78152b40 con 0x7f3b781407e0 2023-12-04T10:43:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.948+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b78153340 con 0x7f3b781407e0 2023-12-04T10:43:53.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.949+0000 7f3b6d7fa640 1 -- 172.21.15.63:0/300689343 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b74007430 con 0x7f3b781407e0 2023-12-04T10:43:53.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.950+0000 7f3b6d7fa640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3b6406ae70 0x7f3b6406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:53.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.950+0000 7f3b6d7fa640 1 -- 172.21.15.63:0/300689343 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b74088980 con 0x7f3b781407e0 2023-12-04T10:43:53.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.951+0000 7f3b7cbac640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3b6406ae70 0x7f3b6406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:53.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.951+0000 7f3b7cbac640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3b6406ae70 0x7f3b6406d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b68036000 tx=0x7f3b6803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:53.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:53.955+0000 7f3b6d7fa640 1 -- 172.21.15.63:0/300689343 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b78153340 con 0x7f3b781407e0 2023-12-04T10:43:54.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.165+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f3b78153340 con 0x7f3b781407e0 2023-12-04T10:43:54.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.976+0000 7f3b6d7fa640 1 -- 172.21.15.63:0/300689343 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v23) v1 ==== 157+0+0 (secure 0 0 0) 0x7f3b78153340 con 0x7f3b781407e0 2023-12-04T10:43:54.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.982+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3b6406ae70 msgr2=0x7f3b6406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:54.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.982+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3b6406ae70 0x7f3b6406d330 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b68036000 tx=0x7f3b6803d040 comp rx=0 tx=0).stop 2023-12-04T10:43:54.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.983+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b781407e0 msgr2=0x7f3b7815dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:54.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.983+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b781407e0 0x7f3b7815dde0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b7400c3c0 tx=0x7f3b7400c880 comp rx=0 tx=0).stop 2023-12-04T10:43:54.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.984+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 shutdown_connections 2023-12-04T10:43:54.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.984+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3b6406ae70 0x7f3b6406d330 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:54.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.984+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3b7815c360 0x7f3b7806a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:54.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.984+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3b781407e0 0x7f3b7815dde0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:54.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.984+0000 7f3b7dbae640 1 --2- 172.21.15.63:0/300689343 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3b780aec80 0x7f3b7813d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:54.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.984+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 >> 172.21.15.63:0/300689343 conn(0x7f3b780b1860 msgr2=0x7f3b7815a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:54.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.984+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 shutdown_connections 2023-12-04T10:43:54.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:54.984+0000 7f3b7dbae640 1 -- 172.21.15.63:0/300689343 wait complete. 2023-12-04T10:43:55.007 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T10:43:55.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.237+0000 7fb65a347640 1 Processor -- start 2023-12-04T10:43:55.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.237+0000 7fb65a347640 1 -- start start 2023-12-04T10:43:55.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.239+0000 7fb65a347640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb654151ca0 0x7fb65406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:55.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.239+0000 7fb65a347640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6540cc7f0 con 0x7fb65406e0b0 2023-12-04T10:43:55.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.239+0000 7fb65a347640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6540cca40 con 0x7fb65415b470 2023-12-04T10:43:55.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.239+0000 7fb65a347640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6540ccd20 con 0x7fb654151ca0 2023-12-04T10:43:55.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.239+0000 7fb659345640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb654151ca0 0x7fb65406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:55.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.239+0000 7fb659b46640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb65406e0b0 0x7fb654071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33270/0 (socket says 172.21.15.63:33270) 2023-12-04T10:43:55.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.239+0000 7fb659b46640 1 -- 172.21.15.63:0/141188873 learned_addr learned my addr 172.21.15.63:0/141188873 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:43:55.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.240+0000 7fb64bfff640 1 -- 172.21.15.63:0/141188873 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844360741 0 0) 0x7fb6540cc7f0 con 0x7fb65406e0b0 2023-12-04T10:43:55.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.240+0000 7fb64bfff640 1 -- 172.21.15.63:0/141188873 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb640003520 con 0x7fb65406e0b0 2023-12-04T10:43:55.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.240+0000 7fb659345640 1 -- 172.21.15.63:0/141188873 >> v1:172.21.15.66:6789/0 conn(0x7fb65415b470 legacy=0x7fb6540cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:55.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.240+0000 7fb659345640 1 -- 172.21.15.63:0/141188873 >> v1:172.21.15.63:6789/0 conn(0x7fb65406e0b0 legacy=0x7fb654071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:55.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.240+0000 7fb659345640 1 -- 172.21.15.63:0/141188873 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6540cd000 con 0x7fb654151ca0 2023-12-04T10:43:55.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.241+0000 7fb659345640 1 --2- 172.21.15.63:0/141188873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406db70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6500097a0 tx=0x7fb65002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4e031a46243444 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:55.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.241+0000 7fb64bfff640 1 -- 172.21.15.63:0/141188873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65002e070 con 0x7fb654151ca0 2023-12-04T10:43:55.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.241+0000 7fb64bfff640 1 -- 172.21.15.63:0/141188873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6500315a0 con 0x7fb654151ca0 2023-12-04T10:43:55.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.241+0000 7fb64bfff640 1 -- 172.21.15.63:0/141188873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb650031930 con 0x7fb654151ca0 2023-12-04T10:43:55.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.242+0000 7fb65a347640 1 -- 172.21.15.63:0/141188873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 msgr2=0x7fb65406db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:55.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.242+0000 7fb65a347640 1 --2- 172.21.15.63:0/141188873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406db70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb6500097a0 tx=0x7fb65002b840 comp rx=0 tx=0).stop 2023-12-04T10:43:55.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.242+0000 7fb65a347640 1 -- 172.21.15.63:0/141188873 shutdown_connections 2023-12-04T10:43:55.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.242+0000 7fb65a347640 1 --2- 172.21.15.63:0/141188873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406db70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:55.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.242+0000 7fb65a347640 1 -- 172.21.15.63:0/141188873 >> 172.21.15.63:0/141188873 conn(0x7fb6540b07f0 msgr2=0x7fb6540b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:55.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.242+0000 7fb65a347640 1 -- 172.21.15.63:0/141188873 shutdown_connections 2023-12-04T10:43:55.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.242+0000 7fb65a347640 1 -- 172.21.15.63:0/141188873 wait complete. 2023-12-04T10:43:55.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.244+0000 7fb65a347640 1 Processor -- start 2023-12-04T10:43:55.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.244+0000 7fb65a347640 1 -- start start 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.245+0000 7fb65a347640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb65406e0b0 0x7fb6540c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.245+0000 7fb65a347640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.245+0000 7fb65a347640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6540c5640 0x7fb654070510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.245+0000 7fb65a347640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6541f2cb0 con 0x7fb654151ca0 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.245+0000 7fb65a347640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c4380 con 0x7fb65406e0b0 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.245+0000 7fb65a347640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6540c2c50 con 0x7fb6540c5640 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39682/0 (socket says 172.21.15.63:39682) 2023-12-04T10:43:55.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 -- 172.21.15.63:0/779120565 learned_addr learned my addr 172.21.15.63:0/779120565 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 -- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6540c5640 msgr2=0x7fb654070510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb659345640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb65406e0b0 0x7fb6540c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb659b46640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6540c5640 0x7fb654070510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6540c5640 0x7fb654070510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 -- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb65406e0b0 msgr2=0x7fb6540c5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb65406e0b0 0x7fb6540c5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 -- 172.21.15.63:0/779120565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb650009400 con 0x7fb654151ca0 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb659345640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb65406e0b0 0x7fb6540c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.246+0000 7fb658b44640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406ffd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c400 tx=0x7fb64400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.247+0000 7fb649ffb640 1 -- 172.21.15.63:0/779120565 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6440052d0 con 0x7fb654151ca0 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.247+0000 7fb649ffb640 1 -- 172.21.15.63:0/779120565 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb644005430 con 0x7fb654151ca0 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.247+0000 7fb649ffb640 1 -- 172.21.15.63:0/779120565 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb644003830 con 0x7fb654151ca0 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.247+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6540c4620 con 0x7fb654151ca0 2023-12-04T10:43:55.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.247+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6540c4be0 con 0x7fb654151ca0 2023-12-04T10:43:55.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.248+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb65404e840 con 0x7fb654151ca0 2023-12-04T10:43:55.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.249+0000 7fb649ffb640 1 -- 172.21.15.63:0/779120565 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb644003990 con 0x7fb654151ca0 2023-12-04T10:43:55.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.250+0000 7fb649ffb640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb63806ae40 0x7fb63806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:55.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.250+0000 7fb649ffb640 1 -- 172.21.15.63:0/779120565 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5935+0+0 (secure 0 0 0) 0x7fb644088c80 con 0x7fb654151ca0 2023-12-04T10:43:55.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.250+0000 7fb659345640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb63806ae40 0x7fb63806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:55.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.251+0000 7fb659345640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb63806ae40 0x7fb63806d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb650036000 tx=0x7fb65003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:55.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.255+0000 7fb649ffb640 1 -- 172.21.15.63:0/779120565 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb644053c40 con 0x7fb654151ca0 2023-12-04T10:43:55.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:55.451+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb6540ce280 con 0x7fb654151ca0 2023-12-04T10:43:56.539 INFO:tasks.ceph.mds.d.smithi066.stderr:2023-12-04T10:43:56.538+0000 7fd77bef0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T10:43:57.012 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.011+0000 7fb649ffb640 1 -- 172.21.15.63:0/779120565 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v25) v1 ==== 228+0+0 (secure 0 0 0) 0x7fb644017100 con 0x7fb654151ca0 2023-12-04T10:43:57.012 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data_ec' created 2023-12-04T10:43:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.016+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb63806ae40 msgr2=0x7fb63806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.016+0000 7fb65a347640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb63806ae40 0x7fb63806d300 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb650036000 tx=0x7fb65003d040 comp rx=0 tx=0).stop 2023-12-04T10:43:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.016+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 msgr2=0x7fb65406ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.016+0000 7fb65a347640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406ffd0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fb64400c400 tx=0x7fb64400c8c0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.017+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 shutdown_connections 2023-12-04T10:43:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.017+0000 7fb65a347640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb63806ae40 0x7fb63806d300 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.017+0000 7fb65a347640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb6540c5640 0x7fb654070510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.017+0000 7fb65a347640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb654151ca0 0x7fb65406ffd0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.017+0000 7fb65a347640 1 --2- 172.21.15.63:0/779120565 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb65406e0b0 0x7fb6540c5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.017+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 >> 172.21.15.63:0/779120565 conn(0x7fb6540b07f0 msgr2=0x7fb654071c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.017+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 shutdown_connections 2023-12-04T10:43:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.018+0000 7fb65a347640 1 -- 172.21.15.63:0/779120565 wait complete. 2023-12-04T10:43:57.045 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-04T10:43:57.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.241+0000 7fabb359e640 1 Processor -- start 2023-12-04T10:43:57.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.242+0000 7fabb359e640 1 -- start start 2023-12-04T10:43:57.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.243+0000 7fabb359e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fabb40b20c0 0x7fabb40cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fabb359e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fabb406d700 0x7fabb4164a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fabb359e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabb40ce6a0 con 0x7fabb40cbb30 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fabb359e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb40ce0e0 con 0x7fabb40b20c0 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fabb359e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabb40ce3c0 con 0x7fabb406d700 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fababfff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fabb40cbb30 0x7fabb40b24a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33282/0 (socket says 172.21.15.63:33282) 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fababfff640 1 -- 172.21.15.63:0/3386840684 learned_addr learned my addr 172.21.15.63:0/3386840684 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fabb259c640 1 --2- 172.21.15.63:0/3386840684 >> v2:172.21.15.63:3300/0 conn(0x7fabb40b20c0 0x7fabb40cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fabb2d9d640 1 --2- 172.21.15.63:0/3386840684 >> v2:172.21.15.66:3300/0 conn(0x7fabb406d700 0x7fabb4164a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.244+0000 7fabb1d9b640 1 -- 172.21.15.63:0/3386840684 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080645655 0 0) 0x7fabb40ce6a0 con 0x7fabb40cbb30 2023-12-04T10:43:57.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.245+0000 7fabb1d9b640 1 -- 172.21.15.63:0/3386840684 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faba0003520 con 0x7fabb40cbb30 2023-12-04T10:43:57.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.245+0000 7fabb259c640 1 -- 172.21.15.63:0/3386840684 >> v2:172.21.15.66:3300/0 conn(0x7fabb406d700 msgr2=0x7fabb4164a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:57.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.245+0000 7fabb259c640 1 --2- 172.21.15.63:0/3386840684 >> v2:172.21.15.66:3300/0 conn(0x7fabb406d700 0x7fabb4164a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.245+0000 7fabb259c640 1 -- 172.21.15.63:0/3386840684 >> v1:172.21.15.63:6789/0 conn(0x7fabb40cbb30 legacy=0x7fabb40b24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:57.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.245+0000 7fabb259c640 1 -- 172.21.15.63:0/3386840684 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb406bef0 con 0x7fabb40b20c0 2023-12-04T10:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.246+0000 7fabb259c640 1 --2- 172.21.15.63:0/3386840684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb40cb5f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabb4144d50 tx=0x7faba402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75434a21546452b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.246+0000 7fabb1d9b640 1 -- 172.21.15.63:0/3386840684 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba402e070 con 0x7fabb40b20c0 2023-12-04T10:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.246+0000 7fabb1d9b640 1 -- 172.21.15.63:0/3386840684 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faba40315a0 con 0x7fabb40b20c0 2023-12-04T10:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.246+0000 7fabb1d9b640 1 -- 172.21.15.63:0/3386840684 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faba4031910 con 0x7fabb40b20c0 2023-12-04T10:43:57.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.247+0000 7fabb359e640 1 -- 172.21.15.63:0/3386840684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 msgr2=0x7fabb40cb5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.247+0000 7fabb359e640 1 --2- 172.21.15.63:0/3386840684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb40cb5f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fabb4144d50 tx=0x7faba402b840 comp rx=0 tx=0).stop 2023-12-04T10:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.247+0000 7fabb359e640 1 -- 172.21.15.63:0/3386840684 shutdown_connections 2023-12-04T10:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.247+0000 7fabb359e640 1 --2- 172.21.15.63:0/3386840684 >> v2:172.21.15.66:3300/0 conn(0x7fabb406d700 0x7fabb4164a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.247+0000 7fabb359e640 1 --2- 172.21.15.63:0/3386840684 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb40cb5f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.247+0000 7fabb359e640 1 -- 172.21.15.63:0/3386840684 >> 172.21.15.63:0/3386840684 conn(0x7fabb40b07f0 msgr2=0x7fabb40b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.247+0000 7fabb359e640 1 -- 172.21.15.63:0/3386840684 shutdown_connections 2023-12-04T10:43:57.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.247+0000 7fabb359e640 1 -- 172.21.15.63:0/3386840684 wait complete. 2023-12-04T10:43:57.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.249+0000 7fabb359e640 1 Processor -- start 2023-12-04T10:43:57.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.249+0000 7fabb359e640 1 -- start start 2023-12-04T10:43:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fabb359e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fabb406d700 0x7fabb41e5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fabb359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb413ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fabb359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabb40cbb30 0x7fabb41f66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fabb359e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41f7530 con 0x7fabb40b20c0 2023-12-04T10:43:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fabb359e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41e5b50 con 0x7fabb40cbb30 2023-12-04T10:43:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fabb359e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabb41f3180 con 0x7fabb406d700 2023-12-04T10:43:57.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fababfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb413ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:57.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fababfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb413ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39694/0 (socket says 172.21.15.63:39694) 2023-12-04T10:43:57.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fababfff640 1 -- 172.21.15.63:0/455747878 learned_addr learned my addr 172.21.15.63:0/455747878 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:57.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fabb2d9d640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabb40cbb30 0x7fabb41f66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:57.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.250+0000 7fabb259c640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fabb406d700 0x7fabb41e5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:57.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fababfff640 1 -- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fabb406d700 msgr2=0x7fabb41e5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:57.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fababfff640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fabb406d700 0x7fabb41e5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fababfff640 1 -- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabb40cbb30 msgr2=0x7fabb41f66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fababfff640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabb40cbb30 0x7fabb41f66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fababfff640 1 -- 172.21.15.63:0/455747878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faba4009400 con 0x7fabb40b20c0 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fabb259c640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fabb406d700 0x7fabb41e5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fabb2d9d640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabb40cbb30 0x7fabb41f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fababfff640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb413ec30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c430 tx=0x7fab9c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fabaaffd640 1 -- 172.21.15.63:0/455747878 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c005ce0 con 0x7fabb40b20c0 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fabaaffd640 1 -- 172.21.15.63:0/455747878 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9c005e40 con 0x7fabb40b20c0 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fabaaffd640 1 -- 172.21.15.63:0/455747878 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9c0072f0 con 0x7fabb40b20c0 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb413fd20 con 0x7fabb40b20c0 2023-12-04T10:43:57.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.251+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabb4141e90 con 0x7fabb40b20c0 2023-12-04T10:43:57.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.253+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabb40b28f0 con 0x7fabb40b20c0 2023-12-04T10:43:57.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.254+0000 7fabaaffd640 1 -- 172.21.15.63:0/455747878 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fab9c007450 con 0x7fabb40b20c0 2023-12-04T10:43:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.255+0000 7fabaaffd640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fab9406ae40 0x7fab9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.255+0000 7fabaaffd640 1 -- 172.21.15.63:0/455747878 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fab9c088f80 con 0x7fabb40b20c0 2023-12-04T10:43:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.255+0000 7fabb259c640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fab9406ae40 0x7fab9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:57.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.256+0000 7fabb259c640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fab9406ae40 0x7fab9406d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faba4036000 tx=0x7faba403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:57.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.260+0000 7fabaaffd640 1 -- 172.21.15.63:0/455747878 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fab9c053d50 con 0x7fabb40b20c0 2023-12-04T10:43:57.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:57.452+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fabb40b24a0 con 0x7fabb40b20c0 2023-12-04T10:43:58.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.015+0000 7fabaaffd640 1 -- 172.21.15.63:0/455747878 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7fab9c017020 con 0x7fabb40b20c0 2023-12-04T10:43:58.017 INFO:teuthology.orchestra.run.smithi063.stderr:set pool 4 allow_ec_overwrites to true 2023-12-04T10:43:58.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.020+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fab9406ae40 msgr2=0x7fab9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:58.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.020+0000 7fabb359e640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fab9406ae40 0x7fab9406d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faba4036000 tx=0x7faba403d040 comp rx=0 tx=0).stop 2023-12-04T10:43:58.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.020+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 msgr2=0x7fabb413ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:58.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.020+0000 7fabb359e640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb413ec30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fab9c00c430 tx=0x7fab9c00c8f0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.022+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 shutdown_connections 2023-12-04T10:43:58.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.022+0000 7fabb359e640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fab9406ae40 0x7fab9406d300 secure :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7faba4036000 tx=0x7faba403d040 comp rx=0 tx=0).stop 2023-12-04T10:43:58.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.022+0000 7fabb359e640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabb40cbb30 0x7fabb41f66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.022+0000 7fabb359e640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabb40b20c0 0x7fabb413ec30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.022+0000 7fabb359e640 1 --2- 172.21.15.63:0/455747878 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fabb406d700 0x7fabb41e5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.022+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 >> 172.21.15.63:0/455747878 conn(0x7fabb40b07f0 msgr2=0x7fabb40af080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:58.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.024+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 shutdown_connections 2023-12-04T10:43:58.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.025+0000 7fabb359e640 1 -- 172.21.15.63:0/455747878 wait complete. 2023-12-04T10:43:58.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-04T10:43:58.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.255+0000 7f1a644f3640 1 Processor -- start 2023-12-04T10:43:58.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.255+0000 7f1a644f3640 1 -- start start 2023-12-04T10:43:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.256+0000 7f1a644f3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1a5c15d5d0 0x7f1a5c0d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.256+0000 7f1a644f3640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a5c0d1fb0 0x7f1a5c0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.256+0000 7f1a644f3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c0b2710 con 0x7f1a5c0ce8e0 2023-12-04T10:43:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.256+0000 7f1a644f3640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c0ced70 con 0x7f1a5c0d1fb0 2023-12-04T10:43:58.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.256+0000 7f1a644f3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c0cf050 con 0x7f1a5c15d5d0 2023-12-04T10:43:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.256+0000 7f1a62a90640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a5c0d1fb0 0x7f1a5c0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.257+0000 7f1a62a90640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1a5c0d1fb0 0x7f1a5c0b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39706/0 (socket says 172.21.15.63:39706) 2023-12-04T10:43:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.257+0000 7f1a62a90640 1 -- 172.21.15.63:0/2592291963 learned_addr learned my addr 172.21.15.63:0/2592291963 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:58.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.257+0000 7f1a6228f640 1 --2- 172.21.15.63:0/2592291963 >> v2:172.21.15.66:3300/0 conn(0x7f1a5c15d5d0 0x7f1a5c0d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:58.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.257+0000 7f1a62a90640 1 -- 172.21.15.63:0/2592291963 >> v2:172.21.15.66:3300/0 conn(0x7f1a5c15d5d0 msgr2=0x7f1a5c0d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:58.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.257+0000 7f1a62a90640 1 --2- 172.21.15.63:0/2592291963 >> v2:172.21.15.66:3300/0 conn(0x7f1a5c15d5d0 0x7f1a5c0d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.257+0000 7f1a62a90640 1 -- 172.21.15.63:0/2592291963 >> v1:172.21.15.66:6789/0 conn(0x7f1a5c0ce8e0 legacy=0x7f1a5c0d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:58.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.257+0000 7f1a62a90640 1 -- 172.21.15.63:0/2592291963 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0b2960 con 0x7f1a5c0d1fb0 2023-12-04T10:43:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.258+0000 7f1a62a90640 1 --2- 172.21.15.63:0/2592291963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c0d1fb0 0x7f1a5c0b3160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c08da80 tx=0x7f1a5402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f06c95f0902131c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.258+0000 7f1a6128d640 1 -- 172.21.15.63:0/2592291963 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5402ca80 con 0x7f1a5c0d1fb0 2023-12-04T10:43:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.258+0000 7f1a6128d640 1 -- 172.21.15.63:0/2592291963 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5402cbe0 con 0x7f1a5c0d1fb0 2023-12-04T10:43:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.258+0000 7f1a6128d640 1 -- 172.21.15.63:0/2592291963 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a540343f0 con 0x7f1a5c0d1fb0 2023-12-04T10:43:58.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.259+0000 7f1a644f3640 1 -- 172.21.15.63:0/2592291963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c0d1fb0 msgr2=0x7f1a5c0b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.259+0000 7f1a644f3640 1 --2- 172.21.15.63:0/2592291963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c0d1fb0 0x7f1a5c0b3160 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c08da80 tx=0x7f1a5402bee0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.259+0000 7f1a644f3640 1 -- 172.21.15.63:0/2592291963 shutdown_connections 2023-12-04T10:43:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.259+0000 7f1a644f3640 1 --2- 172.21.15.63:0/2592291963 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c0d1fb0 0x7f1a5c0b3160 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.259+0000 7f1a644f3640 1 --2- 172.21.15.63:0/2592291963 >> v2:172.21.15.66:3300/0 conn(0x7f1a5c15d5d0 0x7f1a5c0d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.259+0000 7f1a644f3640 1 -- 172.21.15.63:0/2592291963 >> 172.21.15.63:0/2592291963 conn(0x7f1a5c09c600 msgr2=0x7f1a5c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.259+0000 7f1a644f3640 1 -- 172.21.15.63:0/2592291963 shutdown_connections 2023-12-04T10:43:58.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.259+0000 7f1a644f3640 1 -- 172.21.15.63:0/2592291963 wait complete. 2023-12-04T10:43:58.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.261+0000 7f1a644f3640 1 Processor -- start 2023-12-04T10:43:58.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.261+0000 7f1a644f3640 1 -- start start 2023-12-04T10:43:58.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a644f3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a5c0d1fb0 0x7f1a5c0ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:58.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a644f3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5c15d5d0 0x7f1a5c15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a644f3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c15b630 0x7f1a5c0cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a644f3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0cae40 con 0x7f1a5c15b630 2023-12-04T10:43:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a644f3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b7000 con 0x7f1a5c15d5d0 2023-12-04T10:43:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a644f3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b72e0 con 0x7f1a5c0d1fb0 2023-12-04T10:43:58.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a62a90640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c15b630 0x7f1a5c0cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:58.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a62a90640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c15b630 0x7f1a5c0cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39710/0 (socket says 172.21.15.63:39710) 2023-12-04T10:43:58.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.262+0000 7f1a62a90640 1 -- 172.21.15.63:0/794905971 learned_addr learned my addr 172.21.15.63:0/794905971 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:58.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a6228f640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a5c0d1fb0 0x7f1a5c0ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:58.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a61a8e640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5c15d5d0 0x7f1a5c15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:58.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a62a90640 1 -- 172.21.15.63:0/794905971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a5c0d1fb0 msgr2=0x7f1a5c0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:58.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a62a90640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a5c0d1fb0 0x7f1a5c0ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a62a90640 1 -- 172.21.15.63:0/794905971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5c15d5d0 msgr2=0x7f1a5c15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:58.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a62a90640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5c15d5d0 0x7f1a5c15ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:58.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a62a90640 1 -- 172.21.15.63:0/794905971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a54009b30 con 0x7f1a5c15b630 2023-12-04T10:43:58.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a62a90640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c15b630 0x7f1a5c0cb5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a54036040 tx=0x7f1a54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:58.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.263+0000 7f1a52ffd640 1 -- 172.21.15.63:0/794905971 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5403e450 con 0x7f1a5c15b630 2023-12-04T10:43:58.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.264+0000 7f1a52ffd640 1 -- 172.21.15.63:0/794905971 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5403e5d0 con 0x7f1a5c15b630 2023-12-04T10:43:58.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.264+0000 7f1a52ffd640 1 -- 172.21.15.63:0/794905971 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5403e980 con 0x7f1a5c15b630 2023-12-04T10:43:58.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.264+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c0cb0b0 con 0x7f1a5c15b630 2023-12-04T10:43:58.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.264+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c15b2b0 con 0x7f1a5c15b630 2023-12-04T10:43:58.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.265+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c068710 con 0x7f1a5c15b630 2023-12-04T10:43:58.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.266+0000 7f1a52ffd640 1 -- 172.21.15.63:0/794905971 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a5402cd50 con 0x7f1a5c15b630 2023-12-04T10:43:58.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.267+0000 7f1a52ffd640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1a4006ae40 0x7f1a4006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:58.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.267+0000 7f1a52ffd640 1 -- 172.21.15.63:0/794905971 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 6428+0+0 (secure 0 0 0) 0x7f1a540ac5c0 con 0x7f1a5c15b630 2023-12-04T10:43:58.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.268+0000 7f1a6228f640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1a4006ae40 0x7f1a4006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:58.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.268+0000 7f1a6228f640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1a4006ae40 0x7f1a4006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a58006fd0 tx=0x7f1a58008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:58.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.272+0000 7f1a52ffd640 1 -- 172.21.15.63:0/794905971 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a54077440 con 0x7f1a5c15b630 2023-12-04T10:43:58.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:58.509+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7f1a5c0ce060 con 0x7f1a5c15b630 2023-12-04T10:43:59.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.047+0000 7f1a52ffd640 1 -- 172.21.15.63:0/794905971 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v7) v1 ==== 137+0+0 (secure 0 0 0) 0x7f1a5407aa60 con 0x7f1a5c15b630 2023-12-04T10:43:59.048 INFO:teuthology.orchestra.run.smithi063.stderr:added data pool 4 to fsmap 2023-12-04T10:43:59.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1a4006ae40 msgr2=0x7f1a4006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1a4006ae40 0x7f1a4006d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1a58006fd0 tx=0x7f1a58008040 comp rx=0 tx=0).stop 2023-12-04T10:43:59.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c15b630 msgr2=0x7f1a5c0cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c15b630 0x7f1a5c0cb5d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1a54036040 tx=0x7f1a54004a40 comp rx=0 tx=0).stop 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 shutdown_connections 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1a4006ae40 0x7f1a4006d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1a5c15b630 0x7f1a5c0cb5d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1a5c15d5d0 0x7f1a5c15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 --2- 172.21.15.63:0/794905971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1a5c0d1fb0 0x7f1a5c0ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.051+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 >> 172.21.15.63:0/794905971 conn(0x7f1a5c09c600 msgr2=0x7f1a5c0d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.052+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 shutdown_connections 2023-12-04T10:43:59.053 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.052+0000 7f1a644f3640 1 -- 172.21.15.63:0/794905971 wait complete. 2023-12-04T10:43:59.073 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:43:59.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.291+0000 7f2b7aa1a640 1 Processor -- start 2023-12-04T10:43:59.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.292+0000 7f2b7aa1a640 1 -- start start 2023-12-04T10:43:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.293+0000 7f2b7aa1a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2b74151ca0 0x7f2b7406db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.293+0000 7f2b7aa1a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b7415b470 0x7f2b740cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.293+0000 7f2b7aa1a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b740cc7f0 con 0x7f2b7406e0b0 2023-12-04T10:43:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.293+0000 7f2b7aa1a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b740cca40 con 0x7f2b74151ca0 2023-12-04T10:43:59.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.293+0000 7f2b7aa1a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740ccd20 con 0x7f2b7415b470 2023-12-04T10:43:59.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.294+0000 7f2b79a18640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2b74151ca0 0x7f2b7406db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.294+0000 7f2b79217640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b7415b470 0x7f2b740cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.294+0000 7f2b79217640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b7415b470 0x7f2b740cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:49886/0 (socket says 172.21.15.63:49886) 2023-12-04T10:43:59.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.294+0000 7f2b79217640 1 -- 172.21.15.63:0/4023327775 learned_addr learned my addr 172.21.15.63:0/4023327775 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.295+0000 7f2b79217640 1 -- 172.21.15.63:0/4023327775 >> v2:172.21.15.66:3300/0 conn(0x7f2b74151ca0 msgr2=0x7f2b7406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.295+0000 7f2b79217640 1 --2- 172.21.15.63:0/4023327775 >> v2:172.21.15.66:3300/0 conn(0x7f2b74151ca0 0x7f2b7406db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.295+0000 7f2b79217640 1 -- 172.21.15.63:0/4023327775 >> v1:172.21.15.66:6789/0 conn(0x7f2b7406e0b0 legacy=0x7f2b74071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.295+0000 7f2b79217640 1 -- 172.21.15.63:0/4023327775 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b740cd000 con 0x7f2b7415b470 2023-12-04T10:43:59.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.296+0000 7f2b79217640 1 --2- 172.21.15.63:0/4023327775 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b7415b470 0x7f2b740cb570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009870 tx=0x7f2b6402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f4efd1a58640ad server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.297+0000 7f2b78a16640 1 -- 172.21.15.63:0/4023327775 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64031640 con 0x7f2b7415b470 2023-12-04T10:43:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.297+0000 7f2b78a16640 1 -- 172.21.15.63:0/4023327775 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b640317a0 con 0x7f2b7415b470 2023-12-04T10:43:59.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.297+0000 7f2b78a16640 1 -- 172.21.15.63:0/4023327775 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64031b30 con 0x7f2b7415b470 2023-12-04T10:43:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.298+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/4023327775 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b7415b470 msgr2=0x7f2b740cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.298+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/4023327775 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b7415b470 0x7f2b740cb570 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009870 tx=0x7f2b6402b8f0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.298+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/4023327775 shutdown_connections 2023-12-04T10:43:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.298+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/4023327775 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b7415b470 0x7f2b740cb570 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.298+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/4023327775 >> v2:172.21.15.66:3300/0 conn(0x7f2b74151ca0 0x7f2b7406db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.298+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/4023327775 >> 172.21.15.63:0/4023327775 conn(0x7f2b740b07f0 msgr2=0x7f2b740b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.298+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/4023327775 shutdown_connections 2023-12-04T10:43:59.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.298+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/4023327775 wait complete. 2023-12-04T10:43:59.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.300+0000 7f2b7aa1a640 1 Processor -- start 2023-12-04T10:43:59.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.300+0000 7f2b7aa1a640 1 -- start start 2023-12-04T10:43:59.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7aa1a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b7406e0b0 0x7f2b740c8640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7aa1a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b74151ca0 0x7f2b741e2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7aa1a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b7414d5f0 0x7f2b740b38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7aa1a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740c8b80 con 0x7f2b7414d5f0 2023-12-04T10:43:59.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7aa1a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740c75a0 con 0x7f2b7406e0b0 2023-12-04T10:43:59.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7aa1a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b740c7880 con 0x7f2b74151ca0 2023-12-04T10:43:59.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7a219640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b7414d5f0 0x7f2b740b38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7a219640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b7414d5f0 0x7f2b740b38c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39714/0 (socket says 172.21.15.63:39714) 2023-12-04T10:43:59.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b7a219640 1 -- 172.21.15.63:0/3656477168 learned_addr learned my addr 172.21.15.63:0/3656477168 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:59.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b79217640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b74151ca0 0x7f2b741e2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.302+0000 7f2b79a18640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b7406e0b0 0x7f2b740c8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b7a219640 1 -- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b74151ca0 msgr2=0x7f2b741e2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b7a219640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b74151ca0 0x7f2b741e2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b7a219640 1 -- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b7406e0b0 msgr2=0x7f2b740c8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b7a219640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b7406e0b0 0x7f2b740c8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b7a219640 1 -- 172.21.15.63:0/3656477168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b640094d0 con 0x7f2b7414d5f0 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b79a18640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b7406e0b0 0x7f2b740c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b7a219640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b7414d5f0 0x7f2b740b38c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c730 tx=0x7f2b6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b6a7fc640 1 -- 172.21.15.63:0/3656477168 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c006d50 con 0x7f2b7414d5f0 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b6a7fc640 1 -- 172.21.15.63:0/3656477168 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00ce40 con 0x7f2b7414d5f0 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b740c7b60 con 0x7f2b7414d5f0 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b6a7fc640 1 -- 172.21.15.63:0/3656477168 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c003bb0 con 0x7f2b7414d5f0 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.303+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b740c8120 con 0x7f2b7414d5f0 2023-12-04T10:43:59.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.304+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b740c8310 con 0x7f2b7414d5f0 2023-12-04T10:43:59.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.305+0000 7f2b6a7fc640 1 -- 172.21.15.63:0/3656477168 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2b6c003d10 con 0x7f2b7414d5f0 2023-12-04T10:43:59.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.306+0000 7f2b6a7fc640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2b5806ae70 0x7f2b5806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.306+0000 7f2b6a7fc640 1 -- 172.21.15.63:0/3656477168 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2b6c089470 con 0x7f2b7414d5f0 2023-12-04T10:43:59.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.307+0000 7f2b79a18640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2b5806ae70 0x7f2b5806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.307+0000 7f2b79a18640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2b5806ae70 0x7f2b5806d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009b90 tx=0x7f2b70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:59.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.311+0000 7f2b6a7fc640 1 -- 172.21.15.63:0/3656477168 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2b6c054220 con 0x7f2b7414d5f0 2023-12-04T10:43:59.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.548+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b7404e840 con 0x7f2b7414d5f0 2023-12-04T10:43:59.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.549+0000 7f2b6a7fc640 1 -- 172.21.15.63:0/3656477168 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f2b6c057840 con 0x7f2b7414d5f0 2023-12-04T10:43:59.551 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:43:59.551 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:43:58.511386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-04T10:43:59.551 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2023-12-04T10:43:59.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2b5806ae70 msgr2=0x7f2b5806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2b5806ae70 0x7f2b5806d330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009b90 tx=0x7f2b70008040 comp rx=0 tx=0).stop 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b7414d5f0 msgr2=0x7f2b740b38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b7414d5f0 0x7f2b740b38c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c00c730 tx=0x7f2b6c00cbf0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 shutdown_connections 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2b5806ae70 0x7f2b5806d330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2b74151ca0 0x7f2b741e2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2b7414d5f0 0x7f2b740b38c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 --2- 172.21.15.63:0/3656477168 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2b7406e0b0 0x7f2b740c8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 >> 172.21.15.63:0/3656477168 conn(0x7f2b740b07f0 msgr2=0x7f2b74071b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 shutdown_connections 2023-12-04T10:43:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.552+0000 7f2b7aa1a640 1 -- 172.21.15.63:0/3656477168 wait complete. 2023-12-04T10:43:59.573 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:43:59.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.800+0000 7f94428d4640 1 Processor -- start 2023-12-04T10:43:59.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.801+0000 7f94428d4640 1 -- start start 2023-12-04T10:43:59.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.802+0000 7f94428d4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c15b1e0 0x7f943c0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.802+0000 7f94428d4640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f943c0caba0 0x7f943c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.802+0000 7f94428d4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f943c071600 0x7f943c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.802+0000 7f94428d4640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c15aa30 con 0x7f943c0caba0 2023-12-04T10:43:59.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.802+0000 7f94428d4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f943c0cb000 con 0x7f943c071600 2023-12-04T10:43:59.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.802+0000 7f94428d4640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c15b5c0 con 0x7f943c15b1e0 2023-12-04T10:43:59.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943b7fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f943c0caba0 0x7f943c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943b7fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f943c0caba0 0x7f943c0710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39724/0 (socket says 172.21.15.63:39724) 2023-12-04T10:43:59.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943b7fe640 1 -- 172.21.15.63:0/1594058892 learned_addr learned my addr 172.21.15.63:0/1594058892 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:59.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f9440e71640 1 --2- 172.21.15.63:0/1594058892 >> v2:172.21.15.66:3300/0 conn(0x7f943c071600 0x7f943c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943bfff640 1 --2- 172.21.15.63:0/1594058892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c15b1e0 0x7f943c0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943b7fe640 1 -- 172.21.15.63:0/1594058892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c15b1e0 msgr2=0x7f943c0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943b7fe640 1 --2- 172.21.15.63:0/1594058892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c15b1e0 0x7f943c0ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943b7fe640 1 -- 172.21.15.63:0/1594058892 >> v2:172.21.15.66:3300/0 conn(0x7f943c071600 msgr2=0x7f943c0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:43:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943b7fe640 1 --2- 172.21.15.63:0/1594058892 >> v2:172.21.15.66:3300/0 conn(0x7f943c071600 0x7f943c0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.803+0000 7f943b7fe640 1 -- 172.21.15.63:0/1594058892 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f943c071dd0 con 0x7f943c0caba0 2023-12-04T10:43:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.804+0000 7f943b7fe640 1 --2- 172.21.15.63:0/1594058892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c0710c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f943c15b870 tx=0x7f942402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c9b4358d858b3c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f943affd640 1 -- 172.21.15.63:0/1594058892 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424031870 con 0x7f943c0caba0 2023-12-04T10:43:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f943affd640 1 -- 172.21.15.63:0/1594058892 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94240319d0 con 0x7f943c0caba0 2023-12-04T10:43:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f943affd640 1 -- 172.21.15.63:0/1594058892 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424031d60 con 0x7f943c0caba0 2023-12-04T10:43:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 -- 172.21.15.63:0/1594058892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 msgr2=0x7f943c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 --2- 172.21.15.63:0/1594058892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c0710c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f943c15b870 tx=0x7f942402b910 comp rx=0 tx=0).stop 2023-12-04T10:43:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 -- 172.21.15.63:0/1594058892 shutdown_connections 2023-12-04T10:43:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 --2- 172.21.15.63:0/1594058892 >> v2:172.21.15.66:3300/0 conn(0x7f943c071600 0x7f943c0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 --2- 172.21.15.63:0/1594058892 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c0710c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 --2- 172.21.15.63:0/1594058892 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c15b1e0 0x7f943c0ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 -- 172.21.15.63:0/1594058892 >> 172.21.15.63:0/1594058892 conn(0x7f943c0cee80 msgr2=0x7f943c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:43:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 -- 172.21.15.63:0/1594058892 shutdown_connections 2023-12-04T10:43:59.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.805+0000 7f94428d4640 1 -- 172.21.15.63:0/1594058892 wait complete. 2023-12-04T10:43:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.807+0000 7f94428d4640 1 Processor -- start 2023-12-04T10:43:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.807+0000 7f94428d4640 1 -- start start 2023-12-04T10:43:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.808+0000 7f94428d4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c071600 0x7f943c159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.808+0000 7f94428d4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c1f6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f94428d4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f943c15b1e0 0x7f943c1f2230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f94428d4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c1f6ea0 con 0x7f943c0caba0 2023-12-04T10:43:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f94428d4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f943c14ab60 con 0x7f943c15b1e0 2023-12-04T10:43:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f94428d4640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943c0c46b0 con 0x7f943c071600 2023-12-04T10:43:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f943b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c1f6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f943b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c1f6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39726/0 (socket says 172.21.15.63:39726) 2023-12-04T10:43:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f943b7fe640 1 -- 172.21.15.63:0/4004302141 learned_addr learned my addr 172.21.15.63:0/4004302141 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:43:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f943b7fe640 1 -- 172.21.15.63:0/4004302141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c071600 msgr2=0x7f943c159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f943b7fe640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c071600 0x7f943c159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f943b7fe640 1 -- 172.21.15.63:0/4004302141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f943c15b1e0 msgr2=0x7f943c1f2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:43:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f943b7fe640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f943c15b1e0 0x7f943c1f2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:43:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.809+0000 7f943b7fe640 1 -- 172.21.15.63:0/4004302141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94240094d0 con 0x7f943c0caba0 2023-12-04T10:43:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.810+0000 7f943b7fe640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c1f6960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f942402b950 tx=0x7f94240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.810+0000 7f9438ff9640 1 -- 172.21.15.63:0/4004302141 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942403abe0 con 0x7f943c0caba0 2023-12-04T10:43:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.810+0000 7f9438ff9640 1 -- 172.21.15.63:0/4004302141 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f942403ad40 con 0x7f943c0caba0 2023-12-04T10:43:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.810+0000 7f9438ff9640 1 -- 172.21.15.63:0/4004302141 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424044610 con 0x7f943c0caba0 2023-12-04T10:43:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.810+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f943c1514e0 con 0x7f943c0caba0 2023-12-04T10:43:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.810+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f943c151780 con 0x7f943c0caba0 2023-12-04T10:43:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.811+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f943c151970 con 0x7f943c0caba0 2023-12-04T10:43:59.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.812+0000 7f9438ff9640 1 -- 172.21.15.63:0/4004302141 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9424044770 con 0x7f943c0caba0 2023-12-04T10:43:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.813+0000 7f9438ff9640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f941c06ae40 0x7f941c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:43:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.813+0000 7f9438ff9640 1 -- 172.21.15.63:0/4004302141 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f942402d040 con 0x7f943c0caba0 2023-12-04T10:43:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.814+0000 7f943bfff640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f941c06ae40 0x7f941c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:43:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.814+0000 7f943bfff640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f941c06ae40 0x7f941c06d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f942c0070b0 tx=0x7f942c007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:43:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:43:59.818+0000 7f9438ff9640 1 -- 172.21.15.63:0/4004302141 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9424076d10 con 0x7f943c0caba0 2023-12-04T10:44:00.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.015+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f943c068710 con 0x7f943c0caba0 2023-12-04T10:44:00.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.018+0000 7f9438ff9640 1 -- 172.21.15.63:0/4004302141 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f942407a330 con 0x7f943c0caba0 2023-12-04T10:44:00.020 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:00.020 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f941c06ae40 msgr2=0x7f941c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f941c06ae40 0x7f941c06d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f942c0070b0 tx=0x7f942c007040 comp rx=0 tx=0).stop 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 msgr2=0x7f943c1f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c1f6960 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f942402b950 tx=0x7f94240046c0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 shutdown_connections 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f941c06ae40 0x7f941c06d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f943c15b1e0 0x7f943c1f2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f943c0caba0 0x7f943c1f6960 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 --2- 172.21.15.63:0/4004302141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f943c071600 0x7f943c159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 >> 172.21.15.63:0/4004302141 conn(0x7f943c0cee80 msgr2=0x7f943c0cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 shutdown_connections 2023-12-04T10:44:00.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.022+0000 7f94428d4640 1 -- 172.21.15.63:0/4004302141 wait complete. 2023-12-04T10:44:00.043 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:00.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.263+0000 7f8e81a21640 1 Processor -- start 2023-12-04T10:44:00.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.263+0000 7f8e81a21640 1 -- start start 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.264+0000 7f8e81a21640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8e7c15d350 0x7f8e7c0d3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e81a21640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c15d730 0x7f8e7c0d1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e81a21640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e7c0cdce0 con 0x7f8e7c0d0f40 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e81a21640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e7c0d0530 con 0x7f8e7c15d350 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e81a21640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c0c7cc0 con 0x7f8e7c15d730 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e80a1f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8e7c15d350 0x7f8e7c0d3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e81220640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8e7c0d0f40 0x7f8e7c0b3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33290/0 (socket says 172.21.15.63:33290) 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e81220640 1 -- 172.21.15.63:0/2874851118 learned_addr learned my addr 172.21.15.63:0/2874851118 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:00.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e7bfff640 1 --2- 172.21.15.63:0/2874851118 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c15d730 0x7f8e7c0d1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e7b7fe640 1 -- 172.21.15.63:0/2874851118 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3493777735 0 0) 0x7f8e7c0cdce0 con 0x7f8e7c0d0f40 2023-12-04T10:44:00.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.265+0000 7f8e7b7fe640 1 -- 172.21.15.63:0/2874851118 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e6c003520 con 0x7f8e7c0d0f40 2023-12-04T10:44:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.266+0000 7f8e80a1f640 1 -- 172.21.15.63:0/2874851118 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c15d730 msgr2=0x7f8e7c0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.266+0000 7f8e80a1f640 1 --2- 172.21.15.63:0/2874851118 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c15d730 0x7f8e7c0d1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.266+0000 7f8e80a1f640 1 -- 172.21.15.63:0/2874851118 >> v1:172.21.15.63:6789/0 conn(0x7f8e7c0d0f40 legacy=0x7f8e7c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.266+0000 7f8e80a1f640 1 -- 172.21.15.63:0/2874851118 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e7c0cdf10 con 0x7f8e7c15d350 2023-12-04T10:44:00.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.267+0000 7f8e80a1f640 1 --2- 172.21.15.63:0/2874851118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c0d3c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e700097a0 tx=0x7f8e7002b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0c73e1bae6e639 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.267+0000 7f8e7b7fe640 1 -- 172.21.15.63:0/2874851118 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7002d040 con 0x7f8e7c15d350 2023-12-04T10:44:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.267+0000 7f8e7b7fe640 1 -- 172.21.15.63:0/2874851118 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e70031810 con 0x7f8e7c15d350 2023-12-04T10:44:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.267+0000 7f8e7b7fe640 1 -- 172.21.15.63:0/2874851118 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e70031ba0 con 0x7f8e7c15d350 2023-12-04T10:44:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.268+0000 7f8e81a21640 1 -- 172.21.15.63:0/2874851118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 msgr2=0x7f8e7c0d3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.268+0000 7f8e81a21640 1 --2- 172.21.15.63:0/2874851118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c0d3c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e700097a0 tx=0x7f8e7002b8b0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.268+0000 7f8e81a21640 1 -- 172.21.15.63:0/2874851118 shutdown_connections 2023-12-04T10:44:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.268+0000 7f8e81a21640 1 --2- 172.21.15.63:0/2874851118 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c15d730 0x7f8e7c0d1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.268+0000 7f8e81a21640 1 --2- 172.21.15.63:0/2874851118 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c0d3c80 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.268+0000 7f8e81a21640 1 -- 172.21.15.63:0/2874851118 >> 172.21.15.63:0/2874851118 conn(0x7f8e7c0d3160 msgr2=0x7f8e7c0d3570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:00.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.268+0000 7f8e81a21640 1 -- 172.21.15.63:0/2874851118 shutdown_connections 2023-12-04T10:44:00.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.268+0000 7f8e81a21640 1 -- 172.21.15.63:0/2874851118 wait complete. 2023-12-04T10:44:00.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.270+0000 7f8e81a21640 1 Processor -- start 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.270+0000 7f8e81a21640 1 -- start start 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e81a21640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c0d0f40 0x7f8e7c1457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e81a21640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e81a21640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15d730 0x7f8e7c0cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e81a21640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c155360 con 0x7f8e7c15d350 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e81a21640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c154a90 con 0x7f8e7c15d730 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e81a21640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e7c1599d0 con 0x7f8e7c0d0f40 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e7bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e7bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c145cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39750/0 (socket says 172.21.15.63:39750) 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e7bfff640 1 -- 172.21.15.63:0/1649118934 learned_addr learned my addr 172.21.15.63:0/1649118934 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e80a1f640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c0d0f40 0x7f8e7c1457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e7bfff640 1 -- 172.21.15.63:0/1649118934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c0d0f40 msgr2=0x7f8e7c1457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e7bfff640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c0d0f40 0x7f8e7c1457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e7bfff640 1 -- 172.21.15.63:0/1649118934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15d730 msgr2=0x7f8e7c0cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e7bfff640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15d730 0x7f8e7c0cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e7bfff640 1 -- 172.21.15.63:0/1649118934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e70009400 con 0x7f8e7c15d350 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.271+0000 7f8e80a1f640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c0d0f40 0x7f8e7c1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.272+0000 7f8e7bfff640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c145cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800d800 tx=0x7f8e6800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.272+0000 7f8e797fa640 1 -- 172.21.15.63:0/1649118934 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800b6c0 con 0x7f8e7c15d350 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.272+0000 7f8e797fa640 1 -- 172.21.15.63:0/1649118934 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e6800b820 con 0x7f8e7c15d350 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.272+0000 7f8e797fa640 1 -- 172.21.15.63:0/1649118934 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e6800bbb0 con 0x7f8e7c15d350 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.272+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e7c154d10 con 0x7f8e7c15d350 2023-12-04T10:44:00.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.272+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e7c152750 con 0x7f8e7c15d350 2023-12-04T10:44:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.273+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e7c155510 con 0x7f8e7c15d350 2023-12-04T10:44:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.274+0000 7f8e797fa640 1 -- 172.21.15.63:0/1649118934 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8e6800bd10 con 0x7f8e7c15d350 2023-12-04T10:44:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.275+0000 7f8e797fa640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8e6006ae40 0x7f8e6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.275+0000 7f8e797fa640 1 -- 172.21.15.63:0/1649118934 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8e68089f40 con 0x7f8e7c15d350 2023-12-04T10:44:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.275+0000 7f8e80a1f640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8e6006ae40 0x7f8e6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.276+0000 7f8e80a1f640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8e6006ae40 0x7f8e6006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e70036000 tx=0x7f8e7003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:00.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.280+0000 7f8e797fa640 1 -- 172.21.15.63:0/1649118934 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8e7c155510 con 0x7f8e7c15d350 2023-12-04T10:44:00.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.478+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e7c155510 con 0x7f8e7c15d350 2023-12-04T10:44:00.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.480+0000 7f8e797fa640 1 -- 172.21.15.63:0/1649118934 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f8e7c155510 con 0x7f8e7c15d350 2023-12-04T10:44:00.481 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:00.481 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.482+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8e6006ae40 msgr2=0x7f8e6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.482+0000 7f8e81a21640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8e6006ae40 0x7f8e6006d300 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e70036000 tx=0x7f8e7003c040 comp rx=0 tx=0).stop 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.482+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 msgr2=0x7f8e7c145cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.482+0000 7f8e81a21640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c145cf0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8e6800d800 tx=0x7f8e6800dcc0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.483+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 shutdown_connections 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.483+0000 7f8e81a21640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8e6006ae40 0x7f8e6006d300 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.483+0000 7f8e81a21640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8e7c15d730 0x7f8e7c0cb280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.483+0000 7f8e81a21640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8e7c15d350 0x7f8e7c145cf0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.483+0000 7f8e81a21640 1 --2- 172.21.15.63:0/1649118934 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8e7c0d0f40 0x7f8e7c1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.483+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 >> 172.21.15.63:0/1649118934 conn(0x7f8e7c0d3160 msgr2=0x7f8e7c15e890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.483+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 shutdown_connections 2023-12-04T10:44:00.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.483+0000 7f8e81a21640 1 -- 172.21.15.63:0/1649118934 wait complete. 2023-12-04T10:44:00.515 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:44:00.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.746+0000 7f05dbe7c640 1 Processor -- start 2023-12-04T10:44:00.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.746+0000 7f05dbe7c640 1 -- start start 2023-12-04T10:44:00.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.747+0000 7f05dbe7c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f05d40cad70 0x7f05d40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05dbe7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d4071600 0x7f05d415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05dbe7c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05d415b5c0 con 0x7f05d415b1e0 2023-12-04T10:44:00.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05dbe7c640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05d415aa30 con 0x7f05d40cad70 2023-12-04T10:44:00.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05dbe7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4071dd0 con 0x7f05d4071600 2023-12-04T10:44:00.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d9c18640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f05d415b1e0 0x7f05d40ca660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33294/0 (socket says 172.21.15.63:33294) 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d9c18640 1 -- 172.21.15.63:0/2712507475 learned_addr learned my addr 172.21.15.63:0/2712507475 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d9417640 1 --2- 172.21.15.63:0/2712507475 >> v2:172.21.15.63:3300/0 conn(0x7f05d40cad70 0x7f05d40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05da419640 1 --2- 172.21.15.63:0/2712507475 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d4071600 0x7f05d415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d8c16640 1 -- 172.21.15.63:0/2712507475 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192145983 0 0) 0x7f05d415b5c0 con 0x7f05d415b1e0 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d8c16640 1 -- 172.21.15.63:0/2712507475 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05c0005730 con 0x7f05d415b1e0 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d9417640 1 -- 172.21.15.63:0/2712507475 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d4071600 msgr2=0x7f05d415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d9417640 1 --2- 172.21.15.63:0/2712507475 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d4071600 0x7f05d415bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d9417640 1 -- 172.21.15.63:0/2712507475 >> v1:172.21.15.63:6789/0 conn(0x7f05d415b1e0 legacy=0x7f05d40ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.748+0000 7f05d9417640 1 -- 172.21.15.63:0/2712507475 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d40720b0 con 0x7f05d40cad70 2023-12-04T10:44:00.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.750+0000 7f05d9417640 1 --2- 172.21.15.63:0/2712507475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d40cad70 0x7f05d40710c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f05c40097a0 tx=0x7f05c402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bc2f5f62a54bfd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:00.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.750+0000 7f05d8c16640 1 -- 172.21.15.63:0/2712507475 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c402d040 con 0x7f05d40cad70 2023-12-04T10:44:00.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.750+0000 7f05d8c16640 1 -- 172.21.15.63:0/2712507475 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05c4031810 con 0x7f05d40cad70 2023-12-04T10:44:00.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.750+0000 7f05d8c16640 1 -- 172.21.15.63:0/2712507475 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05c4031b80 con 0x7f05d40cad70 2023-12-04T10:44:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.751+0000 7f05dbe7c640 1 -- 172.21.15.63:0/2712507475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d40cad70 msgr2=0x7f05d40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.751+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/2712507475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d40cad70 0x7f05d40710c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f05c40097a0 tx=0x7f05c402b8b0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.751+0000 7f05dbe7c640 1 -- 172.21.15.63:0/2712507475 shutdown_connections 2023-12-04T10:44:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.751+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/2712507475 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d4071600 0x7f05d415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.751+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/2712507475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d40cad70 0x7f05d40710c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.751+0000 7f05dbe7c640 1 -- 172.21.15.63:0/2712507475 >> 172.21.15.63:0/2712507475 conn(0x7f05d40cee80 msgr2=0x7f05d40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.751+0000 7f05dbe7c640 1 -- 172.21.15.63:0/2712507475 shutdown_connections 2023-12-04T10:44:00.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.751+0000 7f05dbe7c640 1 -- 172.21.15.63:0/2712507475 wait complete. 2023-12-04T10:44:00.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.753+0000 7f05dbe7c640 1 Processor -- start 2023-12-04T10:44:00.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.753+0000 7f05dbe7c640 1 -- start start 2023-12-04T10:44:00.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05dbe7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d4071600 0x7f05d414a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05dbe7c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05d40cad70 0x7f05d414a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05dbe7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d415b1e0 0x7f05d40cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05dbe7c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d414c2f0 con 0x7f05d4071600 2023-12-04T10:44:00.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05dbe7c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05d40cbbd0 con 0x7f05d40cad70 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05dbe7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05d4151400 con 0x7f05d415b1e0 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9c18640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d4071600 0x7f05d414a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9c18640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d4071600 0x7f05d414a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39766/0 (socket says 172.21.15.63:39766) 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9c18640 1 -- 172.21.15.63:0/54409777 learned_addr learned my addr 172.21.15.63:0/54409777 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05da419640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d415b1e0 0x7f05d40cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9c18640 1 -- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d415b1e0 msgr2=0x7f05d40cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9417640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05d40cad70 0x7f05d414a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9c18640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d415b1e0 0x7f05d40cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9c18640 1 -- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05d40cad70 msgr2=0x7f05d414a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9c18640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05d40cad70 0x7f05d414a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05d9c18640 1 -- 172.21.15.63:0/54409777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c4009400 con 0x7f05d4071600 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.754+0000 7f05da419640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d415b1e0 0x7f05d40cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:00.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.755+0000 7f05d9c18640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d4071600 0x7f05d414a290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05d000c390 tx=0x7f05d000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:00.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.755+0000 7f05ca7fc640 1 -- 172.21.15.63:0/54409777 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0005ce0 con 0x7f05d4071600 2023-12-04T10:44:00.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.755+0000 7f05ca7fc640 1 -- 172.21.15.63:0/54409777 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d0005e40 con 0x7f05d4071600 2023-12-04T10:44:00.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.755+0000 7f05ca7fc640 1 -- 172.21.15.63:0/54409777 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d00072f0 con 0x7f05d4071600 2023-12-04T10:44:00.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.755+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05d41516c0 con 0x7f05d4071600 2023-12-04T10:44:00.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.755+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05d414c4d0 con 0x7f05d4071600 2023-12-04T10:44:00.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.756+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05d4151be0 con 0x7f05d4071600 2023-12-04T10:44:00.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.757+0000 7f05ca7fc640 1 -- 172.21.15.63:0/54409777 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f05d0007450 con 0x7f05d4071600 2023-12-04T10:44:00.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.758+0000 7f05ca7fc640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f05b806ae40 0x7f05b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:00.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.758+0000 7f05ca7fc640 1 -- 172.21.15.63:0/54409777 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f05d0088f20 con 0x7f05d4071600 2023-12-04T10:44:00.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.758+0000 7f05d9417640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f05b806ae40 0x7f05b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:00.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.759+0000 7f05d9417640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f05b806ae40 0x7f05b806d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05c4036000 tx=0x7f05c403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:00.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.763+0000 7f05ca7fc640 1 -- 172.21.15.63:0/54409777 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f05d4151be0 con 0x7f05d4071600 2023-12-04T10:44:01.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:00.999+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05d4151be0 con 0x7f05d4071600 2023-12-04T10:44:01.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.001+0000 7f05ca7fc640 1 -- 172.21.15.63:0/54409777 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f05d4151be0 con 0x7f05d4071600 2023-12-04T10:44:01.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:01.002 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:43:58.511386+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-04T10:44:01.002 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 7 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.003+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f05b806ae40 msgr2=0x7f05b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.003+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f05b806ae40 0x7f05b806d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f05c4036000 tx=0x7f05c403c040 comp rx=0 tx=0).stop 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.003+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d4071600 msgr2=0x7f05d414a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.003+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d4071600 0x7f05d414a290 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f05d000c390 tx=0x7f05d000c850 comp rx=0 tx=0).stop 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.004+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 shutdown_connections 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.004+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f05b806ae40 0x7f05b806d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.004+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f05d415b1e0 0x7f05d40cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.004+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f05d40cad70 0x7f05d414a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.004+0000 7f05dbe7c640 1 --2- 172.21.15.63:0/54409777 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f05d4071600 0x7f05d414a290 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.004+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 >> 172.21.15.63:0/54409777 conn(0x7f05d40cee80 msgr2=0x7f05d40b3040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.004+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 shutdown_connections 2023-12-04T10:44:01.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.004+0000 7f05dbe7c640 1 -- 172.21.15.63:0/54409777 wait complete. 2023-12-04T10:44:01.026 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.245+0000 7ff6411d5640 1 Processor -- start 2023-12-04T10:44:01.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.245+0000 7ff6411d5640 1 -- start start 2023-12-04T10:44:01.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.246+0000 7ff6411d5640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff63c15d290 0x7ff63c161920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:01.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.246+0000 7ff6411d5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c06db00 0x7ff63c06b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:01.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.246+0000 7ff6411d5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff63c06b200 con 0x7ff63c06cf60 2023-12-04T10:44:01.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.246+0000 7ff6411d5640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff63c161e60 con 0x7ff63c15d290 2023-12-04T10:44:01.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.246+0000 7ff6411d5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c06a5f0 con 0x7ff63c06db00 2023-12-04T10:44:01.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.247+0000 7ff63ad9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff63c15d290 0x7ff63c161920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:01.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.247+0000 7ff63ad9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff63c15d290 0x7ff63c161920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39770/0 (socket says 172.21.15.63:39770) 2023-12-04T10:44:01.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.247+0000 7ff63ad9d640 1 -- 172.21.15.63:0/674802310 learned_addr learned my addr 172.21.15.63:0/674802310 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:01.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.247+0000 7ff63a59c640 1 --2- 172.21.15.63:0/674802310 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c06db00 0x7ff63c06b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:01.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.247+0000 7ff63ad9d640 1 -- 172.21.15.63:0/674802310 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c06db00 msgr2=0x7ff63c06b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:01.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.247+0000 7ff63ad9d640 1 --2- 172.21.15.63:0/674802310 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c06db00 0x7ff63c06b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.247+0000 7ff63ad9d640 1 -- 172.21.15.63:0/674802310 >> v1:172.21.15.66:6789/0 conn(0x7ff63c06cf60 legacy=0x7ff63c06d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:01.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.247+0000 7ff63ad9d640 1 -- 172.21.15.63:0/674802310 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff63c06a8d0 con 0x7ff63c15d290 2023-12-04T10:44:01.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.248+0000 7ff63ad9d640 1 --2- 172.21.15.63:0/674802310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c15d290 0x7ff63c161920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009870 tx=0x7ff62c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6542d3267b0e9c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:01.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.249+0000 7ff639d9b640 1 -- 172.21.15.63:0/674802310 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c031640 con 0x7ff63c15d290 2023-12-04T10:44:01.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.249+0000 7ff639d9b640 1 -- 172.21.15.63:0/674802310 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c0317a0 con 0x7ff63c15d290 2023-12-04T10:44:01.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.249+0000 7ff639d9b640 1 -- 172.21.15.63:0/674802310 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c031b30 con 0x7ff63c15d290 2023-12-04T10:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.249+0000 7ff6411d5640 1 -- 172.21.15.63:0/674802310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c15d290 msgr2=0x7ff63c161920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.249+0000 7ff6411d5640 1 --2- 172.21.15.63:0/674802310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c15d290 0x7ff63c161920 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff62c009870 tx=0x7ff62c02b8f0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.250+0000 7ff6411d5640 1 -- 172.21.15.63:0/674802310 shutdown_connections 2023-12-04T10:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.250+0000 7ff6411d5640 1 --2- 172.21.15.63:0/674802310 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c06db00 0x7ff63c06b690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.250+0000 7ff6411d5640 1 --2- 172.21.15.63:0/674802310 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c15d290 0x7ff63c161920 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.250+0000 7ff6411d5640 1 -- 172.21.15.63:0/674802310 >> 172.21.15.63:0/674802310 conn(0x7ff63c0cf720 msgr2=0x7ff63c0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.250+0000 7ff6411d5640 1 -- 172.21.15.63:0/674802310 shutdown_connections 2023-12-04T10:44:01.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.250+0000 7ff6411d5640 1 -- 172.21.15.63:0/674802310 wait complete. 2023-12-04T10:44:01.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.252+0000 7ff6411d5640 1 Processor -- start 2023-12-04T10:44:01.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.252+0000 7ff6411d5640 1 -- start start 2023-12-04T10:44:01.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff6411d5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff63c06cf60 0x7ff63c141880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:01.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff6411d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c06db00 0x7ff63c144380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:01.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff6411d5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c15d290 0x7ff63c1448c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:01.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff6411d5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c15e080 con 0x7ff63c06db00 2023-12-04T10:44:01.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff6411d5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c15dce0 con 0x7ff63c06cf60 2023-12-04T10:44:01.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff6411d5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff63c0cc4f0 con 0x7ff63c15d290 2023-12-04T10:44:01.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c06db00 0x7ff63c144380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c06db00 0x7ff63c144380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39780/0 (socket says 172.21.15.63:39780) 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63a59c640 1 -- 172.21.15.63:0/2287187760 learned_addr learned my addr 172.21.15.63:0/2287187760 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63ad9d640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff63c06cf60 0x7ff63c141880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63b59e640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c15d290 0x7ff63c1448c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63a59c640 1 -- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c15d290 msgr2=0x7ff63c1448c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63a59c640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c15d290 0x7ff63c1448c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63a59c640 1 -- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff63c06cf60 msgr2=0x7ff63c141880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.253+0000 7ff63a59c640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff63c06cf60 0x7ff63c141880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.254+0000 7ff63a59c640 1 -- 172.21.15.63:0/2287187760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff62c0094d0 con 0x7ff63c06db00 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.254+0000 7ff63b59e640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c15d290 0x7ff63c1448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.254+0000 7ff63a59c640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c06db00 0x7ff63c144380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff62400ce10 tx=0x7ff62400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.254+0000 7ff6337fe640 1 -- 172.21.15.63:0/2287187760 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624003b90 con 0x7ff63c06db00 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.254+0000 7ff6337fe640 1 -- 172.21.15.63:0/2287187760 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff624003cf0 con 0x7ff63c06db00 2023-12-04T10:44:01.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.254+0000 7ff6337fe640 1 -- 172.21.15.63:0/2287187760 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff624003ea0 con 0x7ff63c06db00 2023-12-04T10:44:01.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.254+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63c0cbf30 con 0x7ff63c06db00 2023-12-04T10:44:01.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.254+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff63c141dc0 con 0x7ff63c06db00 2023-12-04T10:44:01.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.256+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63c15db40 con 0x7ff63c06db00 2023-12-04T10:44:01.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.256+0000 7ff6337fe640 1 -- 172.21.15.63:0/2287187760 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff624004240 con 0x7ff63c06db00 2023-12-04T10:44:01.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.257+0000 7ff6337fe640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff61c06ae70 0x7ff61c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:01.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.258+0000 7ff6337fe640 1 -- 172.21.15.63:0/2287187760 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff624012070 con 0x7ff63c06db00 2023-12-04T10:44:01.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.258+0000 7ff63ad9d640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff61c06ae70 0x7ff61c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:01.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.258+0000 7ff63ad9d640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff61c06ae70 0x7ff61c06d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff62c036000 tx=0x7ff62c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:01.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.262+0000 7ff6337fe640 1 -- 172.21.15.63:0/2287187760 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff63c15db40 con 0x7ff63c06db00 2023-12-04T10:44:01.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.458+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff63c15db40 con 0x7ff63c06db00 2023-12-04T10:44:01.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.460+0000 7ff6337fe640 1 -- 172.21.15.63:0/2287187760 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7ff63c15db40 con 0x7ff63c06db00 2023-12-04T10:44:01.461 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:01.462 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:01.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff61c06ae70 msgr2=0x7ff61c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:01.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff61c06ae70 0x7ff61c06d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff62c036000 tx=0x7ff62c03c040 comp rx=0 tx=0).stop 2023-12-04T10:44:01.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c06db00 msgr2=0x7ff63c144380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c06db00 0x7ff63c144380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff62400ce10 tx=0x7ff62400a660 comp rx=0 tx=0).stop 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 shutdown_connections 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff61c06ae70 0x7ff61c06d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff63c15d290 0x7ff63c1448c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff63c06db00 0x7ff63c144380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 --2- 172.21.15.63:0/2287187760 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff63c06cf60 0x7ff63c141880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 >> 172.21.15.63:0/2287187760 conn(0x7ff63c0cf720 msgr2=0x7ff63c0b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 shutdown_connections 2023-12-04T10:44:01.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:01.463+0000 7ff6411d5640 1 -- 172.21.15.63:0/2287187760 wait complete. 2023-12-04T10:44:01.886 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-04T10:43:52.705328+0000', 'modified': '2023-12-04T10:43:58.511386+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.66:6834/4278603848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 4278603848}, {'type': 'v1', 'addr': '172.21.15.66:6834', 'nonce': 4278603848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-04T10:44:01.887 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-04T10:44:01.887 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-04T10:44:02.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.123+0000 7f8495267640 1 Processor -- start 2023-12-04T10:44:02.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.123+0000 7f8495267640 1 -- start start 2023-12-04T10:44:02.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.124+0000 7f8495267640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 0x7f8490168060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.124+0000 7f8495267640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84900cef40 con 0x7f84900d16b0 2023-12-04T10:44:02.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.124+0000 7f8495267640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84900b25c0 con 0x7f849015d710 2023-12-04T10:44:02.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.124+0000 7f8495267640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84900b28a0 con 0x7f84900b4390 2023-12-04T10:44:02.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.125+0000 7f848ffff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f84900d16b0 0x7f84900d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:33300/0 (socket says 172.21.15.63:33300) 2023-12-04T10:44:02.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.125+0000 7f848ffff640 1 -- 172.21.15.63:0/3669230527 learned_addr learned my addr 172.21.15.63:0/3669230527 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:02.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.125+0000 7f8494a66640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 0x7f8490168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.125+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847969461 0 0) 0x7f84900cef40 con 0x7f84900d16b0 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.125+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8478003520 con 0x7f84900d16b0 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3600605654 0 0) 0x7f8478003520 con 0x7f84900d16b0 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 msgr2=0x7f8490168060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 0x7f8490168060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 >> v1:172.21.15.66:6789/0 conn(0x7f849015d710 legacy=0x7f84900ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84900b2b80 con 0x7f84900d16b0 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f84800019f0 con 0x7f84900d16b0 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 >> v1:172.21.15.63:6789/0 conn(0x7f84900d16b0 legacy=0x7f84900d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 0x7f84780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8478003f20 0x7f84780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8478004d00 0x7f8478005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900b28a0 con 0x7f8478004d00 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847800bb10 con 0x7f8478003f20 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847800bcd0 con 0x7f84900b4390 2023-12-04T10:44:02.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f8494a66640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8478004d00 0x7f8478005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848f7fe640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8478003f20 0x7f84780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f848ffff640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 0x7f84780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f8494a66640 1 -- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 msgr2=0x7f84780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f8494a66640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 0x7f84780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.126+0000 7f8494a66640 1 -- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8478003f20 msgr2=0x7f84780047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.127+0000 7f8494a66640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8478003f20 0x7f84780047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.127+0000 7f8494a66640 1 -- 172.21.15.63:0/3669230527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8478003520 con 0x7f8478004d00 2023-12-04T10:44:02.129 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.127+0000 7f848ffff640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f84900b4390 0x7f84780039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.128+0000 7f8494a66640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8478004d00 0x7f8478005180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8488009a90 tx=0x7f84780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b39c35b0dde02b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.128+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848802c680 con 0x7f8478004d00 2023-12-04T10:44:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.128+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848802c7e0 con 0x7f8478004d00 2023-12-04T10:44:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.128+0000 7f848effd640 1 -- 172.21.15.63:0/3669230527 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848802cb90 con 0x7f8478004d00 2023-12-04T10:44:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.128+0000 7f8495267640 1 -- 172.21.15.63:0/3669230527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8478004d00 msgr2=0x7f8478005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.128+0000 7f8495267640 1 --2- 172.21.15.63:0/3669230527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8478004d00 0x7f8478005180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8488009a90 tx=0x7f84780057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.128+0000 7f8494a66640 1 -- 172.21.15.63:0/3669230527 reap_dead start 2023-12-04T10:44:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.129+0000 7f8495267640 1 -- 172.21.15.63:0/3669230527 shutdown_connections 2023-12-04T10:44:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.129+0000 7f8495267640 1 -- 172.21.15.63:0/3669230527 >> 172.21.15.63:0/3669230527 conn(0x7f84900d30d0 msgr2=0x7f84900d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.129+0000 7f8495267640 1 -- 172.21.15.63:0/3669230527 shutdown_connections 2023-12-04T10:44:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.129+0000 7f8495267640 1 -- 172.21.15.63:0/3669230527 wait complete. 2023-12-04T10:44:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.131+0000 7f8495267640 1 Processor -- start 2023-12-04T10:44:02.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.131+0000 7f8495267640 1 -- start start 2023-12-04T10:44:02.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f8495267640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8478004d00 0x7f84901593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f8495267640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849015be80 0x7f84900c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f8495267640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849015c3d0 0x7f84900c9260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f8495267640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84900b7040 con 0x7f849015be80 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f8495267640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84901609e0 con 0x7f849015c3d0 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f8495267640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849015fe50 con 0x7f8478004d00 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849015be80 0x7f84900c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849015be80 0x7f84900c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39794/0 (socket says 172.21.15.63:39794) 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f848f7fe640 1 -- 172.21.15.63:0/2780713441 learned_addr learned my addr 172.21.15.63:0/2780713441 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.132+0000 7f848ffff640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8478004d00 0x7f84901593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f8494a66640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849015c3d0 0x7f84900c9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848f7fe640 1 -- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8478004d00 msgr2=0x7f84901593a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848f7fe640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8478004d00 0x7f84901593a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848f7fe640 1 -- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849015c3d0 msgr2=0x7f84900c9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848f7fe640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849015c3d0 0x7f84900c9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848f7fe640 1 -- 172.21.15.63:0/2780713441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490160c30 con 0x7f849015be80 2023-12-04T10:44:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848ffff640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8478004d00 0x7f84901593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f8494a66640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849015c3d0 0x7f84900c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848f7fe640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849015be80 0x7f84900c8d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f848400e550 tx=0x7f848400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848cff9640 1 -- 172.21.15.63:0/2780713441 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840052e0 con 0x7f849015be80 2023-12-04T10:44:02.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848cff9640 1 -- 172.21.15.63:0/2780713441 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8484005440 con 0x7f849015be80 2023-12-04T10:44:02.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f8495267640 1 -- 172.21.15.63:0/2780713441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84900b66a0 con 0x7f849015be80 2023-12-04T10:44:02.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f848cff9640 1 -- 172.21.15.63:0/2780713441 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484003810 con 0x7f849015be80 2023-12-04T10:44:02.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.133+0000 7f8495267640 1 -- 172.21.15.63:0/2780713441 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84900b6c60 con 0x7f849015be80 2023-12-04T10:44:02.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.136+0000 7f848cff9640 1 -- 172.21.15.63:0/2780713441 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8484003970 con 0x7f849015be80 2023-12-04T10:44:02.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.137+0000 7f848cff9640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f847c06ae70 0x7f847c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.137+0000 7f848cff9640 1 -- 172.21.15.63:0/2780713441 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8484089640 con 0x7f849015be80 2023-12-04T10:44:02.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.137+0000 7f848ffff640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f847c06ae70 0x7f847c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.137+0000 7f849905a740 1 Processor -- start 2023-12-04T10:44:02.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.138+0000 7f849905a740 1 -- start start 2023-12-04T10:44:02.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.138+0000 7f848ffff640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f847c06ae70 0x7f847c06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8480002230 tx=0x7f8480009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.138+0000 7f849905a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09339450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.138+0000 7f849905a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09338270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.138+0000 7f849905a740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0937c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.138+0000 7f849905a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee09297880 con 0x55ee09339070 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.138+0000 7f849905a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee092a6ae0 con 0x55ee09333d70 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.138+0000 7f849905a740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee092a41d0 con 0x55ee093387b0 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09339450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09339450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39802/0 (socket says 172.21.15.63:39802) 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 -- 172.21.15.63:0/3195022873 learned_addr learned my addr 172.21.15.63:0/3195022873 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:02.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 -- 172.21.15.63:0/3195022873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 msgr2=0x55ee0937c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 --2- 172.21.15.63:0/3195022873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0937c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 -- 172.21.15.63:0/3195022873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 msgr2=0x55ee09338270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 --2- 172.21.15.63:0/3195022873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09338270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 -- 172.21.15.63:0/3195022873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee09267860 con 0x55ee09339070 2023-12-04T10:44:02.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.139+0000 7f848ffff640 1 --2- 172.21.15.63:0/3195022873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09339450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8480005db0 tx=0x7f8480011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1405bfd0bfd75 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f8475ffb640 1 -- 172.21.15.63:0/3195022873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000c050 con 0x55ee09339070 2023-12-04T10:44:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f8475ffb640 1 -- 172.21.15.63:0/3195022873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000d040 con 0x55ee09339070 2023-12-04T10:44:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f8475ffb640 1 -- 172.21.15.63:0/3195022873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480005ea0 con 0x55ee09339070 2023-12-04T10:44:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 -- 172.21.15.63:0/3195022873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 msgr2=0x55ee09339450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 --2- 172.21.15.63:0/3195022873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09339450 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8480005db0 tx=0x7f8480011000 comp rx=0 tx=0).stop 2023-12-04T10:44:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 -- 172.21.15.63:0/3195022873 shutdown_connections 2023-12-04T10:44:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 --2- 172.21.15.63:0/3195022873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0937c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 --2- 172.21.15.63:0/3195022873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09338270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 --2- 172.21.15.63:0/3195022873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09339450 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 -- 172.21.15.63:0/3195022873 >> 172.21.15.63:0/3195022873 conn(0x55ee092fac70 msgr2=0x55ee0937eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 -- 172.21.15.63:0/3195022873 shutdown_connections 2023-12-04T10:44:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.140+0000 7f849905a740 1 -- 172.21.15.63:0/3195022873 wait complete. 2023-12-04T10:44:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.141+0000 7f849905a740 1 -- start start 2023-12-04T10:44:02.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.141+0000 7f849905a740 1 Processor -- start 2023-12-04T10:44:02.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.142+0000 7f849905a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09376340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f849905a740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0935ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f849905a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09381820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f849905a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee0929fac0 con 0x55ee09339070 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f849905a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee0923c2f0 con 0x55ee09333d70 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f849905a740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee09259c70 con 0x55ee093387b0 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f849905a740 10 client.0 _ll_register_callbacks cb 0x55ee0925e3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f8494a66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09381820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f8494a66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09381820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39818/0 (socket says 172.21.15.63:39818) 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f8494a66640 1 -- 172.21.15.63:0/2376941765 learned_addr learned my addr 172.21.15.63:0/2376941765 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f848ffff640 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09376340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f848f7fe640 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0935ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f8494a66640 1 -- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 msgr2=0x55ee0935ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f8494a66640 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0935ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f8494a66640 1 -- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 msgr2=0x55ee09376340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f8494a66640 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09376340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f8494a66640 1 -- 172.21.15.63:0/2376941765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84900b2b80 con 0x55ee09339070 2023-12-04T10:44:02.146 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.143+0000 7f848f7fe640 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0935ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.144+0000 7f8494a66640 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09381820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84880099e0 tx=0x7f8488004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=895c96121590efa5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.144+0000 7f846effd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.144+0000 7f846effd640 1 -- 172.21.15.63:0/2376941765 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848802c680 con 0x55ee09339070 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.144+0000 7f849905a740 1 -- 172.21.15.63:0/2376941765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee09298aa0 con 0x55ee09339070 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.144+0000 7f846effd640 1 -- 172.21.15.63:0/2376941765 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8488000e40 con 0x55ee09339070 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.144+0000 7f846effd640 1 -- 172.21.15.63:0/2376941765 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f848803e640 con 0x55ee09339070 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.144+0000 7f849905a740 10 client.4413 fetch_fsmap learned FSMap version 7 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.144+0000 7f849905a740 1 -- 172.21.15.63:0/2376941765 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55ee0929e140 con 0x55ee09339070 2023-12-04T10:44:02.147 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f846effd640 1 -- 172.21.15.63:0/2376941765 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ee09298aa0 con 0x55ee09339070 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f846effd640 1 -- 172.21.15.63:0/2376941765 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f848803e7a0 con 0x55ee09339070 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f849905a740 10 client.4413 fetch_fsmap finished waiting for FSMap version 7 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f849905a740 10 client.4413 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f849905a740 20 client.4413 populate_metadata read hostname 'smithi063' 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f849905a740 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x55ee09383dc0 0x55ee0939bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f849905a740 4 client.4413 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f849905a740 1 -- 172.21.15.63:0/2376941765 --> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee092987c0 con 0x55ee09383dc0 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.145+0000 7f848ffff640 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x55ee09383dc0 0x55ee0939bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.146+0000 7f848ffff640 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x55ee09383dc0 0x55ee0939bf80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9f5f9541fb42276 server_cookie=8ada23354314a64a in_seq=0 out_seq=0 2023-12-04T10:44:02.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.146+0000 7f846effd640 10 client.4413 ms_handle_connect on v2:172.21.15.66:6832/4278603848 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f846effd640 1 -- 172.21.15.63:0/2376941765 <== mds.0 v2:172.21.15.66:6832/4278603848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55ee092987c0 con 0x55ee09383dc0 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f846effd640 10 client.4413 handle_command_reply: tid=0 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 client.4413 shutdown 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 -- 172.21.15.63:0/2376941765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 msgr2=0x55ee09381820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09381820 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f84880099e0 tx=0x7f8488004730 comp rx=0 tx=0).stop 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 -- 172.21.15.63:0/2376941765 shutdown_connections 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x55ee09383dc0 0x55ee0939bf80 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0935ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee09381820 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 --2- 172.21.15.63:0/2376941765 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09376340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f846effd640 0 client.4413 ms_handle_reset on v2:172.21.15.66:6832/4278603848 2023-12-04T10:44:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 -- 172.21.15.63:0/2376941765 >> 172.21.15.63:0/2376941765 conn(0x55ee092fac70 msgr2=0x55ee0937eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 -- 172.21.15.63:0/2376941765 shutdown_connections 2023-12-04T10:44:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 1 -- 172.21.15.63:0/2376941765 wait complete. 2023-12-04T10:44:02.151 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.149+0000 7f849905a740 20 client.4413 trim_cache size 0 max 16384 2023-12-04T10:44:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.166+0000 7f849905a740 1 Processor -- start 2023-12-04T10:44:02.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.166+0000 7f849905a740 1 -- start start 2023-12-04T10:44:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.167+0000 7f849905a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09333340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.167+0000 7f849905a740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0937b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.167+0000 7f849905a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee0939ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.167+0000 7f849905a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee09002f20 con 0x55ee09339070 2023-12-04T10:44:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.167+0000 7f849905a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee0937f230 con 0x55ee09333d70 2023-12-04T10:44:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.167+0000 7f849905a740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee0937f020 con 0x55ee093387b0 2023-12-04T10:44:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee0939ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee0939ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39824/0 (socket says 172.21.15.63:39824) 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 -- 172.21.15.63:0/1964603914 learned_addr learned my addr 172.21.15.63:0/1964603914 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f848ffff640 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09333340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 -- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 msgr2=0x55ee0937b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f848f7fe640 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0937b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0937b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 -- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 msgr2=0x55ee09333340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09333340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 -- 172.21.15.63:0/1964603914 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee0923bb80 con 0x55ee09339070 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f848ffff640 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09333340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:02.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.168+0000 7f8494a66640 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee0939ffa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f848800f210 tx=0x7f848803a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b82bb95ba00b38 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f84767fc640 1 -- 172.21.15.63:0/1964603914 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848803ebc0 con 0x55ee09339070 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f84767fc640 1 -- 172.21.15.63:0/1964603914 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848803ed20 con 0x55ee09339070 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f84767fc640 1 -- 172.21.15.63:0/1964603914 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848803e660 con 0x55ee09339070 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 -- 172.21.15.63:0/1964603914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 msgr2=0x55ee0939ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee0939ffa0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f848800f210 tx=0x7f848803a000 comp rx=0 tx=0).stop 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 -- 172.21.15.63:0/1964603914 shutdown_connections 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee093387b0 0x55ee0937b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee09339070 0x55ee0939ffa0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 --2- 172.21.15.63:0/1964603914 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09333d70 0x55ee09333340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 -- 172.21.15.63:0/1964603914 >> 172.21.15.63:0/1964603914 conn(0x55ee092fac70 msgr2=0x55ee093867a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 -- 172.21.15.63:0/1964603914 shutdown_connections 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.169+0000 7f849905a740 1 -- 172.21.15.63:0/1964603914 wait complete. 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.170+0000 7f849905a740 1 -- start start 2023-12-04T10:44:02.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.170+0000 7f849905a740 1 Processor -- start 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.171+0000 7f849905a740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee09333d70 0x55ee093e2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.171+0000 7f849905a740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee093387b0 0x55ee093ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.171+0000 7f849905a740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09339070 0x55ee0935efc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.171+0000 7f849905a740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee093ec3a0 con 0x55ee093387b0 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.171+0000 7f849905a740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee093e8870 con 0x55ee09339070 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.171+0000 7f849905a740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee093a0dd0 con 0x55ee09333d70 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.171+0000 7f849905a740 10 client.0 _ll_register_callbacks cb 0x7f8478004540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee093387b0 0x55ee093ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee093387b0 0x55ee093ebe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39838/0 (socket says 172.21.15.63:39838) 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 -- 172.21.15.63:0/336676875 learned_addr learned my addr 172.21.15.63:0/336676875 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:02.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 -- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee09333d70 msgr2=0x55ee093e2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee09333d70 0x55ee093e2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 -- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09339070 msgr2=0x55ee0935efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09339070 0x55ee0935efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 -- 172.21.15.63:0/336676875 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee0929e140 con 0x55ee093387b0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f848f7fe640 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee093387b0 0x55ee093ebe60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84840050a0 tx=0x7f84840580e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66f7138c329adcd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f846effd640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f846effd640 1 -- 172.21.15.63:0/336676875 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484060320 con 0x55ee093387b0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f846effd640 1 -- 172.21.15.63:0/336676875 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8484054730 con 0x55ee093387b0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.172+0000 7f849905a740 1 -- 172.21.15.63:0/336676875 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f848000d040 con 0x55ee093387b0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f846effd640 1 -- 172.21.15.63:0/336676875 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8484054910 con 0x55ee093387b0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f849905a740 10 client.4419 fetch_fsmap learned FSMap version 7 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f849905a740 1 -- 172.21.15.63:0/336676875 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x55ee09261170 con 0x55ee093387b0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f846effd640 1 -- 172.21.15.63:0/336676875 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000d040 con 0x55ee093387b0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f846effd640 1 -- 172.21.15.63:0/336676875 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 7) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f8484058280 con 0x55ee093387b0 2023-12-04T10:44:02.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f849905a740 10 client.4419 fetch_fsmap finished waiting for FSMap version 7 2023-12-04T10:44:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f849905a740 10 client.4419 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-04T10:44:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f849905a740 20 client.4419 populate_metadata read hostname 'smithi063' 2023-12-04T10:44:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f849905a740 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x55ee09334150 0x55ee09334530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f849905a740 4 client.4419 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-04T10:44:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.173+0000 7f849905a740 1 -- 172.21.15.63:0/336676875 --> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ee08fa06c0 con 0x55ee09334150 2023-12-04T10:44:02.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.174+0000 7f848ffff640 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x55ee09334150 0x55ee09334530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.175+0000 7f848ffff640 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x55ee09334150 0x55ee09334530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb8db8aa9c7a648a server_cookie=c8e02aa846a3ab19 in_seq=0 out_seq=0 2023-12-04T10:44:02.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.175+0000 7f846effd640 10 client.4419 ms_handle_connect on v2:172.21.15.66:6832/4278603848 2023-12-04T10:44:02.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.175+0000 7f846effd640 1 -- 172.21.15.63:0/336676875 <== mds.0 v2:172.21.15.66:6832/4278603848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x55ee08fa06c0 con 0x55ee09334150 2023-12-04T10:44:02.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.175+0000 7f846effd640 10 client.4419 handle_command_reply: tid=0 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.175+0000 7f849905a740 1 client.4419 shutdown 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.175+0000 7f849905a740 1 -- 172.21.15.63:0/336676875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee093387b0 msgr2=0x55ee093ebe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.175+0000 7f849905a740 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee093387b0 0x55ee093ebe60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84840050a0 tx=0x7f84840580e0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.175+0000 7f849905a740 1 -- 172.21.15.63:0/336676875 shutdown_connections 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f849905a740 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x55ee09334150 0x55ee09334530 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f849905a740 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x55ee09339070 0x55ee0935efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f849905a740 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x55ee093387b0 0x55ee093ebe60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f846effd640 0 client.4419 ms_handle_reset on v2:172.21.15.66:6832/4278603848 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f849905a740 1 --2- 172.21.15.63:0/336676875 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x55ee09333d70 0x55ee093e2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f849905a740 1 -- 172.21.15.63:0/336676875 >> 172.21.15.63:0/336676875 conn(0x55ee092fac70 msgr2=0x55ee093657d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f849905a740 1 -- 172.21.15.63:0/336676875 shutdown_connections 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f849905a740 1 -- 172.21.15.63:0/336676875 wait complete. 2023-12-04T10:44:02.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f849905a740 20 client.4419 trim_cache size 0 max 16384 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "41e9b14e-2141-4ea1-b0af-8533c9689063", 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4267, 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 8.4792740539999993, 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 7, 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 27, 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 27, 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 16.632073349999999 2023-12-04T10:44:02.180 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-04T10:44:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f8495267640 1 -- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f847c06ae70 msgr2=0x7f847c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f8495267640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f847c06ae70 0x7f847c06d330 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8480002230 tx=0x7f8480009040 comp rx=0 tx=0).stop 2023-12-04T10:44:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f8495267640 1 -- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849015be80 msgr2=0x7f84900c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f8495267640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849015be80 0x7f84900c8d20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f848400e550 tx=0x7f848400ea10 comp rx=0 tx=0).stop 2023-12-04T10:44:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f8495267640 1 -- 172.21.15.63:0/2780713441 shutdown_connections 2023-12-04T10:44:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f8495267640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f847c06ae70 0x7f847c06d330 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f8495267640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f849015c3d0 0x7f84900c9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.176+0000 7f8495267640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f849015be80 0x7f84900c8d20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.177+0000 7f8495267640 1 --2- 172.21.15.63:0/2780713441 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8478004d00 0x7f84901593a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.177+0000 7f8495267640 1 -- 172.21.15.63:0/2780713441 >> 172.21.15.63:0/2780713441 conn(0x7f84900d30d0 msgr2=0x7f849006c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.177+0000 7f8495267640 1 -- 172.21.15.63:0/2780713441 shutdown_connections 2023-12-04T10:44:02.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.177+0000 7f8495267640 1 -- 172.21.15.63:0/2780713441 wait complete. 2023-12-04T10:44:02.194 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-04T10:44:02.194 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:02.195 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T10:44:02.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.413+0000 7fa37c809640 1 Processor -- start 2023-12-04T10:44:02.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.414+0000 7fa37c809640 1 -- start start 2023-12-04T10:44:02.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.415+0000 7fa37c809640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa37815d710 0x7fa3780ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.415+0000 7fa37c809640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa3780b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.415+0000 7fa37c809640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3780cef40 con 0x7fa3780d16b0 2023-12-04T10:44:02.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.415+0000 7fa37c809640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3780b25c0 con 0x7fa37815d710 2023-12-04T10:44:02.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.415+0000 7fa37c809640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3780b28a0 con 0x7fa3780d3cd0 2023-12-04T10:44:02.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa36ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa37815d710 0x7fa3780ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa36ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa37815d710 0x7fa3780ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39840/0 (socket says 172.21.15.63:39840) 2023-12-04T10:44:02.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa36ffff640 1 -- 172.21.15.63:0/2383155711 learned_addr learned my addr 172.21.15.63:0/2383155711 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:02.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa36ffff640 1 -- 172.21.15.63:0/2383155711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 msgr2=0x7fa3780b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:02.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa377fff640 1 --2- 172.21.15.63:0/2383155711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa3780b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa36ffff640 1 --2- 172.21.15.63:0/2383155711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa3780b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa36ffff640 1 -- 172.21.15.63:0/2383155711 >> v1:172.21.15.66:6789/0 conn(0x7fa3780d16b0 legacy=0x7fa3780d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa36ffff640 1 -- 172.21.15.63:0/2383155711 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3780b2b80 con 0x7fa37815d710 2023-12-04T10:44:02.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.416+0000 7fa377fff640 1 --2- 172.21.15.63:0/2383155711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa3780b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:02.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.417+0000 7fa36ffff640 1 --2- 172.21.15.63:0/2383155711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa3780ce6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa360009870 tx=0x7fa36002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f2099560dfafd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.418+0000 7fa376ffd640 1 -- 172.21.15.63:0/2383155711 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360031640 con 0x7fa37815d710 2023-12-04T10:44:02.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.418+0000 7fa376ffd640 1 -- 172.21.15.63:0/2383155711 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3600317a0 con 0x7fa37815d710 2023-12-04T10:44:02.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.418+0000 7fa376ffd640 1 -- 172.21.15.63:0/2383155711 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa360031b30 con 0x7fa37815d710 2023-12-04T10:44:02.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.418+0000 7fa37c809640 1 -- 172.21.15.63:0/2383155711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 msgr2=0x7fa3780ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.418+0000 7fa37c809640 1 --2- 172.21.15.63:0/2383155711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa3780ce6f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa360009870 tx=0x7fa36002b8f0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.418+0000 7fa37c809640 1 -- 172.21.15.63:0/2383155711 shutdown_connections 2023-12-04T10:44:02.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.418+0000 7fa37c809640 1 --2- 172.21.15.63:0/2383155711 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa3780b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.418+0000 7fa37c809640 1 --2- 172.21.15.63:0/2383155711 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa3780ce6f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.419+0000 7fa37c809640 1 -- 172.21.15.63:0/2383155711 >> 172.21.15.63:0/2383155711 conn(0x7fa3780d30d0 msgr2=0x7fa3780d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:02.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.419+0000 7fa37c809640 1 -- 172.21.15.63:0/2383155711 shutdown_connections 2023-12-04T10:44:02.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.419+0000 7fa37c809640 1 -- 172.21.15.63:0/2383155711 wait complete. 2023-12-04T10:44:02.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.420+0000 7fa37c809640 1 Processor -- start 2023-12-04T10:44:02.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.421+0000 7fa37c809640 1 -- start start 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.422+0000 7fa37c809640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3780d16b0 0x7fa3781576b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.422+0000 7fa37c809640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa37815e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.422+0000 7fa37c809640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa37815b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.422+0000 7fa37c809640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37815fbc0 con 0x7fa37815d710 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.422+0000 7fa37c809640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa37815efb0 con 0x7fa3780d16b0 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.422+0000 7fa37c809640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37815f290 con 0x7fa3780d3cd0 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.422+0000 7fa377fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa37815b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.422+0000 7fa377fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa37815b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39852/0 (socket says 172.21.15.63:39852) 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa377fff640 1 -- 172.21.15.63:0/2739975501 learned_addr learned my addr 172.21.15.63:0/2739975501 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa3777fe640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3780d16b0 0x7fa3781576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa36ffff640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa37815e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa377fff640 1 -- 172.21.15.63:0/2739975501 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 msgr2=0x7fa37815e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa377fff640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa37815e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa377fff640 1 -- 172.21.15.63:0/2739975501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3780d16b0 msgr2=0x7fa3781576b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa377fff640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3780d16b0 0x7fa3781576b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa377fff640 1 -- 172.21.15.63:0/2739975501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3600094d0 con 0x7fa37815d710 2023-12-04T10:44:02.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.423+0000 7fa377fff640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa37815b700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa37000cef0 tx=0x7fa37000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.424+0000 7fa374ff9640 1 -- 172.21.15.63:0/2739975501 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000d840 con 0x7fa37815d710 2023-12-04T10:44:02.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.424+0000 7fa374ff9640 1 -- 172.21.15.63:0/2739975501 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa37000d9c0 con 0x7fa37815d710 2023-12-04T10:44:02.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.424+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa37815f570 con 0x7fa37815d710 2023-12-04T10:44:02.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.424+0000 7fa374ff9640 1 -- 172.21.15.63:0/2739975501 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37000dd70 con 0x7fa37815d710 2023-12-04T10:44:02.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.424+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3780c8b50 con 0x7fa37815d710 2023-12-04T10:44:02.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.425+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37815fd30 con 0x7fa37815d710 2023-12-04T10:44:02.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.426+0000 7fa374ff9640 1 -- 172.21.15.63:0/2739975501 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa37001e3b0 con 0x7fa37815d710 2023-12-04T10:44:02.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.427+0000 7fa374ff9640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa35806ae70 0x7fa35806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:02.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.427+0000 7fa374ff9640 1 -- 172.21.15.63:0/2739975501 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa37008a440 con 0x7fa37815d710 2023-12-04T10:44:02.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.427+0000 7fa3777fe640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa35806ae70 0x7fa35806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:02.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.428+0000 7fa3777fe640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa35806ae70 0x7fa35806d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa368000f60 tx=0x7fa368009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:02.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.431+0000 7fa374ff9640 1 -- 172.21.15.63:0/2739975501 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa370055220 con 0x7fa37815d710 2023-12-04T10:44:02.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.666+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa3780b5f00 con 0x7fa37815d710 2023-12-04T10:44:02.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.667+0000 7fa374ff9640 1 -- 172.21.15.63:0/2739975501 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa370058840 con 0x7fa37815d710 2023-12-04T10:44:02.668 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-04T10:44:02.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.669+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa35806ae70 msgr2=0x7fa35806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.669+0000 7fa37c809640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa35806ae70 0x7fa35806d330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa368000f60 tx=0x7fa368009040 comp rx=0 tx=0).stop 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.669+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 msgr2=0x7fa37815b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.669+0000 7fa37c809640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa37815b700 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa37000cef0 tx=0x7fa37000a710 comp rx=0 tx=0).stop 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.670+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 shutdown_connections 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.670+0000 7fa37c809640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa35806ae70 0x7fa35806d330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.670+0000 7fa37c809640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa3780d3cd0 0x7fa37815e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.670+0000 7fa37c809640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa37815d710 0x7fa37815b700 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.670+0000 7fa37c809640 1 --2- 172.21.15.63:0/2739975501 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa3780d16b0 0x7fa3781576b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.670+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 >> 172.21.15.63:0/2739975501 conn(0x7fa3780d30d0 msgr2=0x7fa37806bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.670+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 shutdown_connections 2023-12-04T10:44:02.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:02.670+0000 7fa37c809640 1 -- 172.21.15.63:0/2739975501 wait complete. 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T10:44:02.689 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-04T10:44:02.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:02.690 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2023-12-04T10:44:02.745 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:02.745 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T10:44:02.746 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:02.747 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-04T10:44:02.747 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42313sec preferred_lft 42313sec 2023-12-04T10:44:02.747 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2023-12-04T10:44:02.747 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:02.748 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-04T10:44:02.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:02.748 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:02.748 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:02.748 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2023-12-04T10:44:02.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2023-12-04T10:44:02.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2023-12-04T10:44:02.749 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-04T10:44:02.749 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:03.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:03.254 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T10:44:03.339 INFO:teuthology.orchestra.run.smithi063.stdout:1 2023-12-04T10:44:03.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:03.343 DEBUG:teuthology.orchestra.run.smithi063:> route 2023-12-04T10:44:03.396 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2023-12-04T10:44:03.397 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T10:44:03.397 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T10:44:03.397 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T10:44:03.397 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T10:44:03.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:03.397 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:03.397 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:03.397 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T10:44:03.398 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T10:44:03.398 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T10:44:03.398 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:04.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:04.222 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-04T10:44:04.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:04.275 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2023-12-04T10:44:04.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:04.323 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:04.323 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:04.323 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-04T10:44:04.323 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-04T10:44:04.323 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:04.454 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-04T10:44:04.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:04.455 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:04.455 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:04.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-04T10:44:04.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-04T10:44:04.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-04T10:44:04.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-04T10:44:04.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-04T10:44:04.455 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:04.727 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:04.727 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:04.727 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:04.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2023-12-04T10:44:04.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2023-12-04T10:44:04.727 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:04.877 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-04T10:44:04.878 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:04.878 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:04.921 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-04T10:44:04.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:04.921 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:05.006 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2023-12-04T10:44:05.137 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2023-12-04T10:44:05.187 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/selinux 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysctl.service 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/nfs/rpc_pipefs 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2023-12-04T10:44:05.188 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2023-12-04T10:44:05.189 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2023-12-04T10:44:05.189 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2023-12-04T10:44:05.189 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2023-12-04T10:44:05.189 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-04T10:44:05.189 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-04T10:44:05.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:05.190 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2023-12-04T10:44:05.236 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-04T10:44:05.236 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-04T10:44:05.285 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2023-12-04T10:44:05.364 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2023-12-04T10:44:05.409 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2023-12-04T10:44:05.409 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/selinux 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2023-12-04T10:44:05.410 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysctl.service 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/nfs/rpc_pipefs 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-04T10:44:05.411 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-04T10:44:05.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:05.412 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2023-12-04T10:44:05.528 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:2023-12-04T10:44:05.527+0000 7f00f923e480 -1 init, newargv = 0x55ed02f14520 newargc=15 2023-12-04T10:44:05.528 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[94185]: starting ceph client 2023-12-04T10:44:05.542 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[94185]: starting fuse 2023-12-04T10:44:06.605 DEBUG:teuthology.orchestra.run.smithi063:> sudo modprobe fuse 2023-12-04T10:44:06.719 DEBUG:teuthology.orchestra.run.smithi063:> cat /proc/self/mounts | awk '{print $2}' 2023-12-04T10:44:06.781 INFO:teuthology.orchestra.run.smithi063.stdout:/proc 2023-12-04T10:44:06.781 INFO:teuthology.orchestra.run.smithi063.stdout:/sys 2023-12-04T10:44:06.781 INFO:teuthology.orchestra.run.smithi063.stdout:/dev 2023-12-04T10:44:06.781 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/security 2023-12-04T10:44:06.781 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/shm 2023-12-04T10:44:06.781 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/pts 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/run 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/cgroup 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/pstore 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/ 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/selinux 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/proc/sys/fs/binfmt_misc 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/hugepages 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/dev/mqueue 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/debug 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/tracing 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/fs/fuse/connections 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/sys/kernel/config 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-sysctl.service 2023-12-04T10:44:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/nfs/rpc_pipefs 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/run/user/1000 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-0 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-1 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-2 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/var/lib/ceph/osd/ceph-3 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-04T10:44:06.783 INFO:teuthology.orchestra.run.smithi063.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:06.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:06.785 DEBUG:teuthology.orchestra.run.smithi063:> ls /sys/fs/fuse/connections 2023-12-04T10:44:06.840 INFO:teuthology.orchestra.run.smithi063.stdout:40 2023-12-04T10:44:06.841 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [40] 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> sudo stdin-killer -- python3 -c ' 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> import glob 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> import re 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> import os 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> import subprocess 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> def _find_admin_socket(client_name): 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> files = glob.glob(asok_path) 2023-12-04T10:44:06.841 DEBUG:teuthology.orchestra.run.smithi063:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> # Given a non-glob path, it better be there 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> if "*" not in asok_path: 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> assert(len(files) == 1) 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> return files[0] 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> for f in files: 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> contents = proc_f.read() 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> if mountpoint in contents: 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> return f 2023-12-04T10:44:06.842 DEBUG:teuthology.orchestra.run.smithi063:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-04T10:44:06.843 DEBUG:teuthology.orchestra.run.smithi063:> 2023-12-04T10:44:06.843 DEBUG:teuthology.orchestra.run.smithi063:> print(_find_admin_socket("client.admin")) 2023-12-04T10:44:06.843 DEBUG:teuthology.orchestra.run.smithi063:> ' 2023-12-04T10:44:07.035 INFO:teuthology.orchestra.run.smithi063.stdout:/var/run/ceph/ceph-client.admin.94185.asok 2023-12-04T10:44:07.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-04T10:44:07.055 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.94185.asok 2023-12-04T10:44:07.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:07.055 DEBUG:teuthology.orchestra.run.smithi063:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.94185.asok status 2023-12-04T10:44:07.307 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-04T10:44:07.307 INFO:teuthology.orchestra.run.smithi063.stdout: "metadata": { 2023-12-04T10:44:07.307 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_sha1": "c7b0e682e685ca9c244e731128a4c5dcad3b99eb", 2023-12-04T10:44:07.307 INFO:teuthology.orchestra.run.smithi063.stdout: "ceph_version": "ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev)", 2023-12-04T10:44:07.307 INFO:teuthology.orchestra.run.smithi063.stdout: "entity_id": "admin", 2023-12-04T10:44:07.307 INFO:teuthology.orchestra.run.smithi063.stdout: "hostname": "smithi063", 2023-12-04T10:44:07.307 INFO:teuthology.orchestra.run.smithi063.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "pid": "94185", 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "root": "/" 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_count": 0, 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "dentry_pinned_count": 0, 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4431, 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "inst": { 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "name": { 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "client", 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "num": 4431 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2023-12-04T10:44:07.308 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4007410441 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": { 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "type": "v1", 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "addr": "192.168.0.1:0", 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "nonce": 4007410441 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "inst_str": "client.4431 192.168.0.1:0/4007410441", 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "addr_str": "192.168.0.1:0/4007410441", 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "inode_count": 1, 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "mds_epoch": 7, 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch": 27, 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "osd_epoch_barrier": 0, 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "blocklisted": false, 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs" 2023-12-04T10:44:07.309 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-04T10:44:07.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:07.323 DEBUG:teuthology.orchestra.run.smithi063:> stat --file-system '--printf=%T 2023-12-04T10:44:07.323 DEBUG:teuthology.orchestra.run.smithi063:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:07.379 INFO:teuthology.orchestra.run.smithi063.stdout:fuseblk 2023-12-04T10:44:07.379 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:07.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:07.379 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:07.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:07.483 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-04T10:44:07.583 INFO:teuthology.orchestra.run.smithi063.stdout:# file: . 2023-12-04T10:44:07.584 INFO:teuthology.orchestra.run.smithi063.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-04T10:44:07.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:07.585 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:44:07.585 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:44:07.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.855+0000 7f163c904640 1 Processor -- start 2023-12-04T10:44:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.855+0000 7f163c904640 1 -- start start 2023-12-04T10:44:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f163c904640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1638151ca0 0x7f163806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f163c904640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f163815b470 0x7f16380cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f163c904640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16380cc7f0 con 0x7f163806e0b0 2023-12-04T10:44:07.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f163c904640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16380cca40 con 0x7f1638151ca0 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f163c904640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16380ccd20 con 0x7f163815b470 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f1636d9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1638151ca0 0x7f163806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f163759e640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f163806e0b0 0x7f1638071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46366/0 (socket says 172.21.15.63:46366) 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f163759e640 1 -- 172.21.15.63:0/3954403587 learned_addr learned my addr 172.21.15.63:0/3954403587 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f1636d9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1638151ca0 0x7f163806db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39604/0 (socket says 172.21.15.63:39604) 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.857+0000 7f163659c640 1 --2- 172.21.15.63:0/3954403587 >> v2:172.21.15.66:3300/0 conn(0x7f163815b470 0x7f16380cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.858+0000 7f1636d9d640 1 -- 172.21.15.63:0/3954403587 >> v2:172.21.15.66:3300/0 conn(0x7f163815b470 msgr2=0x7f16380cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.858+0000 7f1636d9d640 1 --2- 172.21.15.63:0/3954403587 >> v2:172.21.15.66:3300/0 conn(0x7f163815b470 0x7f16380cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.858+0000 7f1636d9d640 1 -- 172.21.15.63:0/3954403587 >> v1:172.21.15.63:6789/0 conn(0x7f163806e0b0 legacy=0x7f1638071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.858+0000 7f1636d9d640 1 -- 172.21.15.63:0/3954403587 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16380cd000 con 0x7f1638151ca0 2023-12-04T10:44:07.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.858+0000 7f1635d9b640 1 -- 172.21.15.63:0/3954403587 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3514040075 0 0) 0x7f16380cc7f0 con 0x7f163806e0b0 2023-12-04T10:44:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.859+0000 7f1636d9d640 1 --2- 172.21.15.63:0/3954403587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1638151ca0 0x7f163806db70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16380cc180 tx=0x7f162802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cdd3d5b0e5af4ce server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:07.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.859+0000 7f1635d9b640 1 -- 172.21.15.63:0/3954403587 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162802e070 con 0x7f1638151ca0 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.859+0000 7f1635d9b640 1 -- 172.21.15.63:0/3954403587 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16280315a0 con 0x7f1638151ca0 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.859+0000 7f1635d9b640 1 -- 172.21.15.63:0/3954403587 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628031930 con 0x7f1638151ca0 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.860+0000 7f163c904640 1 -- 172.21.15.63:0/3954403587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1638151ca0 msgr2=0x7f163806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.860+0000 7f163c904640 1 --2- 172.21.15.63:0/3954403587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1638151ca0 0x7f163806db70 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f16380cc180 tx=0x7f162802b840 comp rx=0 tx=0).stop 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.860+0000 7f163c904640 1 -- 172.21.15.63:0/3954403587 shutdown_connections 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.860+0000 7f163c904640 1 --2- 172.21.15.63:0/3954403587 >> v2:172.21.15.66:3300/0 conn(0x7f163815b470 0x7f16380cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.860+0000 7f163c904640 1 --2- 172.21.15.63:0/3954403587 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1638151ca0 0x7f163806db70 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.860+0000 7f163c904640 1 -- 172.21.15.63:0/3954403587 >> 172.21.15.63:0/3954403587 conn(0x7f16380b07f0 msgr2=0x7f16380b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.860+0000 7f163c904640 1 -- 172.21.15.63:0/3954403587 shutdown_connections 2023-12-04T10:44:07.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.860+0000 7f163c904640 1 -- 172.21.15.63:0/3954403587 wait complete. 2023-12-04T10:44:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.862+0000 7f163c904640 1 Processor -- start 2023-12-04T10:44:07.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.862+0000 7f163c904640 1 -- start start 2023-12-04T10:44:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.863+0000 7f163c904640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163806e0b0 0x7f163814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:07.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.863+0000 7f163c904640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1638151ca0 0x7f16380ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.863+0000 7f163c904640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16381550c0 0x7f16380c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.863+0000 7f163c904640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f163814fee0 con 0x7f16381550c0 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.863+0000 7f163c904640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380c5cf0 con 0x7f163806e0b0 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.863+0000 7f163c904640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16380cad30 con 0x7f1638151ca0 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.863+0000 7f163759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16381550c0 0x7f16380c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16381550c0 0x7f16380c4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39616/0 (socket says 172.21.15.63:39616) 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163759e640 1 -- 172.21.15.63:0/1995853916 learned_addr learned my addr 172.21.15.63:0/1995853916 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f1636d9d640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163806e0b0 0x7f163814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:07.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163659c640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1638151ca0 0x7f16380ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:07.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163759e640 1 -- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1638151ca0 msgr2=0x7f16380ca7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:07.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163759e640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1638151ca0 0x7f16380ca7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:07.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163759e640 1 -- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163806e0b0 msgr2=0x7f163814f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:07.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163759e640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163806e0b0 0x7f163814f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:07.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163759e640 1 -- 172.21.15.63:0/1995853916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1628009400 con 0x7f16381550c0 2023-12-04T10:44:07.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f1636d9d640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163806e0b0 0x7f163814f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:07.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.864+0000 7f163759e640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16381550c0 0x7f16380c4920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1630001560 tx=0x7f163000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:07.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.865+0000 7f161f7fe640 1 -- 172.21.15.63:0/1995853916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000a5e0 con 0x7f16381550c0 2023-12-04T10:44:07.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.865+0000 7f161f7fe640 1 -- 172.21.15.63:0/1995853916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f163000a740 con 0x7f16381550c0 2023-12-04T10:44:07.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.865+0000 7f161f7fe640 1 -- 172.21.15.63:0/1995853916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f163000aad0 con 0x7f16381550c0 2023-12-04T10:44:07.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.865+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638155680 con 0x7f16381550c0 2023-12-04T10:44:07.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.865+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16380c61e0 con 0x7f16381550c0 2023-12-04T10:44:07.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.866+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f163815b040 con 0x7f16381550c0 2023-12-04T10:44:07.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.867+0000 7f161f7fe640 1 -- 172.21.15.63:0/1995853916 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f163000ac30 con 0x7f16381550c0 2023-12-04T10:44:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.868+0000 7f161f7fe640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f162406ae70 0x7f162406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.868+0000 7f161f7fe640 1 -- 172.21.15.63:0/1995853916 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1630088c60 con 0x7f16381550c0 2023-12-04T10:44:07.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.868+0000 7f1636d9d640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f162406ae70 0x7f162406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:07.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.869+0000 7f1636d9d640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f162406ae70 0x7f162406d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1628036000 tx=0x7f1628008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:07.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:07.874+0000 7f161f7fe640 1 -- 172.21.15.63:0/1995853916 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1630053a90 con 0x7f16381550c0 2023-12-04T10:44:08.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.076+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f163804e840 con 0x7f16381550c0 2023-12-04T10:44:08.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.079+0000 7f161f7fe640 1 -- 172.21.15.63:0/1995853916 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f1630018020 con 0x7f16381550c0 2023-12-04T10:44:08.081 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:08.081 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:08.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f162406ae70 msgr2=0x7f162406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f162406ae70 0x7f162406d330 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1628036000 tx=0x7f1628008030 comp rx=0 tx=0).stop 2023-12-04T10:44:08.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16381550c0 msgr2=0x7f16380c4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16381550c0 0x7f16380c4920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1630001560 tx=0x7f163000cc70 comp rx=0 tx=0).stop 2023-12-04T10:44:08.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 shutdown_connections 2023-12-04T10:44:08.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f162406ae70 0x7f162406d330 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1638151ca0 0x7f16380ca7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f16381550c0 0x7f16380c4920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 --2- 172.21.15.63:0/1995853916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f163806e0b0 0x7f163814f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 >> 172.21.15.63:0/1995853916 conn(0x7f16380b07f0 msgr2=0x7f163806ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:08.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 shutdown_connections 2023-12-04T10:44:08.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.082+0000 7f163c904640 1 -- 172.21.15.63:0/1995853916 wait complete. 2023-12-04T10:44:08.103 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:08.103 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:08.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.334+0000 7f7365bae640 1 Processor -- start 2023-12-04T10:44:08.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.335+0000 7f7365bae640 1 -- start start 2023-12-04T10:44:08.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.336+0000 7f7365bae640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f736015d200 0x7f73600cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.336+0000 7f7365bae640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 0x7f73600cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.336+0000 7f7365bae640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73600b6f70 con 0x7f73600ce7c0 2023-12-04T10:44:08.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.336+0000 7f7365bae640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73600d0e60 con 0x7f736015d200 2023-12-04T10:44:08.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.336+0000 7f7365bae640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600d1140 con 0x7f736015d5e0 2023-12-04T10:44:08.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.336+0000 7f7364bac640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f736015d200 0x7f73600cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.336+0000 7f7364bac640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f736015d200 0x7f73600cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39622/0 (socket says 172.21.15.63:39622) 2023-12-04T10:44:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.336+0000 7f7364bac640 1 -- 172.21.15.63:0/2252977678 learned_addr learned my addr 172.21.15.63:0/2252977678 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.337+0000 7f735ffff640 1 --2- 172.21.15.63:0/2252977678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 0x7f73600cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.337+0000 7f7364bac640 1 -- 172.21.15.63:0/2252977678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 msgr2=0x7f73600cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.337+0000 7f7364bac640 1 --2- 172.21.15.63:0/2252977678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 0x7f73600cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.337+0000 7f7364bac640 1 -- 172.21.15.63:0/2252977678 >> v1:172.21.15.66:6789/0 conn(0x7f73600ce7c0 legacy=0x7f7360160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:08.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.337+0000 7f7364bac640 1 -- 172.21.15.63:0/2252977678 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73600d1420 con 0x7f736015d200 2023-12-04T10:44:08.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.337+0000 7f735ffff640 1 --2- 172.21.15.63:0/2252977678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 0x7f73600cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:08.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.338+0000 7f7364bac640 1 --2- 172.21.15.63:0/2252977678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600cfa70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7350009e50 tx=0x7f735002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b9b3ac369f164fb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:08.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.338+0000 7f735f7fe640 1 -- 172.21.15.63:0/2252977678 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735002ca80 con 0x7f736015d200 2023-12-04T10:44:08.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.338+0000 7f735f7fe640 1 -- 172.21.15.63:0/2252977678 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735002cbe0 con 0x7f736015d200 2023-12-04T10:44:08.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.338+0000 7f735f7fe640 1 -- 172.21.15.63:0/2252977678 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73500343f0 con 0x7f736015d200 2023-12-04T10:44:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.339+0000 7f7365bae640 1 -- 172.21.15.63:0/2252977678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 msgr2=0x7f73600cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.339+0000 7f7365bae640 1 --2- 172.21.15.63:0/2252977678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600cfa70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7350009e50 tx=0x7f735002bee0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.339+0000 7f7365bae640 1 -- 172.21.15.63:0/2252977678 shutdown_connections 2023-12-04T10:44:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.339+0000 7f7365bae640 1 --2- 172.21.15.63:0/2252977678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 0x7f73600cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.339+0000 7f7365bae640 1 --2- 172.21.15.63:0/2252977678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600cfa70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.339+0000 7f7365bae640 1 -- 172.21.15.63:0/2252977678 >> 172.21.15.63:0/2252977678 conn(0x7f736009c3e0 msgr2=0x7f73600d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.339+0000 7f7365bae640 1 -- 172.21.15.63:0/2252977678 shutdown_connections 2023-12-04T10:44:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.339+0000 7f7365bae640 1 -- 172.21.15.63:0/2252977678 wait complete. 2023-12-04T10:44:08.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.341+0000 7f7365bae640 1 Processor -- start 2023-12-04T10:44:08.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.341+0000 7f7365bae640 1 -- start start 2023-12-04T10:44:08.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f7365bae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73600ce7c0 0x7f73601459c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f7365bae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600b8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f7365bae640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 0x7f73601f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f7365bae640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600c8810 con 0x7f736015d200 2023-12-04T10:44:08.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f7365bae640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73600c8af0 con 0x7f73600ce7c0 2023-12-04T10:44:08.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f7365bae640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73600c8dd0 con 0x7f736015d5e0 2023-12-04T10:44:08.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f735ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600b8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f735ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600b8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39630/0 (socket says 172.21.15.63:39630) 2023-12-04T10:44:08.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.342+0000 7f735ffff640 1 -- 172.21.15.63:0/1658280816 learned_addr learned my addr 172.21.15.63:0/1658280816 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:08.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f7364bac640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73600ce7c0 0x7f73601459c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735ffff640 1 -- 172.21.15.63:0/1658280816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 msgr2=0x7f73601f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735ffff640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 0x7f73601f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735ffff640 1 -- 172.21.15.63:0/1658280816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73600ce7c0 msgr2=0x7f73601459c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735ffff640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73600ce7c0 0x7f73601459c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735ffff640 1 -- 172.21.15.63:0/1658280816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7350009b30 con 0x7f736015d200 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735ffff640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600b8870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f735400c7c0 tx=0x7f735400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735d7fa640 1 -- 172.21.15.63:0/1658280816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354007820 con 0x7f736015d200 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735d7fa640 1 -- 172.21.15.63:0/1658280816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7354007980 con 0x7f736015d200 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f735d7fa640 1 -- 172.21.15.63:0/1658280816 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7354007d10 con 0x7f736015d200 2023-12-04T10:44:08.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.343+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73600d2080 con 0x7f736015d200 2023-12-04T10:44:08.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.344+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73600c9390 con 0x7f736015d200 2023-12-04T10:44:08.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.345+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736004e840 con 0x7f736015d200 2023-12-04T10:44:08.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.346+0000 7f735d7fa640 1 -- 172.21.15.63:0/1658280816 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f73540113f0 con 0x7f736015d200 2023-12-04T10:44:08.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.347+0000 7f735d7fa640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f734c06ae40 0x7f734c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.347+0000 7f735d7fa640 1 -- 172.21.15.63:0/1658280816 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f73540899c0 con 0x7f736015d200 2023-12-04T10:44:08.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.347+0000 7f7364bac640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f734c06ae40 0x7f734c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.348+0000 7f7364bac640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f734c06ae40 0x7f734c06d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7350035000 tx=0x7f7350030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:08.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.351+0000 7f735d7fa640 1 -- 172.21.15.63:0/1658280816 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7354054780 con 0x7f736015d200 2023-12-04T10:44:08.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.547+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73600d0750 con 0x7f736015d200 2023-12-04T10:44:08.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.548+0000 7f735d7fa640 1 -- 172.21.15.63:0/1658280816 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f735401f0a0 con 0x7f736015d200 2023-12-04T10:44:08.549 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:08.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f734c06ae40 msgr2=0x7f734c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f734c06ae40 0x7f734c06d300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7350035000 tx=0x7f7350030000 comp rx=0 tx=0).stop 2023-12-04T10:44:08.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 msgr2=0x7f73600b8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600b8870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f735400c7c0 tx=0x7f735400cc80 comp rx=0 tx=0).stop 2023-12-04T10:44:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 shutdown_connections 2023-12-04T10:44:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f734c06ae40 0x7f734c06d300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f736015d5e0 0x7f73601f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f736015d200 0x7f73600b8870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 --2- 172.21.15.63:0/1658280816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73600ce7c0 0x7f73601459c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 >> 172.21.15.63:0/1658280816 conn(0x7f736009c3e0 msgr2=0x7f73600b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 shutdown_connections 2023-12-04T10:44:08.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.551+0000 7f7365bae640 1 -- 172.21.15.63:0/1658280816 wait complete. 2023-12-04T10:44:08.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:08.793 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.792+0000 7f4c1abae640 1 Processor -- start 2023-12-04T10:44:08.793 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.792+0000 7f4c1abae640 1 -- start start 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c1abae640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c140c4560 0x7f4c140b1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c1abae640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140b2460 0x7f4c140b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c1abae640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c14161b90 con 0x7f4c141617b0 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c1abae640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c140b0810 con 0x7f4c140c4560 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c1abae640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1406b8b0 con 0x7f4c140b2460 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c193ab640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c140c4560 0x7f4c140b1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c193ab640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c140c4560 0x7f4c140b1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39638/0 (socket says 172.21.15.63:39638) 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c19bac640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f4c141617b0 0x7f4c140c3e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46372/0 (socket says 172.21.15.63:46372) 2023-12-04T10:44:08.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c193ab640 1 -- 172.21.15.63:0/961994166 learned_addr learned my addr 172.21.15.63:0/961994166 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:08.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c193ab640 1 -- 172.21.15.63:0/961994166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140b2460 msgr2=0x7f4c140b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:08.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c1a3ad640 1 --2- 172.21.15.63:0/961994166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140b2460 0x7f4c140b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.794+0000 7f4c193ab640 1 --2- 172.21.15.63:0/961994166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140b2460 0x7f4c140b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.795+0000 7f4c193ab640 1 -- 172.21.15.63:0/961994166 >> v1:172.21.15.63:6789/0 conn(0x7f4c141617b0 legacy=0x7f4c140c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.795+0000 7f4c193ab640 1 -- 172.21.15.63:0/961994166 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c140b0a80 con 0x7f4c140c4560 2023-12-04T10:44:08.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.795+0000 7f4c18baa640 1 -- 172.21.15.63:0/961994166 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112409816 0 0) 0x7f4c14161b90 con 0x7f4c141617b0 2023-12-04T10:44:08.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.795+0000 7f4c1a3ad640 1 --2- 172.21.15.63:0/961994166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140b2460 0x7f4c140b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:08.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.796+0000 7f4c193ab640 1 --2- 172.21.15.63:0/961994166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140c4560 0x7f4c140b1db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009870 tx=0x7f4c0002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9037c18a38629bb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:08.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.796+0000 7f4c18baa640 1 -- 172.21.15.63:0/961994166 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00030840 con 0x7f4c140c4560 2023-12-04T10:44:08.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.796+0000 7f4c18baa640 1 -- 172.21.15.63:0/961994166 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c000309a0 con 0x7f4c140c4560 2023-12-04T10:44:08.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.796+0000 7f4c18baa640 1 -- 172.21.15.63:0/961994166 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00030d30 con 0x7f4c140c4560 2023-12-04T10:44:08.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.797+0000 7f4c1abae640 1 -- 172.21.15.63:0/961994166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140c4560 msgr2=0x7f4c140b1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.797+0000 7f4c1abae640 1 --2- 172.21.15.63:0/961994166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140c4560 0x7f4c140b1db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009870 tx=0x7f4c0002b980 comp rx=0 tx=0).stop 2023-12-04T10:44:08.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.797+0000 7f4c1abae640 1 -- 172.21.15.63:0/961994166 shutdown_connections 2023-12-04T10:44:08.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.797+0000 7f4c1abae640 1 --2- 172.21.15.63:0/961994166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c140b2460 0x7f4c140b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.797+0000 7f4c1abae640 1 --2- 172.21.15.63:0/961994166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140c4560 0x7f4c140b1db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.797+0000 7f4c1abae640 1 -- 172.21.15.63:0/961994166 >> 172.21.15.63:0/961994166 conn(0x7f4c140d0e80 msgr2=0x7f4c140d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:08.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.797+0000 7f4c1abae640 1 -- 172.21.15.63:0/961994166 shutdown_connections 2023-12-04T10:44:08.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.797+0000 7f4c1abae640 1 -- 172.21.15.63:0/961994166 wait complete. 2023-12-04T10:44:08.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.799+0000 7f4c1abae640 1 Processor -- start 2023-12-04T10:44:08.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.800+0000 7f4c1abae640 1 -- start start 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c1abae640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140b2460 0x7f4c141f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c1abae640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c140c4560 0x7f4c1409c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c1abae640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c141617b0 0x7f4c1409dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c1abae640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1409cbe0 con 0x7f4c140b2460 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c1abae640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c141f7170 con 0x7f4c140c4560 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c1abae640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1409eb60 con 0x7f4c141617b0 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c19bac640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140b2460 0x7f4c141f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c19bac640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140b2460 0x7f4c141f7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39646/0 (socket says 172.21.15.63:39646) 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.801+0000 7f4c19bac640 1 -- 172.21.15.63:0/4187001227 learned_addr learned my addr 172.21.15.63:0/4187001227 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c193ab640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c140c4560 0x7f4c1409c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c1a3ad640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c141617b0 0x7f4c1409dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c19bac640 1 -- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c141617b0 msgr2=0x7f4c1409dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c19bac640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c141617b0 0x7f4c1409dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c19bac640 1 -- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c140c4560 msgr2=0x7f4c1409c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:08.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c19bac640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c140c4560 0x7f4c1409c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:08.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c19bac640 1 -- 172.21.15.63:0/4187001227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000094d0 con 0x7f4c140b2460 2023-12-04T10:44:08.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c193ab640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c140c4560 0x7f4c1409c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:08.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c1a3ad640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c141617b0 0x7f4c1409dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:08.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c19bac640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140b2460 0x7f4c141f7f10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c7c0 tx=0x7f4c0800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:08.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c127fc640 1 -- 172.21.15.63:0/4187001227 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800a640 con 0x7f4c140b2460 2023-12-04T10:44:08.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c127fc640 1 -- 172.21.15.63:0/4187001227 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0800a7c0 con 0x7f4c140b2460 2023-12-04T10:44:08.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c127fc640 1 -- 172.21.15.63:0/4187001227 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0800ab70 con 0x7f4c140b2460 2023-12-04T10:44:08.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.802+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c141f7430 con 0x7f4c140b2460 2023-12-04T10:44:08.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.803+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c141f79f0 con 0x7f4c140b2460 2023-12-04T10:44:08.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.804+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1404e840 con 0x7f4c140b2460 2023-12-04T10:44:08.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.805+0000 7f4c127fc640 1 -- 172.21.15.63:0/4187001227 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c0800acd0 con 0x7f4c140b2460 2023-12-04T10:44:08.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.805+0000 7f4c127fc640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4bf806ae40 0x7f4bf806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:08.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.806+0000 7f4c127fc640 1 -- 172.21.15.63:0/4187001227 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c08088e30 con 0x7f4c140b2460 2023-12-04T10:44:08.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.806+0000 7f4c193ab640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4bf806ae40 0x7f4bf806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:08.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.807+0000 7f4c193ab640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4bf806ae40 0x7f4bf806d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c00036000 tx=0x7f4c0003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:08.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:08.811+0000 7f4c127fc640 1 -- 172.21.15.63:0/4187001227 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c08053b50 con 0x7f4c140b2460 2023-12-04T10:44:09.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.013+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c140c7bf0 con 0x7f4c140b2460 2023-12-04T10:44:09.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.014+0000 7f4c127fc640 1 -- 172.21.15.63:0/4187001227 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c080180a0 con 0x7f4c140b2460 2023-12-04T10:44:09.015 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:09.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4bf806ae40 msgr2=0x7f4bf806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4bf806ae40 0x7f4bf806d300 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4c00036000 tx=0x7f4c0003b040 comp rx=0 tx=0).stop 2023-12-04T10:44:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140b2460 msgr2=0x7f4c141f7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140b2460 0x7f4c141f7f10 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c7c0 tx=0x7f4c0800cc80 comp rx=0 tx=0).stop 2023-12-04T10:44:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 shutdown_connections 2023-12-04T10:44:09.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4bf806ae40 0x7f4bf806d300 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c141617b0 0x7f4c1409dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c140c4560 0x7f4c1409c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 --2- 172.21.15.63:0/4187001227 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c140b2460 0x7f4c141f7f10 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 >> 172.21.15.63:0/4187001227 conn(0x7f4c140d0e80 msgr2=0x7f4c140661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 shutdown_connections 2023-12-04T10:44:09.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.017+0000 7f4c1abae640 1 -- 172.21.15.63:0/4187001227 wait complete. 2023-12-04T10:44:09.039 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:09.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.257+0000 7f5925cbb640 1 Processor -- start 2023-12-04T10:44:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.258+0000 7f5925cbb640 1 -- start start 2023-12-04T10:44:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.259+0000 7f5925cbb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f592015d5d0 0x7f59200d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.259+0000 7f5925cbb640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59200d1fb0 0x7f59200b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.259+0000 7f5925cbb640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59200b2710 con 0x7f59200ce8e0 2023-12-04T10:44:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.259+0000 7f5925cbb640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59200ced70 con 0x7f59200d1fb0 2023-12-04T10:44:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.259+0000 7f5925cbb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59200cf050 con 0x7f592015d5d0 2023-12-04T10:44:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.260+0000 7f591ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59200d1fb0 0x7f59200b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.260+0000 7f591ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f59200d1fb0 0x7f59200b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39648/0 (socket says 172.21.15.63:39648) 2023-12-04T10:44:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.260+0000 7f591ffff640 1 -- 172.21.15.63:0/2603940076 learned_addr learned my addr 172.21.15.63:0/2603940076 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.260+0000 7f591f7fe640 1 --2- 172.21.15.63:0/2603940076 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f592015d5d0 0x7f59200d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.260+0000 7f591ffff640 1 -- 172.21.15.63:0/2603940076 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f592015d5d0 msgr2=0x7f59200d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.260+0000 7f591ffff640 1 --2- 172.21.15.63:0/2603940076 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f592015d5d0 0x7f59200d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.260+0000 7f591ffff640 1 -- 172.21.15.63:0/2603940076 >> v1:172.21.15.66:6789/0 conn(0x7f59200ce8e0 legacy=0x7f59200d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.260+0000 7f591ffff640 1 -- 172.21.15.63:0/2603940076 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59200b2960 con 0x7f59200d1fb0 2023-12-04T10:44:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.261+0000 7f591ffff640 1 --2- 172.21.15.63:0/2603940076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f59200b3160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5918009e50 tx=0x7f591802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954a6d333d675011 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f591effd640 1 -- 172.21.15.63:0/2603940076 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591802ca70 con 0x7f59200d1fb0 2023-12-04T10:44:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f591effd640 1 -- 172.21.15.63:0/2603940076 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591802cbd0 con 0x7f59200d1fb0 2023-12-04T10:44:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f591effd640 1 -- 172.21.15.63:0/2603940076 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59180343f0 con 0x7f59200d1fb0 2023-12-04T10:44:09.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f5925cbb640 1 -- 172.21.15.63:0/2603940076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 msgr2=0x7f59200b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f5925cbb640 1 --2- 172.21.15.63:0/2603940076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f59200b3160 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5918009e50 tx=0x7f591802bed0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f5925cbb640 1 -- 172.21.15.63:0/2603940076 shutdown_connections 2023-12-04T10:44:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f5925cbb640 1 --2- 172.21.15.63:0/2603940076 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f59200b3160 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f5925cbb640 1 --2- 172.21.15.63:0/2603940076 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f592015d5d0 0x7f59200d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.262+0000 7f5925cbb640 1 -- 172.21.15.63:0/2603940076 >> 172.21.15.63:0/2603940076 conn(0x7f592009c600 msgr2=0x7f59200d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.263+0000 7f5925cbb640 1 -- 172.21.15.63:0/2603940076 shutdown_connections 2023-12-04T10:44:09.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.263+0000 7f5925cbb640 1 -- 172.21.15.63:0/2603940076 wait complete. 2023-12-04T10:44:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.265+0000 7f5925cbb640 1 Processor -- start 2023-12-04T10:44:09.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.265+0000 7f5925cbb640 1 -- start start 2023-12-04T10:44:09.268 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.266+0000 7f5925cbb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f5920142440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.266+0000 7f5925cbb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592015d5d0 0x7f59200caad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.266+0000 7f5925cbb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5920160620 0x7f59200cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.266+0000 7f5925cbb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5920160440 con 0x7f59200d1fb0 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.266+0000 7f5925cbb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59200b8800 con 0x7f592015d5d0 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.266+0000 7f5925cbb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5920156d40 con 0x7f5920160620 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f5920142440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f5920142440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39664/0 (socket says 172.21.15.63:39664) 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 -- 172.21.15.63:0/1173569935 learned_addr learned my addr 172.21.15.63:0/1173569935 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591ffff640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5920160620 0x7f59200cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 -- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5920160620 msgr2=0x7f59200cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5920160620 0x7f59200cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f5917fff640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592015d5d0 0x7f59200caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 -- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592015d5d0 msgr2=0x7f59200caad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592015d5d0 0x7f59200caad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 -- 172.21.15.63:0/1173569935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5918009b30 con 0x7f59200d1fb0 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591ffff640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5920160620 0x7f59200cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.267+0000 7f591f7fe640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f5920142440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f591000d800 tx=0x7f591000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.268+0000 7f591cff9640 1 -- 172.21.15.63:0/1173569935 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000b6c0 con 0x7f59200d1fb0 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.268+0000 7f591cff9640 1 -- 172.21.15.63:0/1173569935 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f591000b820 con 0x7f59200d1fb0 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.268+0000 7f591cff9640 1 -- 172.21.15.63:0/1173569935 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f591000bbb0 con 0x7f59200d1fb0 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.268+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59200b8a70 con 0x7f59200d1fb0 2023-12-04T10:44:09.270 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.268+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5920142980 con 0x7f59200d1fb0 2023-12-04T10:44:09.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.269+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5920067af0 con 0x7f59200d1fb0 2023-12-04T10:44:09.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.270+0000 7f591cff9640 1 -- 172.21.15.63:0/1173569935 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f591000bd10 con 0x7f59200d1fb0 2023-12-04T10:44:09.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.271+0000 7f591cff9640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f590006ae70 0x7f590006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.271+0000 7f591cff9640 1 -- 172.21.15.63:0/1173569935 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5910089e30 con 0x7f59200d1fb0 2023-12-04T10:44:09.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.271+0000 7f5917fff640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f590006ae70 0x7f590006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.272+0000 7f5917fff640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f590006ae70 0x7f590006d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59200cc320 tx=0x7f5908008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:09.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.276+0000 7f591cff9640 1 -- 172.21.15.63:0/1173569935 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5910054bd0 con 0x7f59200d1fb0 2023-12-04T10:44:09.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.468+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5920068710 con 0x7f59200d1fb0 2023-12-04T10:44:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.469+0000 7f591cff9640 1 -- 172.21.15.63:0/1173569935 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59100581f0 con 0x7f59200d1fb0 2023-12-04T10:44:09.470 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f590006ae70 msgr2=0x7f590006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f590006ae70 0x7f590006d330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f59200cc320 tx=0x7f5908008040 comp rx=0 tx=0).stop 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 msgr2=0x7f5920142440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f5920142440 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f591000d800 tx=0x7f591000dcc0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 shutdown_connections 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f590006ae70 0x7f590006d330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5920160620 0x7f59200cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f592015d5d0 0x7f59200caad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 --2- 172.21.15.63:0/1173569935 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f59200d1fb0 0x7f5920142440 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 >> 172.21.15.63:0/1173569935 conn(0x7f592009c600 msgr2=0x7f592006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:09.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 shutdown_connections 2023-12-04T10:44:09.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.472+0000 7f5925cbb640 1 -- 172.21.15.63:0/1173569935 wait complete. 2023-12-04T10:44:09.492 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:44:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.719+0000 7fbee84d3640 1 Processor -- start 2023-12-04T10:44:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.719+0000 7fbee84d3640 1 -- start start 2023-12-04T10:44:09.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.721+0000 7fbee84d3640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbee00ce8e0 0x7fbee00d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.721+0000 7fbee84d3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee00d1de0 0x7fbee00b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.721+0000 7fbee84d3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee00b2710 con 0x7fbee015d5d0 2023-12-04T10:44:09.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.721+0000 7fbee84d3640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee00d2290 con 0x7fbee00ce8e0 2023-12-04T10:44:09.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.721+0000 7fbee84d3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00d4150 con 0x7fbee00d1de0 2023-12-04T10:44:09.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.721+0000 7fbee5a6e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbee00ce8e0 0x7fbee00d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.721+0000 7fbee5a6e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbee00ce8e0 0x7fbee00d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39672/0 (socket says 172.21.15.63:39672) 2023-12-04T10:44:09.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.721+0000 7fbee5a6e640 1 -- 172.21.15.63:0/2569247261 learned_addr learned my addr 172.21.15.63:0/2569247261 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:09.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.722+0000 7fbee6a70640 1 --2- 172.21.15.63:0/2569247261 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee00d1de0 0x7fbee00b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.722+0000 7fbee5a6e640 1 -- 172.21.15.63:0/2569247261 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee00d1de0 msgr2=0x7fbee00b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:09.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.722+0000 7fbee5a6e640 1 --2- 172.21.15.63:0/2569247261 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee00d1de0 0x7fbee00b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.722+0000 7fbee5a6e640 1 -- 172.21.15.63:0/2569247261 >> v1:172.21.15.66:6789/0 conn(0x7fbee015d5d0 legacy=0x7fbee00d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.722+0000 7fbee5a6e640 1 -- 172.21.15.63:0/2569247261 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee00ced70 con 0x7fbee00ce8e0 2023-12-04T10:44:09.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.723+0000 7fbee5a6e640 1 --2- 172.21.15.63:0/2569247261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00ce8e0 0x7fbee00d18a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009870 tx=0x7fbed002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8d8621788e43d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:09.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.723+0000 7fbee526d640 1 -- 172.21.15.63:0/2569247261 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0030840 con 0x7fbee00ce8e0 2023-12-04T10:44:09.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.723+0000 7fbee526d640 1 -- 172.21.15.63:0/2569247261 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed00309a0 con 0x7fbee00ce8e0 2023-12-04T10:44:09.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.723+0000 7fbee526d640 1 -- 172.21.15.63:0/2569247261 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0030d30 con 0x7fbee00ce8e0 2023-12-04T10:44:09.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.724+0000 7fbee84d3640 1 -- 172.21.15.63:0/2569247261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00ce8e0 msgr2=0x7fbee00d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.724+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2569247261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00ce8e0 0x7fbee00d18a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009870 tx=0x7fbed002b980 comp rx=0 tx=0).stop 2023-12-04T10:44:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.724+0000 7fbee84d3640 1 -- 172.21.15.63:0/2569247261 shutdown_connections 2023-12-04T10:44:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.724+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2569247261 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee00d1de0 0x7fbee00b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.724+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2569247261 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00ce8e0 0x7fbee00d18a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.724+0000 7fbee84d3640 1 -- 172.21.15.63:0/2569247261 >> 172.21.15.63:0/2569247261 conn(0x7fbee009c600 msgr2=0x7fbee00d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.724+0000 7fbee84d3640 1 -- 172.21.15.63:0/2569247261 shutdown_connections 2023-12-04T10:44:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.724+0000 7fbee84d3640 1 -- 172.21.15.63:0/2569247261 wait complete. 2023-12-04T10:44:09.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.726+0000 7fbee84d3640 1 Processor -- start 2023-12-04T10:44:09.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.726+0000 7fbee84d3640 1 -- start start 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.727+0000 7fbee84d3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbee00d1de0 0x7fbee00b8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.727+0000 7fbee84d3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee015d5d0 0x7fbee00cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.727+0000 7fbee84d3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00cc970 0x7fbee00ca390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.727+0000 7fbee84d3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00cce00 con 0x7fbee00cc970 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.727+0000 7fbee84d3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee00b1910 con 0x7fbee00d1de0 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.727+0000 7fbee84d3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee015e340 con 0x7fbee015d5d0 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00cc970 0x7fbee00ca390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00cc970 0x7fbee00ca390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39688/0 (socket says 172.21.15.63:39688) 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 -- 172.21.15.63:0/2485442547 learned_addr learned my addr 172.21.15.63:0/2485442547 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee5a6e640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee015d5d0 0x7fbee00cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee626f640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbee00d1de0 0x7fbee00b8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 -- 172.21.15.63:0/2485442547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee015d5d0 msgr2=0x7fbee00cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee015d5d0 0x7fbee00cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 -- 172.21.15.63:0/2485442547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbee00d1de0 msgr2=0x7fbee00b8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbee00d1de0 0x7fbee00b8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 -- 172.21.15.63:0/2485442547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed00094d0 con 0x7fbee00cc970 2023-12-04T10:44:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.728+0000 7fbee6a70640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00cc970 0x7fbee00ca390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbed8007e40 tx=0x7fbed800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.729+0000 7fbed6ffd640 1 -- 172.21.15.63:0/2485442547 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed8014620 con 0x7fbee00cc970 2023-12-04T10:44:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.729+0000 7fbed6ffd640 1 -- 172.21.15.63:0/2485442547 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed800ee90 con 0x7fbee00cc970 2023-12-04T10:44:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.729+0000 7fbed6ffd640 1 -- 172.21.15.63:0/2485442547 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed80149e0 con 0x7fbee00cc970 2023-12-04T10:44:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.729+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee00ccff0 con 0x7fbee00cc970 2023-12-04T10:44:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.729+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee015e870 con 0x7fbee00cc970 2023-12-04T10:44:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.730+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee0068710 con 0x7fbee00cc970 2023-12-04T10:44:09.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.731+0000 7fbed6ffd640 1 -- 172.21.15.63:0/2485442547 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbed8014b40 con 0x7fbee00cc970 2023-12-04T10:44:09.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.732+0000 7fbed6ffd640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbec406ae70 0x7fbec406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:09.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.732+0000 7fbed6ffd640 1 -- 172.21.15.63:0/2485442547 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbed808a350 con 0x7fbee00cc970 2023-12-04T10:44:09.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.732+0000 7fbee626f640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbec406ae70 0x7fbec406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:09.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.733+0000 7fbee626f640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbec406ae70 0x7fbec406d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbedc000f60 tx=0x7fbedc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:09.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.737+0000 7fbed6ffd640 1 -- 172.21.15.63:0/2485442547 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbed8055070 con 0x7fbee00cc970 2023-12-04T10:44:09.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.930+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbee00b9180 con 0x7fbee00cc970 2023-12-04T10:44:09.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.931+0000 7fbed6ffd640 1 -- 172.21.15.63:0/2485442547 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbed8058690 con 0x7fbee00cc970 2023-12-04T10:44:09.932 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbec406ae70 msgr2=0x7fbec406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbec406ae70 0x7fbec406d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbedc000f60 tx=0x7fbedc009040 comp rx=0 tx=0).stop 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00cc970 msgr2=0x7fbee00ca390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00cc970 0x7fbee00ca390 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbed8007e40 tx=0x7fbed800e4b0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 shutdown_connections 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbec406ae70 0x7fbec406d330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbee015d5d0 0x7fbee00cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbee00cc970 0x7fbee00ca390 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 --2- 172.21.15.63:0/2485442547 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbee00d1de0 0x7fbee00b8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 >> 172.21.15.63:0/2485442547 conn(0x7fbee009c600 msgr2=0x7fbee006b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 shutdown_connections 2023-12-04T10:44:09.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:09.934+0000 7fbee84d3640 1 -- 172.21.15.63:0/2485442547 wait complete. 2023-12-04T10:44:09.953 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T10:44:10.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.167+0000 7f6f55c31640 1 Processor -- start 2023-12-04T10:44:10.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.167+0000 7f6f55c31640 1 -- start start 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f55c31640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6f50143b60 0x7f6f500ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f55c31640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500724e0 0x7f6f500cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f55c31640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f500c81b0 0x7f6f500ce040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f55c31640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500cb5b0 con 0x7f6f500c81b0 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f55c31640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f500ca930 con 0x7f6f50143b60 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f55c31640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500cac10 con 0x7f6f500724e0 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f4ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f500c81b0 0x7f6f500ce040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f4ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6f500c81b0 0x7f6f500ce040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39696/0 (socket says 172.21.15.63:39696) 2023-12-04T10:44:10.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f4ffff640 1 -- 172.21.15.63:0/423203772 learned_addr learned my addr 172.21.15.63:0/423203772 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:10.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f4f7fe640 1 --2- 172.21.15.63:0/423203772 >> v2:172.21.15.66:3300/0 conn(0x7f6f50143b60 0x7f6f500ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.169+0000 7f6f47fff640 1 --2- 172.21.15.63:0/423203772 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500724e0 0x7f6f500cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.170+0000 7f6f4ffff640 1 -- 172.21.15.63:0/423203772 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500724e0 msgr2=0x7f6f500cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:10.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.170+0000 7f6f4ffff640 1 --2- 172.21.15.63:0/423203772 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500724e0 0x7f6f500cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.170+0000 7f6f4ffff640 1 -- 172.21.15.63:0/423203772 >> v2:172.21.15.66:3300/0 conn(0x7f6f50143b60 msgr2=0x7f6f500ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:10.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.170+0000 7f6f4ffff640 1 --2- 172.21.15.63:0/423203772 >> v2:172.21.15.66:3300/0 conn(0x7f6f50143b60 0x7f6f500ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.170+0000 7f6f4ffff640 1 -- 172.21.15.63:0/423203772 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f500caef0 con 0x7f6f500c81b0 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.171+0000 7f6f4ffff640 1 --2- 172.21.15.63:0/423203772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f500c81b0 0x7f6f500ce040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6f500746d0 tx=0x7f6f4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fe58a0cce0049c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.171+0000 7f6f4effd640 1 -- 172.21.15.63:0/423203772 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4802ca70 con 0x7f6f500c81b0 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.171+0000 7f6f4effd640 1 -- 172.21.15.63:0/423203772 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4802cbd0 con 0x7f6f500c81b0 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.171+0000 7f6f4effd640 1 -- 172.21.15.63:0/423203772 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480343f0 con 0x7f6f500c81b0 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 -- 172.21.15.63:0/423203772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f500c81b0 msgr2=0x7f6f500ce040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 --2- 172.21.15.63:0/423203772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f500c81b0 0x7f6f500ce040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6f500746d0 tx=0x7f6f4802bed0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 -- 172.21.15.63:0/423203772 shutdown_connections 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 --2- 172.21.15.63:0/423203772 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f500724e0 0x7f6f500cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 --2- 172.21.15.63:0/423203772 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f500c81b0 0x7f6f500ce040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 --2- 172.21.15.63:0/423203772 >> v2:172.21.15.66:3300/0 conn(0x7f6f50143b60 0x7f6f500ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 -- 172.21.15.63:0/423203772 >> 172.21.15.63:0/423203772 conn(0x7f6f500cee80 msgr2=0x7f6f500cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:10.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 -- 172.21.15.63:0/423203772 shutdown_connections 2023-12-04T10:44:10.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.172+0000 7f6f55c31640 1 -- 172.21.15.63:0/423203772 wait complete. 2023-12-04T10:44:10.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.174+0000 7f6f55c31640 1 Processor -- start 2023-12-04T10:44:10.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.174+0000 7f6f55c31640 1 -- start start 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f55c31640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f500c81b0 0x7f6f500b2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f55c31640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f50143b60 0x7f6f50141db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f55c31640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f50142650 0x7f6f501de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f55c31640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500b1c00 con 0x7f6f50142650 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f55c31640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500b1e50 con 0x7f6f500c81b0 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f55c31640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f500b2130 con 0x7f6f50143b60 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f4ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f50142650 0x7f6f501de100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f4ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f50142650 0x7f6f501de100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39702/0 (socket says 172.21.15.63:39702) 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.175+0000 7f6f4ffff640 1 -- 172.21.15.63:0/4214611569 learned_addr learned my addr 172.21.15.63:0/4214611569 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f47fff640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f50143b60 0x7f6f50141db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f4f7fe640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f500c81b0 0x7f6f500b2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f4ffff640 1 -- 172.21.15.63:0/4214611569 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f50143b60 msgr2=0x7f6f50141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f4ffff640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f50143b60 0x7f6f50141db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f4ffff640 1 -- 172.21.15.63:0/4214611569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f500c81b0 msgr2=0x7f6f500b2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f4ffff640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f500c81b0 0x7f6f500b2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f4ffff640 1 -- 172.21.15.63:0/4214611569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48009b30 con 0x7f6f50142650 2023-12-04T10:44:10.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f4ffff640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f50142650 0x7f6f501de100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f48036040 tx=0x7f6f48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.176+0000 7f6f4cff9640 1 -- 172.21.15.63:0/4214611569 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48009510 con 0x7f6f50142650 2023-12-04T10:44:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.177+0000 7f6f4cff9640 1 -- 172.21.15.63:0/4214611569 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f4803e450 con 0x7f6f50142650 2023-12-04T10:44:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.177+0000 7f6f4cff9640 1 -- 172.21.15.63:0/4214611569 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f4803e800 con 0x7f6f50142650 2023-12-04T10:44:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.177+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f500b2410 con 0x7f6f50142650 2023-12-04T10:44:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.177+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f500b29d0 con 0x7f6f50142650 2023-12-04T10:44:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.178+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f500b2bc0 con 0x7f6f50142650 2023-12-04T10:44:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.179+0000 7f6f4cff9640 1 -- 172.21.15.63:0/4214611569 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f4803e960 con 0x7f6f50142650 2023-12-04T10:44:10.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.180+0000 7f6f4cff9640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f3006ae40 0x7f6f3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.180+0000 7f6f4cff9640 1 -- 172.21.15.63:0/4214611569 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f480ac6d0 con 0x7f6f50142650 2023-12-04T10:44:10.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.180+0000 7f6f4f7fe640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f3006ae40 0x7f6f3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.181+0000 7f6f4f7fe640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f3006ae40 0x7f6f3006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f40006fd0 tx=0x7f6f40008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.184+0000 7f6f4cff9640 1 -- 172.21.15.63:0/4214611569 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f48077490 con 0x7f6f50142650 2023-12-04T10:44:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.392+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6f50068710 con 0x7f6f50142650 2023-12-04T10:44:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.392+0000 7f6f4cff9640 1 -- 172.21.15.63:0/4214611569 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6f4807aab0 con 0x7f6f50142650 2023-12-04T10:44:10.393 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-04T10:44:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f3006ae40 msgr2=0x7f6f3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f3006ae40 0x7f6f3006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f40006fd0 tx=0x7f6f40008040 comp rx=0 tx=0).stop 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f50142650 msgr2=0x7f6f501de100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f50142650 0x7f6f501de100 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6f48036040 tx=0x7f6f48004a40 comp rx=0 tx=0).stop 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 shutdown_connections 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f3006ae40 0x7f6f3006d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f50143b60 0x7f6f50141db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f50142650 0x7f6f501de100 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 --2- 172.21.15.63:0/4214611569 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f500c81b0 0x7f6f500b2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.395+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 >> 172.21.15.63:0/4214611569 conn(0x7f6f500cee80 msgr2=0x7f6f500c8690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.396+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 shutdown_connections 2023-12-04T10:44:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.396+0000 7f6f55c31640 1 -- 172.21.15.63:0/4214611569 wait complete. 2023-12-04T10:44:10.416 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:44:10.416 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:44:10.470 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:10.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.686+0000 7fdfc99a9640 1 Processor -- start 2023-12-04T10:44:10.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.686+0000 7fdfc99a9640 1 -- start start 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc99a9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc415b1e0 0x7fdfc40ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc99a9640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfc40717d0 0x7fdfc415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc99a9640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc40cb000 con 0x7fdfc40caba0 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc99a9640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc415aa30 con 0x7fdfc40717d0 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc99a9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc415b5c0 con 0x7fdfc415b1e0 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc37fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfc40717d0 0x7fdfc415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc37fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdfc40717d0 0x7fdfc415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39712/0 (socket says 172.21.15.63:39712) 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc37fe640 1 -- 172.21.15.63:0/3506225489 learned_addr learned my addr 172.21.15.63:0/3506225489 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:10.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc27fc640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdfc40caba0 0x7fdfc40710c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46386/0 (socket says 172.21.15.63:46386) 2023-12-04T10:44:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.688+0000 7fdfc2ffd640 1 --2- 172.21.15.63:0/3506225489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc415b1e0 0x7fdfc40ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.689+0000 7fdfc37fe640 1 -- 172.21.15.63:0/3506225489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc415b1e0 msgr2=0x7fdfc40ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.689+0000 7fdfc37fe640 1 --2- 172.21.15.63:0/3506225489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc415b1e0 0x7fdfc40ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.689+0000 7fdfc37fe640 1 -- 172.21.15.63:0/3506225489 >> v1:172.21.15.63:6789/0 conn(0x7fdfc40caba0 legacy=0x7fdfc40710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.689+0000 7fdfc37fe640 1 -- 172.21.15.63:0/3506225489 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc4071dd0 con 0x7fdfc40717d0 2023-12-04T10:44:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.689+0000 7fdfc1ffb640 1 -- 172.21.15.63:0/3506225489 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 519687239 0 0) 0x7fdfc40cb000 con 0x7fdfc40caba0 2023-12-04T10:44:10.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.689+0000 7fdfc2ffd640 1 --2- 172.21.15.63:0/3506225489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc415b1e0 0x7fdfc40ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:10.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.690+0000 7fdfc37fe640 1 --2- 172.21.15.63:0/3506225489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc415bd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009e50 tx=0x7fdfbc02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facf501d15f0146f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:10.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.690+0000 7fdfc1ffb640 1 -- 172.21.15.63:0/3506225489 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc02caf0 con 0x7fdfc40717d0 2023-12-04T10:44:10.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.690+0000 7fdfc1ffb640 1 -- 172.21.15.63:0/3506225489 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfbc02cc50 con 0x7fdfc40717d0 2023-12-04T10:44:10.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.690+0000 7fdfc1ffb640 1 -- 172.21.15.63:0/3506225489 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfbc0343f0 con 0x7fdfc40717d0 2023-12-04T10:44:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.691+0000 7fdfc99a9640 1 -- 172.21.15.63:0/3506225489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 msgr2=0x7fdfc415bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.691+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/3506225489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc415bd50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdfbc009e50 tx=0x7fdfbc02bf50 comp rx=0 tx=0).stop 2023-12-04T10:44:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.691+0000 7fdfc99a9640 1 -- 172.21.15.63:0/3506225489 shutdown_connections 2023-12-04T10:44:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.691+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/3506225489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc415bd50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.691+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/3506225489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc415b1e0 0x7fdfc40ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.691+0000 7fdfc99a9640 1 -- 172.21.15.63:0/3506225489 >> 172.21.15.63:0/3506225489 conn(0x7fdfc40cee80 msgr2=0x7fdfc40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.691+0000 7fdfc99a9640 1 -- 172.21.15.63:0/3506225489 shutdown_connections 2023-12-04T10:44:10.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.691+0000 7fdfc99a9640 1 -- 172.21.15.63:0/3506225489 wait complete. 2023-12-04T10:44:10.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.693+0000 7fdfc99a9640 1 Processor -- start 2023-12-04T10:44:10.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.693+0000 7fdfc99a9640 1 -- start start 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc99a9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc4140470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc99a9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc40caba0 0x7fdfc4154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc99a9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc415b1e0 0x7fdfc4155210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc99a9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4159e20 con 0x7fdfc40717d0 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc99a9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc4157430 con 0x7fdfc415b1e0 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc99a9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc41579b0 con 0x7fdfc40caba0 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc4140470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc2ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc4140470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39718/0 (socket says 172.21.15.63:39718) 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.694+0000 7fdfc2ffd640 1 -- 172.21.15.63:0/2752776925 learned_addr learned my addr 172.21.15.63:0/2752776925 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc27fc640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc40caba0 0x7fdfc4154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc37fe640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc415b1e0 0x7fdfc4155210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc2ffd640 1 -- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc40caba0 msgr2=0x7fdfc4154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc2ffd640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc40caba0 0x7fdfc4154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc2ffd640 1 -- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc415b1e0 msgr2=0x7fdfc4155210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc2ffd640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc415b1e0 0x7fdfc4155210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc2ffd640 1 -- 172.21.15.63:0/2752776925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfbc009b30 con 0x7fdfc40717d0 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc27fc640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc40caba0 0x7fdfc4154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc37fe640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc415b1e0 0x7fdfc4155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc2ffd640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc4140470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d7d0 tx=0x7fdfb400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfabfff640 1 -- 172.21.15.63:0/2752776925 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4004030 con 0x7fdfc40717d0 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfabfff640 1 -- 172.21.15.63:0/2752776925 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb4004190 con 0x7fdfc40717d0 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfabfff640 1 -- 172.21.15.63:0/2752776925 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb4004520 con 0x7fdfc40717d0 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.695+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc41f3050 con 0x7fdfc40717d0 2023-12-04T10:44:10.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.696+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc415a2f0 con 0x7fdfc40717d0 2023-12-04T10:44:10.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.697+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfc4070150 con 0x7fdfc40717d0 2023-12-04T10:44:10.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.698+0000 7fdfabfff640 1 -- 172.21.15.63:0/2752776925 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdfb40096a0 con 0x7fdfc40717d0 2023-12-04T10:44:10.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.698+0000 7fdfabfff640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdfb006ae70 0x7fdfb006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:10.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.699+0000 7fdfabfff640 1 -- 172.21.15.63:0/2752776925 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdfb4089ae0 con 0x7fdfc40717d0 2023-12-04T10:44:10.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.699+0000 7fdfc27fc640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdfb006ae70 0x7fdfb006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:10.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.699+0000 7fdfc27fc640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdfb006ae70 0x7fdfb006d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b2270 tx=0x7fdfb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:10.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.703+0000 7fdfabfff640 1 -- 172.21.15.63:0/2752776925 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdfb4054890 con 0x7fdfc40717d0 2023-12-04T10:44:10.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.904+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdfc4068710 con 0x7fdfc40717d0 2023-12-04T10:44:10.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.908+0000 7fdfabfff640 1 -- 172.21.15.63:0/2752776925 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fdfb4057eb0 con 0x7fdfc40717d0 2023-12-04T10:44:10.910 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:10.910 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdfb006ae70 msgr2=0x7fdfb006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdfb006ae70 0x7fdfb006d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fdfc40b2270 tx=0x7fdfb8009040 comp rx=0 tx=0).stop 2023-12-04T10:44:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 msgr2=0x7fdfc4140470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc4140470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400d7d0 tx=0x7fdfb400dc90 comp rx=0 tx=0).stop 2023-12-04T10:44:10.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 shutdown_connections 2023-12-04T10:44:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdfb006ae70 0x7fdfb006d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdfc40caba0 0x7fdfc4154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdfc415b1e0 0x7fdfc4155210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 --2- 172.21.15.63:0/2752776925 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdfc40717d0 0x7fdfc4140470 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 >> 172.21.15.63:0/2752776925 conn(0x7fdfc40cee80 msgr2=0x7fdfc40aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 shutdown_connections 2023-12-04T10:44:10.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:10.911+0000 7fdfc99a9640 1 -- 172.21.15.63:0/2752776925 wait complete. 2023-12-04T10:44:10.931 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:10.931 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:11.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.160+0000 7f212cf68640 1 Processor -- start 2023-12-04T10:44:11.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.160+0000 7f212cf68640 1 -- start start 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.161+0000 7f212cf68640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2128144a00 0x7f21280b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.161+0000 7f212cf68640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f21280ca290 0x7f21280ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.161+0000 7f212cf68640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21280b2370 con 0x7f21280701b0 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.161+0000 7f212cf68640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280cabe0 con 0x7f2128144a00 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.161+0000 7f212cf68640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21280cae80 con 0x7f21280ca290 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f212659c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2128144a00 0x7f21280b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f212659c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2128144a00 0x7f21280b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39728/0 (socket says 172.21.15.63:39728) 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f212659c640 1 -- 172.21.15.63:0/3543642646 learned_addr learned my addr 172.21.15.63:0/3543642646 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:11.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f2126d9d640 1 --2- 172.21.15.63:0/3543642646 >> v2:172.21.15.66:3300/0 conn(0x7f21280ca290 0x7f21280ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f212659c640 1 -- 172.21.15.63:0/3543642646 >> v2:172.21.15.66:3300/0 conn(0x7f21280ca290 msgr2=0x7f21280ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:11.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f212659c640 1 --2- 172.21.15.63:0/3543642646 >> v2:172.21.15.66:3300/0 conn(0x7f21280ca290 0x7f21280ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f212659c640 1 -- 172.21.15.63:0/3543642646 >> v1:172.21.15.66:6789/0 conn(0x7f21280701b0 legacy=0x7f21280705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:11.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f212659c640 1 -- 172.21.15.63:0/3543642646 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f212806c460 con 0x7f2128144a00 2023-12-04T10:44:11.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.162+0000 7f2126d9d640 1 --2- 172.21.15.63:0/3543642646 >> v2:172.21.15.66:3300/0 conn(0x7f21280ca290 0x7f21280ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:11.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.163+0000 7f212659c640 1 --2- 172.21.15.63:0/3543642646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f21280b1e30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2128071990 tx=0x7f211802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993c9d0f4fe6bdb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:11.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212559a640 1 -- 172.21.15.63:0/3543642646 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f211802ca80 con 0x7f2128144a00 2023-12-04T10:44:11.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212559a640 1 -- 172.21.15.63:0/3543642646 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f211802cbe0 con 0x7f2128144a00 2023-12-04T10:44:11.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212559a640 1 -- 172.21.15.63:0/3543642646 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21180343f0 con 0x7f2128144a00 2023-12-04T10:44:11.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212cf68640 1 -- 172.21.15.63:0/3543642646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 msgr2=0x7f21280b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212cf68640 1 --2- 172.21.15.63:0/3543642646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f21280b1e30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2128071990 tx=0x7f211802bee0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212cf68640 1 -- 172.21.15.63:0/3543642646 shutdown_connections 2023-12-04T10:44:11.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212cf68640 1 --2- 172.21.15.63:0/3543642646 >> v2:172.21.15.66:3300/0 conn(0x7f21280ca290 0x7f21280ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212cf68640 1 --2- 172.21.15.63:0/3543642646 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f21280b1e30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.164+0000 7f212cf68640 1 -- 172.21.15.63:0/3543642646 >> 172.21.15.63:0/3543642646 conn(0x7f21280cee80 msgr2=0x7f21280cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:11.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.165+0000 7f212cf68640 1 -- 172.21.15.63:0/3543642646 shutdown_connections 2023-12-04T10:44:11.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.165+0000 7f212cf68640 1 -- 172.21.15.63:0/3543642646 wait complete. 2023-12-04T10:44:11.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.166+0000 7f212cf68640 1 Processor -- start 2023-12-04T10:44:11.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.166+0000 7f212cf68640 1 -- start start 2023-12-04T10:44:11.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.167+0000 7f212cf68640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21280701b0 0x7f21281403f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.167+0000 7f212cf68640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21280ca290 0x7f212815a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.167+0000 7f212cf68640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f212815ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.167+0000 7f212cf68640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212815b280 con 0x7f2128144a00 2023-12-04T10:44:11.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.167+0000 7f212cf68640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21281f3080 con 0x7f21280701b0 2023-12-04T10:44:11.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.167+0000 7f212cf68640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21281f3360 con 0x7f21280ca290 2023-12-04T10:44:11.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2126d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f212815ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2126d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f212815ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39738/0 (socket says 172.21.15.63:39738) 2023-12-04T10:44:11.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2126d9d640 1 -- 172.21.15.63:0/542172593 learned_addr learned my addr 172.21.15.63:0/542172593 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:11.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f212659c640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21280701b0 0x7f21281403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2125d9b640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21280ca290 0x7f212815a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2126d9d640 1 -- 172.21.15.63:0/542172593 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21280ca290 msgr2=0x7f212815a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2126d9d640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21280ca290 0x7f212815a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2126d9d640 1 -- 172.21.15.63:0/542172593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21280701b0 msgr2=0x7f21281403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2126d9d640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21280701b0 0x7f21281403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.168+0000 7f2126d9d640 1 -- 172.21.15.63:0/542172593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2118009b30 con 0x7f2128144a00 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.169+0000 7f2126d9d640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f212815ad40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f212000c7f0 tx=0x7f212000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.169+0000 7f211effd640 1 -- 172.21.15.63:0/542172593 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120007820 con 0x7f2128144a00 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.169+0000 7f211effd640 1 -- 172.21.15.63:0/542172593 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2120007980 con 0x7f2128144a00 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.169+0000 7f211effd640 1 -- 172.21.15.63:0/542172593 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2120007d70 con 0x7f2128144a00 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.169+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21281f3640 con 0x7f2128144a00 2023-12-04T10:44:11.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.169+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21281f3c00 con 0x7f2128144a00 2023-12-04T10:44:11.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.170+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2128068710 con 0x7f2128144a00 2023-12-04T10:44:11.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.171+0000 7f211effd640 1 -- 172.21.15.63:0/542172593 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f21200113f0 con 0x7f2128144a00 2023-12-04T10:44:11.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.172+0000 7f211effd640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f210806ae40 0x7f210806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.172+0000 7f211effd640 1 -- 172.21.15.63:0/542172593 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2120089c00 con 0x7f2128144a00 2023-12-04T10:44:11.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.172+0000 7f212659c640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f210806ae40 0x7f210806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.173+0000 7f212659c640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f210806ae40 0x7f210806d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2118035000 tx=0x7f2118030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:11.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.177+0000 7f211effd640 1 -- 172.21.15.63:0/542172593 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21200549f0 con 0x7f2128144a00 2023-12-04T10:44:11.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.370+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f212806e2a0 con 0x7f2128144a00 2023-12-04T10:44:11.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.371+0000 7f211effd640 1 -- 172.21.15.63:0/542172593 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f212001f0a0 con 0x7f2128144a00 2023-12-04T10:44:11.372 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.373+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f210806ae40 msgr2=0x7f210806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.373+0000 7f212cf68640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f210806ae40 0x7f210806d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2118035000 tx=0x7f2118030000 comp rx=0 tx=0).stop 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.373+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 msgr2=0x7f212815ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.373+0000 7f212cf68640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f212815ad40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f212000c7f0 tx=0x7f212000ccb0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.374+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 shutdown_connections 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.374+0000 7f212cf68640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f210806ae40 0x7f210806d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.374+0000 7f212cf68640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f21280ca290 0x7f212815a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.374+0000 7f212cf68640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2128144a00 0x7f212815ad40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.374+0000 7f212cf68640 1 --2- 172.21.15.63:0/542172593 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f21280701b0 0x7f21281403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.374+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 >> 172.21.15.63:0/542172593 conn(0x7f21280cee80 msgr2=0x7f212806d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.374+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 shutdown_connections 2023-12-04T10:44:11.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.374+0000 7f212cf68640 1 -- 172.21.15.63:0/542172593 wait complete. 2023-12-04T10:44:11.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:11.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.620+0000 7f4950548640 1 Processor -- start 2023-12-04T10:44:11.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.620+0000 7f4950548640 1 -- start start 2023-12-04T10:44:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.622+0000 7f4950548640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4948143b60 0x7f49480ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.622+0000 7f4950548640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480724e0 0x7f49480cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.622+0000 7f4950548640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49480ca930 con 0x7f49480c81b0 2023-12-04T10:44:11.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.622+0000 7f4950548640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49480cb5b0 con 0x7f4948143b60 2023-12-04T10:44:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.622+0000 7f4950548640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49480cac10 con 0x7f49480724e0 2023-12-04T10:44:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.623+0000 7f494dae3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480724e0 0x7f49480cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.623+0000 7f494e2e4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4948143b60 0x7f49480ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.623+0000 7f494dae3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480724e0 0x7f49480cdb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:38310/0 (socket says 172.21.15.63:38310) 2023-12-04T10:44:11.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.623+0000 7f494dae3640 1 -- 172.21.15.63:0/2951142036 learned_addr learned my addr 172.21.15.63:0/2951142036 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:11.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.624+0000 7f494e2e4640 1 -- 172.21.15.63:0/2951142036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480724e0 msgr2=0x7f49480cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:11.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.624+0000 7f494e2e4640 1 --2- 172.21.15.63:0/2951142036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480724e0 0x7f49480cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.624+0000 7f494e2e4640 1 -- 172.21.15.63:0/2951142036 >> v1:172.21.15.66:6789/0 conn(0x7f49480c81b0 legacy=0x7f49480cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.624+0000 7f494e2e4640 1 -- 172.21.15.63:0/2951142036 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49480caef0 con 0x7f4948143b60 2023-12-04T10:44:11.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.624+0000 7f494dae3640 1 --2- 172.21.15.63:0/2951142036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480724e0 0x7f49480cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:44:11.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.625+0000 7f494e2e4640 1 --2- 172.21.15.63:0/2951142036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 0x7f49480ca330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f49440097a0 tx=0x7f494402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52cac387b0ac3730 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:11.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.626+0000 7f494d2e2640 1 -- 172.21.15.63:0/2951142036 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944031830 con 0x7f4948143b60 2023-12-04T10:44:11.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.626+0000 7f494d2e2640 1 -- 172.21.15.63:0/2951142036 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4944031990 con 0x7f4948143b60 2023-12-04T10:44:11.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.626+0000 7f494d2e2640 1 -- 172.21.15.63:0/2951142036 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4944031d20 con 0x7f4948143b60 2023-12-04T10:44:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.627+0000 7f4950548640 1 -- 172.21.15.63:0/2951142036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 msgr2=0x7f49480ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.627+0000 7f4950548640 1 --2- 172.21.15.63:0/2951142036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 0x7f49480ca330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f49440097a0 tx=0x7f494402b8d0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.627+0000 7f4950548640 1 -- 172.21.15.63:0/2951142036 shutdown_connections 2023-12-04T10:44:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.627+0000 7f4950548640 1 --2- 172.21.15.63:0/2951142036 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480724e0 0x7f49480cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.627+0000 7f4950548640 1 --2- 172.21.15.63:0/2951142036 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 0x7f49480ca330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.627+0000 7f4950548640 1 -- 172.21.15.63:0/2951142036 >> 172.21.15.63:0/2951142036 conn(0x7f49480cee80 msgr2=0x7f49480cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:11.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.627+0000 7f4950548640 1 -- 172.21.15.63:0/2951142036 shutdown_connections 2023-12-04T10:44:11.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.627+0000 7f4950548640 1 -- 172.21.15.63:0/2951142036 wait complete. 2023-12-04T10:44:11.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.629+0000 7f4950548640 1 Processor -- start 2023-12-04T10:44:11.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.629+0000 7f4950548640 1 -- start start 2023-12-04T10:44:11.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f4950548640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480c81b0 0x7f4948132b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f4950548640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 0x7f494815d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f4950548640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f494815c800 0x7f4948134270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f4950548640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f494815d8d0 con 0x7f494815c800 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f4950548640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49481331d0 con 0x7f4948143b60 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f4950548640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49481334b0 con 0x7f49480c81b0 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f494eae5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f494815c800 0x7f4948134270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f494eae5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f494815c800 0x7f4948134270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39752/0 (socket says 172.21.15.63:39752) 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f494eae5640 1 -- 172.21.15.63:0/4109256786 learned_addr learned my addr 172.21.15.63:0/4109256786 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f494e2e4640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480c81b0 0x7f4948132b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.630+0000 7f494dae3640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 0x7f494815d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f494eae5640 1 -- 172.21.15.63:0/4109256786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480c81b0 msgr2=0x7f4948132b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f494eae5640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480c81b0 0x7f4948132b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f494eae5640 1 -- 172.21.15.63:0/4109256786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 msgr2=0x7f494815d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f494eae5640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 0x7f494815d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f494eae5640 1 -- 172.21.15.63:0/4109256786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49380094d0 con 0x7f494815c800 2023-12-04T10:44:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f494eae5640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f494815c800 0x7f4948134270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f494000c710 tx=0x7f494000cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f493effd640 1 -- 172.21.15.63:0/4109256786 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940006d50 con 0x7f494815c800 2023-12-04T10:44:11.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f493effd640 1 -- 172.21.15.63:0/4109256786 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494000ce20 con 0x7f494815c800 2023-12-04T10:44:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f493effd640 1 -- 172.21.15.63:0/4109256786 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4940003bb0 con 0x7f494815c800 2023-12-04T10:44:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4944009400 con 0x7f494815c800 2023-12-04T10:44:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.631+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4948133a70 con 0x7f494815c800 2023-12-04T10:44:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.632+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4948068710 con 0x7f494815c800 2023-12-04T10:44:11.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.634+0000 7f493effd640 1 -- 172.21.15.63:0/4109256786 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4940003d10 con 0x7f494815c800 2023-12-04T10:44:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.634+0000 7f493effd640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f492c06ae70 0x7f492c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.635+0000 7f493effd640 1 -- 172.21.15.63:0/4109256786 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4940089420 con 0x7f494815c800 2023-12-04T10:44:11.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.635+0000 7f494e2e4640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f492c06ae70 0x7f492c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:11.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.635+0000 7f494e2e4640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f492c06ae70 0x7f492c06d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4944036000 tx=0x7f494403c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:11.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.639+0000 7f493effd640 1 -- 172.21.15.63:0/4109256786 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4940057d00 con 0x7f494815c800 2023-12-04T10:44:11.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.833+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4948160b00 con 0x7f494815c800 2023-12-04T10:44:11.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.834+0000 7f493effd640 1 -- 172.21.15.63:0/4109256786 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4940057890 con 0x7f494815c800 2023-12-04T10:44:11.835 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f492c06ae70 msgr2=0x7f492c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f492c06ae70 0x7f492c06d330 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4944036000 tx=0x7f494403c040 comp rx=0 tx=0).stop 2023-12-04T10:44:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f494815c800 msgr2=0x7f4948134270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f494815c800 0x7f4948134270 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f494000c710 tx=0x7f494000cbd0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 shutdown_connections 2023-12-04T10:44:11.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f492c06ae70 0x7f492c06d330 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f494815c800 0x7f4948134270 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4948143b60 0x7f494815d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 --2- 172.21.15.63:0/4109256786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f49480c81b0 0x7f4948132b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 >> 172.21.15.63:0/4109256786 conn(0x7f49480cee80 msgr2=0x7f494815dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 shutdown_connections 2023-12-04T10:44:11.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:11.837+0000 7f4950548640 1 -- 172.21.15.63:0/4109256786 wait complete. 2023-12-04T10:44:11.858 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:12.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.087+0000 7f671a989640 1 Processor -- start 2023-12-04T10:44:12.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.088+0000 7f671a989640 1 -- start start 2023-12-04T10:44:12.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.089+0000 7f671a989640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6714143b60 0x7f67140ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.089+0000 7f671a989640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67140724e0 0x7f67140cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.089+0000 7f671a989640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67140ca930 con 0x7f67140c81b0 2023-12-04T10:44:12.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.089+0000 7f671a989640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67140cb5b0 con 0x7f6714143b60 2023-12-04T10:44:12.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.089+0000 7f671a989640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67140cac10 con 0x7f67140724e0 2023-12-04T10:44:12.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.090+0000 7f6713fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6714143b60 0x7f67140ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.090+0000 7f6718f26640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f67140c81b0 0x7f67140cca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:46396/0 (socket says 172.21.15.63:46396) 2023-12-04T10:44:12.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.090+0000 7f6718f26640 1 -- 172.21.15.63:0/3821946756 learned_addr learned my addr 172.21.15.63:0/3821946756 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:12.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.090+0000 7f670b7fe640 1 --2- 172.21.15.63:0/3821946756 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67140724e0 0x7f67140cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.091+0000 7f6713fff640 1 -- 172.21.15.63:0/3821946756 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67140724e0 msgr2=0x7f67140cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:12.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.091+0000 7f6713fff640 1 --2- 172.21.15.63:0/3821946756 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67140724e0 0x7f67140cdb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.091+0000 7f6713fff640 1 -- 172.21.15.63:0/3821946756 >> v1:172.21.15.63:6789/0 conn(0x7f67140c81b0 legacy=0x7f67140cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.091+0000 7f6713fff640 1 -- 172.21.15.63:0/3821946756 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67140caef0 con 0x7f6714143b60 2023-12-04T10:44:12.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.092+0000 7f6713fff640 1 --2- 172.21.15.63:0/3821946756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6714143b60 0x7f67140ca330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6704009d90 tx=0x7f670402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c926d2a103267e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:12.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.092+0000 7f67137fe640 1 -- 172.21.15.63:0/3821946756 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670402cc50 con 0x7f6714143b60 2023-12-04T10:44:12.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.093+0000 7f67137fe640 1 -- 172.21.15.63:0/3821946756 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670402cdb0 con 0x7f6714143b60 2023-12-04T10:44:12.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.093+0000 7f67137fe640 1 -- 172.21.15.63:0/3821946756 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6704034660 con 0x7f6714143b60 2023-12-04T10:44:12.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.093+0000 7f671a989640 1 -- 172.21.15.63:0/3821946756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6714143b60 msgr2=0x7f67140ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.093+0000 7f671a989640 1 --2- 172.21.15.63:0/3821946756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6714143b60 0x7f67140ca330 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6704009d90 tx=0x7f670402bea0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.093+0000 7f671a989640 1 -- 172.21.15.63:0/3821946756 shutdown_connections 2023-12-04T10:44:12.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.093+0000 7f671a989640 1 --2- 172.21.15.63:0/3821946756 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67140724e0 0x7f67140cdb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.093+0000 7f671a989640 1 --2- 172.21.15.63:0/3821946756 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6714143b60 0x7f67140ca330 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.093+0000 7f671a989640 1 -- 172.21.15.63:0/3821946756 >> 172.21.15.63:0/3821946756 conn(0x7f67140cee80 msgr2=0x7f67140cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:12.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.094+0000 7f671a989640 1 -- 172.21.15.63:0/3821946756 shutdown_connections 2023-12-04T10:44:12.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.094+0000 7f671a989640 1 -- 172.21.15.63:0/3821946756 wait complete. 2023-12-04T10:44:12.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.095+0000 7f671a989640 1 Processor -- start 2023-12-04T10:44:12.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.096+0000 7f671a989640 1 -- start start 2023-12-04T10:44:12.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f671a989640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67140c81b0 0x7f671415d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f671a989640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6714143b60 0x7f6714136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f671a989640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f671415be90 0x7f6714155ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f671a989640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f671415cff0 con 0x7f671415be90 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f671a989640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6714136640 con 0x7f67140c81b0 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f671a989640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f671415c370 con 0x7f6714143b60 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f6718f26640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f671415be90 0x7f6714155ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f6718f26640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f671415be90 0x7f6714155ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39774/0 (socket says 172.21.15.63:39774) 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f6718f26640 1 -- 172.21.15.63:0/4154950222 learned_addr learned my addr 172.21.15.63:0/4154950222 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f670b7fe640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6714143b60 0x7f6714136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.097+0000 7f6713fff640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67140c81b0 0x7f671415d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f6718f26640 1 -- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6714143b60 msgr2=0x7f6714136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f6718f26640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6714143b60 0x7f6714136100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f6718f26640 1 -- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67140c81b0 msgr2=0x7f671415d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f6718f26640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67140c81b0 0x7f671415d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f6718f26640 1 -- 172.21.15.63:0/4154950222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704009a70 con 0x7f671415be90 2023-12-04T10:44:12.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f670b7fe640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6714143b60 0x7f6714136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:12.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f6718f26640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f671415be90 0x7f6714155ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c420 tx=0x7f670c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:12.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f67117fa640 1 -- 172.21.15.63:0/4154950222 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c005ce0 con 0x7f671415be90 2023-12-04T10:44:12.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f67117fa640 1 -- 172.21.15.63:0/4154950222 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c005e40 con 0x7f671415be90 2023-12-04T10:44:12.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f671415c650 con 0x7f671415be90 2023-12-04T10:44:12.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f67117fa640 1 -- 172.21.15.63:0/4154950222 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c0072d0 con 0x7f671415be90 2023-12-04T10:44:12.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.098+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f671415cc10 con 0x7f671415be90 2023-12-04T10:44:12.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.100+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f671415d130 con 0x7f671415be90 2023-12-04T10:44:12.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.101+0000 7f67117fa640 1 -- 172.21.15.63:0/4154950222 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f670c0074f0 con 0x7f671415be90 2023-12-04T10:44:12.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.102+0000 7f67117fa640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f66f406ae40 0x7f66f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.102+0000 7f67117fa640 1 -- 172.21.15.63:0/4154950222 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f670c088cb0 con 0x7f671415be90 2023-12-04T10:44:12.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.102+0000 7f6713fff640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f66f406ae40 0x7f66f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.103+0000 7f6713fff640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f66f406ae40 0x7f66f406d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6704036000 tx=0x7f6704030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:12.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.106+0000 7f67117fa640 1 -- 172.21.15.63:0/4154950222 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f671415d130 con 0x7f671415be90 2023-12-04T10:44:12.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.300+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f671415d130 con 0x7f671415be90 2023-12-04T10:44:12.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.301+0000 7f67117fa640 1 -- 172.21.15.63:0/4154950222 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f671415d130 con 0x7f671415be90 2023-12-04T10:44:12.302 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:44:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f66f406ae40 msgr2=0x7f66f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f66f406ae40 0x7f66f406d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6704036000 tx=0x7f6704030000 comp rx=0 tx=0).stop 2023-12-04T10:44:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f671415be90 msgr2=0x7f6714155ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f671415be90 0x7f6714155ba0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f670c00c420 tx=0x7f670c00c8e0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 shutdown_connections 2023-12-04T10:44:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f66f406ae40 0x7f66f406d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6714143b60 0x7f6714136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f671415be90 0x7f6714155ba0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 --2- 172.21.15.63:0/4154950222 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67140c81b0 0x7f671415d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 >> 172.21.15.63:0/4154950222 conn(0x7f67140cee80 msgr2=0x7f67140afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 shutdown_connections 2023-12-04T10:44:12.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.304+0000 7f671a989640 1 -- 172.21.15.63:0/4154950222 wait complete. 2023-12-04T10:44:12.324 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:44:12.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.545+0000 7f6a400f3640 1 Processor -- start 2023-12-04T10:44:12.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.546+0000 7f6a400f3640 1 -- start start 2023-12-04T10:44:12.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a400f3640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a3815d350 0x7f6a380d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a400f3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6a3815d730 0x7f6a380d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a400f3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a380b0450 con 0x7f6a380d1d50 2023-12-04T10:44:12.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a400f3640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a380d3b90 con 0x7f6a3815d350 2023-12-04T10:44:12.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a400f3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a380b0730 con 0x7f6a3815d730 2023-12-04T10:44:12.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a3de8f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a3815d350 0x7f6a380d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a3de8f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6a3815d350 0x7f6a380d3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39788/0 (socket says 172.21.15.63:39788) 2023-12-04T10:44:12.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a3de8f640 1 -- 172.21.15.63:0/216960876 learned_addr learned my addr 172.21.15.63:0/216960876 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:12.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.547+0000 7f6a3d68e640 1 --2- 172.21.15.63:0/216960876 >> v2:172.21.15.66:3300/0 conn(0x7f6a3815d730 0x7f6a380d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.548+0000 7f6a3de8f640 1 -- 172.21.15.63:0/216960876 >> v2:172.21.15.66:3300/0 conn(0x7f6a3815d730 msgr2=0x7f6a380d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:12.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.548+0000 7f6a3de8f640 1 --2- 172.21.15.63:0/216960876 >> v2:172.21.15.66:3300/0 conn(0x7f6a3815d730 0x7f6a380d3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.548+0000 7f6a3de8f640 1 -- 172.21.15.63:0/216960876 >> v1:172.21.15.66:6789/0 conn(0x7f6a380d1d50 legacy=0x7f6a380b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:12.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.548+0000 7f6a3de8f640 1 -- 172.21.15.63:0/216960876 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a380b0a10 con 0x7f6a3815d350 2023-12-04T10:44:12.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.549+0000 7f6a3de8f640 1 --2- 172.21.15.63:0/216960876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d350 0x7f6a380d3110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a380d22b0 tx=0x7f6a2802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5594f697f76a7cb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:12.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.549+0000 7f6a3ce8d640 1 -- 172.21.15.63:0/216960876 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a280317e0 con 0x7f6a3815d350 2023-12-04T10:44:12.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.549+0000 7f6a3ce8d640 1 -- 172.21.15.63:0/216960876 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a28031940 con 0x7f6a3815d350 2023-12-04T10:44:12.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.549+0000 7f6a3ce8d640 1 -- 172.21.15.63:0/216960876 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a28031cd0 con 0x7f6a3815d350 2023-12-04T10:44:12.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.550+0000 7f6a400f3640 1 -- 172.21.15.63:0/216960876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d350 msgr2=0x7f6a380d3110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.550+0000 7f6a400f3640 1 --2- 172.21.15.63:0/216960876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d350 0x7f6a380d3110 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6a380d22b0 tx=0x7f6a2802b880 comp rx=0 tx=0).stop 2023-12-04T10:44:12.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.550+0000 7f6a400f3640 1 -- 172.21.15.63:0/216960876 shutdown_connections 2023-12-04T10:44:12.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.550+0000 7f6a400f3640 1 --2- 172.21.15.63:0/216960876 >> v2:172.21.15.66:3300/0 conn(0x7f6a3815d730 0x7f6a380d3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.550+0000 7f6a400f3640 1 --2- 172.21.15.63:0/216960876 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d350 0x7f6a380d3110 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.550+0000 7f6a400f3640 1 -- 172.21.15.63:0/216960876 >> 172.21.15.63:0/216960876 conn(0x7f6a3808cc80 msgr2=0x7f6a3809c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:12.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.550+0000 7f6a400f3640 1 -- 172.21.15.63:0/216960876 shutdown_connections 2023-12-04T10:44:12.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.550+0000 7f6a400f3640 1 -- 172.21.15.63:0/216960876 wait complete. 2023-12-04T10:44:12.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.551+0000 7f6a400f3640 1 Processor -- start 2023-12-04T10:44:12.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.552+0000 7f6a400f3640 1 -- start start 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.552+0000 7f6a400f3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a380d1d50 0x7f6a381f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a400f3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a3815d350 0x7f6a380b87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a400f3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d730 0x7f6a380b8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a400f3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a3815fff0 con 0x7f6a3815d730 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a400f3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380cd7f0 con 0x7f6a3815d350 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a400f3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a380ccf50 con 0x7f6a380d1d50 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3e690640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d730 0x7f6a380b8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3e690640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d730 0x7f6a380b8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39796/0 (socket says 172.21.15.63:39796) 2023-12-04T10:44:12.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3e690640 1 -- 172.21.15.63:0/2223122621 learned_addr learned my addr 172.21.15.63:0/2223122621 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3d68e640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a3815d350 0x7f6a380b87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3de8f640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a380d1d50 0x7f6a381f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3e690640 1 -- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a380d1d50 msgr2=0x7f6a381f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3e690640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a380d1d50 0x7f6a381f23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3e690640 1 -- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a3815d350 msgr2=0x7f6a380b87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3e690640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a3815d350 0x7f6a380b87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3e690640 1 -- 172.21.15.63:0/2223122621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a280094d0 con 0x7f6a3815d730 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.553+0000 7f6a3d68e640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a3815d350 0x7f6a380b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.554+0000 7f6a3e690640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d730 0x7f6a380b8d20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000c780 tx=0x7f6a3000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.554+0000 7f6a367fc640 1 -- 172.21.15.63:0/2223122621 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a30004b60 con 0x7f6a3815d730 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.554+0000 7f6a367fc640 1 -- 172.21.15.63:0/2223122621 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3000ce90 con 0x7f6a3815d730 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.554+0000 7f6a367fc640 1 -- 172.21.15.63:0/2223122621 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3000a850 con 0x7f6a3815d730 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.554+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a380cd230 con 0x7f6a3815d730 2023-12-04T10:44:12.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.554+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a381f28f0 con 0x7f6a3815d730 2023-12-04T10:44:12.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.555+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a38068710 con 0x7f6a3815d730 2023-12-04T10:44:12.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.556+0000 7f6a367fc640 1 -- 172.21.15.63:0/2223122621 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6a3000a9b0 con 0x7f6a3815d730 2023-12-04T10:44:12.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.557+0000 7f6a367fc640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a2406ae40 0x7f6a2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:12.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.558+0000 7f6a367fc640 1 -- 172.21.15.63:0/2223122621 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6a30089a80 con 0x7f6a3815d730 2023-12-04T10:44:12.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.558+0000 7f6a3de8f640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a2406ae40 0x7f6a2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:12.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.558+0000 7f6a3de8f640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a2406ae40 0x7f6a2406d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a28036000 tx=0x7f6a2803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:12.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.562+0000 7f6a367fc640 1 -- 172.21.15.63:0/2223122621 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6a30054830 con 0x7f6a3815d730 2023-12-04T10:44:12.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.753+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6a3815cd50 con 0x7f6a3815d730 2023-12-04T10:44:12.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.754+0000 7f6a367fc640 1 -- 172.21.15.63:0/2223122621 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6a30057e50 con 0x7f6a3815d730 2023-12-04T10:44:12.755 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.756+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a2406ae40 msgr2=0x7f6a2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.756+0000 7f6a400f3640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a2406ae40 0x7f6a2406d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6a28036000 tx=0x7f6a2803d040 comp rx=0 tx=0).stop 2023-12-04T10:44:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d730 msgr2=0x7f6a380b8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d730 0x7f6a380b8d20 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6a3000c780 tx=0x7f6a3000cc40 comp rx=0 tx=0).stop 2023-12-04T10:44:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 shutdown_connections 2023-12-04T10:44:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a2406ae40 0x7f6a2406d300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6a3815d730 0x7f6a380b8d20 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a3815d350 0x7f6a380b87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 --2- 172.21.15.63:0/2223122621 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6a380d1d50 0x7f6a381f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:12.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 >> 172.21.15.63:0/2223122621 conn(0x7f6a3808cc80 msgr2=0x7f6a380b5430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:12.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 shutdown_connections 2023-12-04T10:44:12.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:12.757+0000 7f6a400f3640 1 -- 172.21.15.63:0/2223122621 wait complete. 2023-12-04T10:44:12.778 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T10:44:13.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.003+0000 7f17c7fff640 1 Processor -- start 2023-12-04T10:44:13.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.003+0000 7f17c7fff640 1 -- start start 2023-12-04T10:44:13.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.005+0000 7f17c7fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f17c8151ca0 0x7f17c806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:13.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.005+0000 7f17c7fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17c815b470 0x7f17c80cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:13.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.005+0000 7f17c7fff640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c80cc7f0 con 0x7f17c806e0b0 2023-12-04T10:44:13.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.005+0000 7f17c7fff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c80cca40 con 0x7f17c815b470 2023-12-04T10:44:13.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.005+0000 7f17c7fff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c80ccd20 con 0x7f17c8151ca0 2023-12-04T10:44:13.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.006+0000 7f17be7fc640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17c815b470 0x7f17c80cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:13.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.006+0000 7f17be7fc640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f17c815b470 0x7f17c80cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39800/0 (socket says 172.21.15.63:39800) 2023-12-04T10:44:13.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.006+0000 7f17be7fc640 1 -- 172.21.15.63:0/2792380764 learned_addr learned my addr 172.21.15.63:0/2792380764 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:13.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.006+0000 7f17c6ffd640 1 --2- 172.21.15.63:0/2792380764 >> v2:172.21.15.66:3300/0 conn(0x7f17c8151ca0 0x7f17c806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:13.007 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.006+0000 7f17be7fc640 1 -- 172.21.15.63:0/2792380764 >> v2:172.21.15.66:3300/0 conn(0x7f17c8151ca0 msgr2=0x7f17c806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:13.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.006+0000 7f17be7fc640 1 --2- 172.21.15.63:0/2792380764 >> v2:172.21.15.66:3300/0 conn(0x7f17c8151ca0 0x7f17c806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.006+0000 7f17be7fc640 1 -- 172.21.15.63:0/2792380764 >> v1:172.21.15.63:6789/0 conn(0x7f17c806e0b0 legacy=0x7f17c8071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:13.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.006+0000 7f17be7fc640 1 -- 172.21.15.63:0/2792380764 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c80cd000 con 0x7f17c815b470 2023-12-04T10:44:13.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.007+0000 7f17be7fc640 1 --2- 172.21.15.63:0/2792380764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c815b470 0x7f17c80cb570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f17c80cdfb0 tx=0x7f17b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acdb9cb158acde4f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:13.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c67fc640 1 -- 172.21.15.63:0/2792380764 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0031870 con 0x7f17c815b470 2023-12-04T10:44:13.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c67fc640 1 -- 172.21.15.63:0/2792380764 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b00319d0 con 0x7f17c815b470 2023-12-04T10:44:13.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c67fc640 1 -- 172.21.15.63:0/2792380764 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b0031d60 con 0x7f17c815b470 2023-12-04T10:44:13.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c7fff640 1 -- 172.21.15.63:0/2792380764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c815b470 msgr2=0x7f17c80cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:13.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c7fff640 1 --2- 172.21.15.63:0/2792380764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c815b470 0x7f17c80cb570 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f17c80cdfb0 tx=0x7f17b002b910 comp rx=0 tx=0).stop 2023-12-04T10:44:13.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c7fff640 1 -- 172.21.15.63:0/2792380764 shutdown_connections 2023-12-04T10:44:13.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c7fff640 1 --2- 172.21.15.63:0/2792380764 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c815b470 0x7f17c80cb570 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c7fff640 1 --2- 172.21.15.63:0/2792380764 >> v2:172.21.15.66:3300/0 conn(0x7f17c8151ca0 0x7f17c806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.008+0000 7f17c7fff640 1 -- 172.21.15.63:0/2792380764 >> 172.21.15.63:0/2792380764 conn(0x7f17c80b07f0 msgr2=0x7f17c80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:13.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.009+0000 7f17c7fff640 1 -- 172.21.15.63:0/2792380764 shutdown_connections 2023-12-04T10:44:13.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.009+0000 7f17c7fff640 1 -- 172.21.15.63:0/2792380764 wait complete. 2023-12-04T10:44:13.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.010+0000 7f17c7fff640 1 Processor -- start 2023-12-04T10:44:13.011 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.010+0000 7f17c7fff640 1 -- start start 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.011+0000 7f17c7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c806e0b0 0x7f17c8158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.011+0000 7f17c7fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17c8151ca0 0x7f17c81f0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17c8150570 0x7f17c814f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c7fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8150150 con 0x7f17c806e0b0 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c7fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8155b50 con 0x7f17c8150570 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c7fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c8155e30 con 0x7f17c8151ca0 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c806e0b0 0x7f17c8158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c806e0b0 0x7f17c8158540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39804/0 (socket says 172.21.15.63:39804) 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 -- 172.21.15.63:0/1254550900 learned_addr learned my addr 172.21.15.63:0/1254550900 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:13.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 -- 172.21.15.63:0/1254550900 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17c8151ca0 msgr2=0x7f17c81f0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:13.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17c8151ca0 0x7f17c81f0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 -- 172.21.15.63:0/1254550900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17c8150570 msgr2=0x7f17c814f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:13.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17c8150570 0x7f17c814f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 -- 172.21.15.63:0/1254550900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b00094d0 con 0x7f17c806e0b0 2023-12-04T10:44:13.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.012+0000 7f17c6ffd640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c806e0b0 0x7f17c8158540 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f17b800d800 tx=0x7f17b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:13.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.013+0000 7f17bffff640 1 -- 172.21.15.63:0/1254550900 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800b6c0 con 0x7f17c806e0b0 2023-12-04T10:44:13.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.013+0000 7f17bffff640 1 -- 172.21.15.63:0/1254550900 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b800b820 con 0x7f17c806e0b0 2023-12-04T10:44:13.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.013+0000 7f17bffff640 1 -- 172.21.15.63:0/1254550900 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b800bbb0 con 0x7f17c806e0b0 2023-12-04T10:44:13.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.013+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c814fd70 con 0x7f17c806e0b0 2023-12-04T10:44:13.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.013+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c81f0e60 con 0x7f17c806e0b0 2023-12-04T10:44:13.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.014+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c804e840 con 0x7f17c806e0b0 2023-12-04T10:44:13.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.015+0000 7f17bffff640 1 -- 172.21.15.63:0/1254550900 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f17b800bd10 con 0x7f17c806e0b0 2023-12-04T10:44:13.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.016+0000 7f17bffff640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f17a806ae40 0x7f17a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:13.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.016+0000 7f17bffff640 1 -- 172.21.15.63:0/1254550900 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f17b8089eb0 con 0x7f17c806e0b0 2023-12-04T10:44:13.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.016+0000 7f17be7fc640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f17a806ae40 0x7f17a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:13.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.017+0000 7f17be7fc640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f17a806ae40 0x7f17a806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17b0036000 tx=0x7f17b0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:13.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.021+0000 7f17bffff640 1 -- 172.21.15.63:0/1254550900 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f17b8054c60 con 0x7f17c806e0b0 2023-12-04T10:44:13.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.230+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f17c80ce280 con 0x7f17c806e0b0 2023-12-04T10:44:13.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.231+0000 7f17bffff640 1 -- 172.21.15.63:0/1254550900 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f17b8058280 con 0x7f17c806e0b0 2023-12-04T10:44:13.232 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-04T10:44:13.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f17a806ae40 msgr2=0x7f17a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:13.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f17a806ae40 0x7f17a806d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f17b0036000 tx=0x7f17b0030000 comp rx=0 tx=0).stop 2023-12-04T10:44:13.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c806e0b0 msgr2=0x7f17c8158540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:13.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c806e0b0 0x7f17c8158540 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f17b800d800 tx=0x7f17b800dcc0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 shutdown_connections 2023-12-04T10:44:13.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f17a806ae40 0x7f17a806d300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f17c8151ca0 0x7f17c81f0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f17c8150570 0x7f17c814f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 --2- 172.21.15.63:0/1254550900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f17c806e0b0 0x7f17c8158540 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:13.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 >> 172.21.15.63:0/1254550900 conn(0x7f17c80b07f0 msgr2=0x7f17c806ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:13.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 shutdown_connections 2023-12-04T10:44:13.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:13.234+0000 7f17c7fff640 1 -- 172.21.15.63:0/1254550900 wait complete. 2023-12-04T10:44:13.255 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi063.front.sepia.ceph.com... 2023-12-04T10:44:13.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:13.255 DEBUG:teuthology.orchestra.run.smithi063:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-04T10:44:13.356 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi063.stderr:ceph-fuse[94185]: fuse finished with error 0 and tester_r 0 2023-12-04T10:44:13.361 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T10:44:14.702 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:44:14.712 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:44:19.463 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:44:19.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:19.464 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-04T10:44:19.535 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.760+0000 7fbd6ffff640 1 Processor -- start 2023-12-04T10:44:19.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.760+0000 7fbd6ffff640 1 -- start start 2023-12-04T10:44:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.762+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700cad70 0x7fbd700cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.762+0000 7fbd6ffff640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd7015a300 con 0x7fbd700cbb70 2023-12-04T10:44:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.762+0000 7fbd6ffff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd700ca040 con 0x7fbd70159f20 2023-12-04T10:44:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.762+0000 7fbd6ffff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd700723f0 con 0x7fbd700cad70 2023-12-04T10:44:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.762+0000 7fbd6f7fe640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fbd700cbb70 0x7fbd7006c9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38472/0 (socket says 172.21.15.63:38472) 2023-12-04T10:44:19.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.762+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/2165857489 learned_addr learned my addr 172.21.15.63:0/2165857489 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.762+0000 7fbd6e7fc640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700cad70 0x7fbd700cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.762+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1560498134 0 0) 0x7fbd7015a300 con 0x7fbd700cbb70 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd58005730 con 0x7fbd700cbb70 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3039587064 0 0) 0x7fbd58005730 con 0x7fbd700cbb70 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700cad70 msgr2=0x7fbd700cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700cad70 0x7fbd700cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 >> v1:172.21.15.66:6789/0 conn(0x7fbd70159f20 legacy=0x7fbd70070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd70071890 con 0x7fbd700cbb70 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fbd680019f0 con 0x7fbd700cbb70 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 >> v1:172.21.15.63:6789/0 conn(0x7fbd700cbb70 legacy=0x7fbd7006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700cad70 0x7fbd58005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:19.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd58006130 0x7fbd580069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58006f10 0x7fbd58007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5800dc40 con 0x7fbd58006f10 2023-12-04T10:44:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5800ddb0 con 0x7fbd58006130 2023-12-04T10:44:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd5800df70 con 0x7fbd700cad70 2023-12-04T10:44:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.763+0000 7fbd6f7fe640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58006f10 0x7fbd58007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.764+0000 7fbd6effd640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700cad70 0x7fbd58005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:19.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.764+0000 7fbd6e7fc640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd58006130 0x7fbd580069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.764+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700cad70 msgr2=0x7fbd58005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.764+0000 7fbd6f7fe640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700cad70 0x7fbd58005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.764+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd58006130 msgr2=0x7fbd580069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.764+0000 7fbd6f7fe640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd58006130 0x7fbd580069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.764+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/2165857489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd58005730 con 0x7fbd58006f10 2023-12-04T10:44:19.770 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.765+0000 7fbd6f7fe640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58006f10 0x7fbd58007390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800a830 tx=0x7fbd58007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b7b7fb2240dac21 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.765+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680072d0 con 0x7fbd58006f10 2023-12-04T10:44:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.765+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd6802f070 con 0x7fbd58006f10 2023-12-04T10:44:19.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.765+0000 7fbd6dffb640 1 -- 172.21.15.63:0/2165857489 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd680076f0 con 0x7fbd58006f10 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.766+0000 7fbd6ffff640 1 -- 172.21.15.63:0/2165857489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58006f10 msgr2=0x7fbd58007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.766+0000 7fbd6ffff640 1 --2- 172.21.15.63:0/2165857489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd58006f10 0x7fbd58007390 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800a830 tx=0x7fbd58007a00 comp rx=0 tx=0).stop 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.766+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/2165857489 reap_dead start 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.766+0000 7fbd6ffff640 1 -- 172.21.15.63:0/2165857489 shutdown_connections 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.766+0000 7fbd6ffff640 1 -- 172.21.15.63:0/2165857489 >> 172.21.15.63:0/2165857489 conn(0x7fbd700b07f0 msgr2=0x7fbd700b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.766+0000 7fbd6ffff640 1 -- 172.21.15.63:0/2165857489 shutdown_connections 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.766+0000 7fbd6ffff640 1 -- 172.21.15.63:0/2165857489 wait complete. 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.768+0000 7fbd6ffff640 1 Processor -- start 2023-12-04T10:44:19.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.768+0000 7fbd6ffff640 1 -- start start 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700c1350 0x7fbd7015b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd7015be90 0x7fbd7014da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd7014df90 0x7fbd7014fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6ffff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7014e420 con 0x7fbd7014df90 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6ffff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7015c990 con 0x7fbd7015be90 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6ffff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd7015c3d0 con 0x7fbd700c1350 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd7014df90 0x7fbd7014fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd7014df90 0x7fbd7014fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38778/0 (socket says 172.21.15.63:38778) 2023-12-04T10:44:19.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.769+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/3402143163 learned_addr learned my addr 172.21.15.63:0/3402143163 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.770+0000 7fbd6e7fc640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd7015be90 0x7fbd7014da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.770+0000 7fbd6effd640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700c1350 0x7fbd7015b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.770+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/3402143163 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700c1350 msgr2=0x7fbd7015b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.770+0000 7fbd6f7fe640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700c1350 0x7fbd7015b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.770+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/3402143163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd7015be90 msgr2=0x7fbd7014da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.770+0000 7fbd6f7fe640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd7015be90 0x7fbd7014da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.770+0000 7fbd6f7fe640 1 -- 172.21.15.63:0/3402143163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd7015c6b0 con 0x7fbd7014df90 2023-12-04T10:44:19.776 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.770+0000 7fbd6f7fe640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd7014df90 0x7fbd7014fc70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800a830 tx=0x7fbd68001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.771+0000 7fbd57fff640 1 -- 172.21.15.63:0/3402143163 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68044070 con 0x7fbd7014df90 2023-12-04T10:44:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.771+0000 7fbd57fff640 1 -- 172.21.15.63:0/3402143163 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd68001250 con 0x7fbd7014df90 2023-12-04T10:44:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.771+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd700c6740 con 0x7fbd7014df90 2023-12-04T10:44:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.771+0000 7fbd57fff640 1 -- 172.21.15.63:0/3402143163 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd68007520 con 0x7fbd7014df90 2023-12-04T10:44:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.771+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd700c1730 con 0x7fbd7014df90 2023-12-04T10:44:19.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.772+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd700c6c60 con 0x7fbd7014df90 2023-12-04T10:44:19.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.773+0000 7fbd57fff640 1 -- 172.21.15.63:0/3402143163 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd68031030 con 0x7fbd7014df90 2023-12-04T10:44:19.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.774+0000 7fbd57fff640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd5c06ae70 0x7fbd5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:19.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.774+0000 7fbd57fff640 1 -- 172.21.15.63:0/3402143163 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd680ab0b0 con 0x7fbd7014df90 2023-12-04T10:44:19.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.774+0000 7fbd6effd640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd5c06ae70 0x7fbd5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:19.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.775+0000 7fbd6effd640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd5c06ae70 0x7fbd5c06d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd60007fd0 tx=0x7fbd60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:19.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.779+0000 7fbd57fff640 1 -- 172.21.15.63:0/3402143163 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbd700c6c60 con 0x7fbd7014df90 2023-12-04T10:44:19.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.976+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd700c6c60 con 0x7fbd7014df90 2023-12-04T10:44:19.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.978+0000 7fbd57fff640 1 -- 172.21.15.63:0/3402143163 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fbd700c6c60 con 0x7fbd7014df90 2023-12-04T10:44:19.981 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:19.982 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:19.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd5c06ae70 msgr2=0x7fbd5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:19.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd5c06ae70 0x7fbd5c06d330 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbd60007fd0 tx=0x7fbd60009040 comp rx=0 tx=0).stop 2023-12-04T10:44:19.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd7014df90 msgr2=0x7fbd7014fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:19.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd7014df90 0x7fbd7014fc70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbd6800a830 tx=0x7fbd68001d80 comp rx=0 tx=0).stop 2023-12-04T10:44:19.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 shutdown_connections 2023-12-04T10:44:19.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd5c06ae70 0x7fbd5c06d330 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd7014df90 0x7fbd7014fc70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd7015be90 0x7fbd7014da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 --2- 172.21.15.63:0/3402143163 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd700c1350 0x7fbd7015b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 >> 172.21.15.63:0/3402143163 conn(0x7fbd700b07f0 msgr2=0x7fbd701580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 shutdown_connections 2023-12-04T10:44:19.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:19.981+0000 7fbd6ffff640 1 -- 172.21.15.63:0/3402143163 wait complete. 2023-12-04T10:44:20.005 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:20.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.225+0000 7efcf54d1640 1 Processor -- start 2023-12-04T10:44:20.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.226+0000 7efcf54d1640 1 -- start start 2023-12-04T10:44:20.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.227+0000 7efcf54d1640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcf00d16b0 0x7efcf00d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.227+0000 7efcf54d1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7efcf00d3cd0 0x7efcf00b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.227+0000 7efcf54d1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcf00d1fd0 con 0x7efcf015d710 2023-12-04T10:44:20.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.227+0000 7efcf54d1640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf00cef40 con 0x7efcf00d16b0 2023-12-04T10:44:20.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.227+0000 7efcf54d1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcf00b25c0 con 0x7efcf00d3cd0 2023-12-04T10:44:20.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.228+0000 7efceffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcf00d16b0 0x7efcf00d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.228+0000 7efceffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efcf00d16b0 0x7efcf00d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38786/0 (socket says 172.21.15.63:38786) 2023-12-04T10:44:20.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.228+0000 7efceffff640 1 -- 172.21.15.63:0/4069826992 learned_addr learned my addr 172.21.15.63:0/4069826992 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:20.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.228+0000 7efcf4cd0640 1 --2- 172.21.15.63:0/4069826992 >> v2:172.21.15.66:3300/0 conn(0x7efcf00d3cd0 0x7efcf00b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.228+0000 7efceffff640 1 -- 172.21.15.63:0/4069826992 >> v2:172.21.15.66:3300/0 conn(0x7efcf00d3cd0 msgr2=0x7efcf00b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:20.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.228+0000 7efceffff640 1 --2- 172.21.15.63:0/4069826992 >> v2:172.21.15.66:3300/0 conn(0x7efcf00d3cd0 0x7efcf00b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.228+0000 7efceffff640 1 -- 172.21.15.63:0/4069826992 >> v1:172.21.15.66:6789/0 conn(0x7efcf015d710 legacy=0x7efcf00ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:20.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.228+0000 7efceffff640 1 -- 172.21.15.63:0/4069826992 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf00b28a0 con 0x7efcf00d16b0 2023-12-04T10:44:20.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.229+0000 7efceffff640 1 --2- 172.21.15.63:0/4069826992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d16b0 0x7efcf00d1a90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efcf008c4d0 tx=0x7efce002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca14ad47fea94e96 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.230+0000 7efcef7fe640 1 -- 172.21.15.63:0/4069826992 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0031750 con 0x7efcf00d16b0 2023-12-04T10:44:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.230+0000 7efcef7fe640 1 -- 172.21.15.63:0/4069826992 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efce00318b0 con 0x7efcf00d16b0 2023-12-04T10:44:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.230+0000 7efcef7fe640 1 -- 172.21.15.63:0/4069826992 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efce0031c40 con 0x7efcf00d16b0 2023-12-04T10:44:20.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.230+0000 7efcf54d1640 1 -- 172.21.15.63:0/4069826992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d16b0 msgr2=0x7efcf00d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.230+0000 7efcf54d1640 1 --2- 172.21.15.63:0/4069826992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d16b0 0x7efcf00d1a90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7efcf008c4d0 tx=0x7efce002b7f0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.231+0000 7efcf54d1640 1 -- 172.21.15.63:0/4069826992 shutdown_connections 2023-12-04T10:44:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.231+0000 7efcf54d1640 1 --2- 172.21.15.63:0/4069826992 >> v2:172.21.15.66:3300/0 conn(0x7efcf00d3cd0 0x7efcf00b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.231+0000 7efcf54d1640 1 --2- 172.21.15.63:0/4069826992 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d16b0 0x7efcf00d1a90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.231+0000 7efcf54d1640 1 -- 172.21.15.63:0/4069826992 >> 172.21.15.63:0/4069826992 conn(0x7efcf00d30d0 msgr2=0x7efcf00d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.231+0000 7efcf54d1640 1 -- 172.21.15.63:0/4069826992 shutdown_connections 2023-12-04T10:44:20.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.231+0000 7efcf54d1640 1 -- 172.21.15.63:0/4069826992 wait complete. 2023-12-04T10:44:20.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.233+0000 7efcf54d1640 1 Processor -- start 2023-12-04T10:44:20.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.233+0000 7efcf54d1640 1 -- start start 2023-12-04T10:44:20.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.234+0000 7efcf54d1640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcf00d16b0 0x7efcf015fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.234+0000 7efcf54d1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d3cd0 0x7efcf00b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.234+0000 7efcf54d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcf015d710 0x7efcf00b61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.234+0000 7efcf54d1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf0160530 con 0x7efcf00d3cd0 2023-12-04T10:44:20.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.234+0000 7efcf54d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcf015fb60 con 0x7efcf015d710 2023-12-04T10:44:20.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.234+0000 7efcf54d1640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcf015ef50 con 0x7efcf00d16b0 2023-12-04T10:44:20.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efce7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d3cd0 0x7efcf00b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efce7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d3cd0 0x7efcf00b5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38802/0 (socket says 172.21.15.63:38802) 2023-12-04T10:44:20.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efce7fff640 1 -- 172.21.15.63:0/1749291220 learned_addr learned my addr 172.21.15.63:0/1749291220 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:20.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efceffff640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcf00d16b0 0x7efcf015fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efcf4cd0640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcf015d710 0x7efcf00b61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efce7fff640 1 -- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcf00d16b0 msgr2=0x7efcf015fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efce7fff640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcf00d16b0 0x7efcf015fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efce7fff640 1 -- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcf015d710 msgr2=0x7efcf00b61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efce7fff640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcf015d710 0x7efcf00b61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efce7fff640 1 -- 172.21.15.63:0/1749291220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce00094d0 con 0x7efcf00d3cd0 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.235+0000 7efceffff640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcf00d16b0 0x7efcf015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.236+0000 7efce7fff640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d3cd0 0x7efcf00b5c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efcd800b3f0 tx=0x7efcd800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.236+0000 7efced7fa640 1 -- 172.21.15.63:0/1749291220 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8011830 con 0x7efcf00d3cd0 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.236+0000 7efced7fa640 1 -- 172.21.15.63:0/1749291220 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd8011990 con 0x7efcf00d3cd0 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.236+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcf015f230 con 0x7efcf00d3cd0 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.236+0000 7efced7fa640 1 -- 172.21.15.63:0/1749291220 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd8011d40 con 0x7efcf00d3cd0 2023-12-04T10:44:20.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.236+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcf015f7f0 con 0x7efcf00d3cd0 2023-12-04T10:44:20.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.237+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcf015fd10 con 0x7efcf00d3cd0 2023-12-04T10:44:20.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.238+0000 7efced7fa640 1 -- 172.21.15.63:0/1749291220 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efcd801a400 con 0x7efcf00d3cd0 2023-12-04T10:44:20.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.239+0000 7efced7fa640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efcd006ae40 0x7efcd006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.239+0000 7efced7fa640 1 -- 172.21.15.63:0/1749291220 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7efcd8089840 con 0x7efcf00d3cd0 2023-12-04T10:44:20.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.240+0000 7efceffff640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efcd006ae40 0x7efcd006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.241+0000 7efceffff640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efcd006ae40 0x7efcd006d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efce0035000 tx=0x7efce0008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:20.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.244+0000 7efced7fa640 1 -- 172.21.15.63:0/1749291220 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efcd80544d0 con 0x7efcf00d3cd0 2023-12-04T10:44:20.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.438+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efcf004e840 con 0x7efcf00d3cd0 2023-12-04T10:44:20.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.441+0000 7efced7fa640 1 -- 172.21.15.63:0/1749291220 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7efcd8057af0 con 0x7efcf00d3cd0 2023-12-04T10:44:20.444 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:20.444 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:20.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efcd006ae40 msgr2=0x7efcd006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efcd006ae40 0x7efcd006d300 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7efce0035000 tx=0x7efce0008030 comp rx=0 tx=0).stop 2023-12-04T10:44:20.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d3cd0 msgr2=0x7efcf00b5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d3cd0 0x7efcf00b5c90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efcd800b3f0 tx=0x7efcd800b8b0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 shutdown_connections 2023-12-04T10:44:20.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efcd006ae40 0x7efcd006d300 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efcf015d710 0x7efcf00b61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efcf00d3cd0 0x7efcf00b5c90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 --2- 172.21.15.63:0/1749291220 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efcf00d16b0 0x7efcf015fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.443+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 >> 172.21.15.63:0/1749291220 conn(0x7efcf00d30d0 msgr2=0x7efcf00b4b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:20.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.444+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 shutdown_connections 2023-12-04T10:44:20.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.444+0000 7efcf54d1640 1 -- 172.21.15.63:0/1749291220 wait complete. 2023-12-04T10:44:20.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-04T10:44:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.687+0000 7f2a20900640 1 Processor -- start 2023-12-04T10:44:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.687+0000 7f2a20900640 1 -- start start 2023-12-04T10:44:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.689+0000 7f2a20900640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0b2270 0x7f2a1c16c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.689+0000 7f2a20900640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1c070bf0 con 0x7f2a1c161b60 2023-12-04T10:44:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.689+0000 7f2a20900640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a1c070ed0 con 0x7f2a1c14ae80 2023-12-04T10:44:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.689+0000 7f2a20900640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0711b0 con 0x7f2a1c0b2270 2023-12-04T10:44:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.689+0000 7f2a13fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2a1c161b60 0x7f2a1c0b1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38484/0 (socket says 172.21.15.63:38484) 2023-12-04T10:44:20.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.689+0000 7f2a13fff640 1 -- 172.21.15.63:0/2015977767 learned_addr learned my addr 172.21.15.63:0/2015977767 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.689+0000 7f2a1b59e640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0b2270 0x7f2a1c16c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1288280858 0 0) 0x7f2a1c070bf0 con 0x7f2a1c161b60 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2a08003520 con 0x7f2a1c161b60 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2863031885 0 0) 0x7f2a08003520 con 0x7f2a1c161b60 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0b2270 msgr2=0x7f2a1c16c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0b2270 0x7f2a1c16c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 >> v1:172.21.15.66:6789/0 conn(0x7f2a1c14ae80 legacy=0x7f2a1c0703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c071490 con 0x7f2a1c161b60 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f2a040017f0 con 0x7f2a1c161b60 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 >> v1:172.21.15.63:6789/0 conn(0x7f2a1c161b60 legacy=0x7f2a1c0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a080039a0 0x7f2a08003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0b2270 0x7f2a080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a08004d00 0x7f2a08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0711b0 con 0x7f2a08004d00 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0800ba60 con 0x7f2a080039a0 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a0800bc20 con 0x7f2a1c0b2270 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.690+0000 7f2a1b59e640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a08004d00 0x7f2a08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.691+0000 7f2a13fff640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0b2270 0x7f2a080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.691+0000 7f2a1ad9d640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a080039a0 0x7f2a08003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.691+0000 7f2a1b59e640 1 -- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0b2270 msgr2=0x7f2a080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.691+0000 7f2a1b59e640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0b2270 0x7f2a080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.691+0000 7f2a1b59e640 1 -- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a080039a0 msgr2=0x7f2a08003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.691+0000 7f2a1b59e640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a080039a0 0x7f2a08003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.691+0000 7f2a1b59e640 1 -- 172.21.15.63:0/2015977767 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a08003520 con 0x7f2a08004d00 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.691+0000 7f2a1ad9d640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a080039a0 0x7f2a08003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.692+0000 7f2a1b59e640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a08004d00 0x7f2a08005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009fc0 tx=0x7f2a080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54c5652783ff281 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.692+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1402cc20 con 0x7f2a08004d00 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.692+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1400f040 con 0x7f2a08004d00 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.692+0000 7f2a1a59c640 1 -- 172.21.15.63:0/2015977767 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a14034440 con 0x7f2a08004d00 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.693+0000 7f2a20900640 1 -- 172.21.15.63:0/2015977767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a08004d00 msgr2=0x7f2a08005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.693+0000 7f2a20900640 1 --2- 172.21.15.63:0/2015977767 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a08004d00 0x7f2a08005180 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009fc0 tx=0x7f2a080057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.693+0000 7f2a1b59e640 1 -- 172.21.15.63:0/2015977767 reap_dead start 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.693+0000 7f2a20900640 1 -- 172.21.15.63:0/2015977767 shutdown_connections 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.693+0000 7f2a20900640 1 -- 172.21.15.63:0/2015977767 >> 172.21.15.63:0/2015977767 conn(0x7f2a1c0b0860 msgr2=0x7f2a1c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.693+0000 7f2a20900640 1 -- 172.21.15.63:0/2015977767 shutdown_connections 2023-12-04T10:44:20.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.693+0000 7f2a20900640 1 -- 172.21.15.63:0/2015977767 wait complete. 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.695+0000 7f2a20900640 1 Processor -- start 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.695+0000 7f2a20900640 1 -- start start 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.696+0000 7f2a20900640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08004d00 0x7f2a1c0a8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.696+0000 7f2a20900640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a1c1f6970 0x7f2a1c0aa950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.696+0000 7f2a20900640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0ad280 0x7f2a1c0ad700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.696+0000 7f2a20900640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0aae90 con 0x7f2a1c1f6970 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.696+0000 7f2a20900640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0adc40 con 0x7f2a08004d00 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.696+0000 7f2a20900640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a1c0a9520 con 0x7f2a1c0ad280 2023-12-04T10:44:20.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a1c1f6970 0x7f2a1c0aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a1c1f6970 0x7f2a1c0aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38832/0 (socket says 172.21.15.63:38832) 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 -- 172.21.15.63:0/3032977798 learned_addr learned my addr 172.21.15.63:0/3032977798 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a1b59e640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0ad280 0x7f2a1c0ad700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 -- 172.21.15.63:0/3032977798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0ad280 msgr2=0x7f2a1c0ad700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a1ad9d640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08004d00 0x7f2a1c0a8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0ad280 0x7f2a1c0ad700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 -- 172.21.15.63:0/3032977798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08004d00 msgr2=0x7f2a1c0a8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08004d00 0x7f2a1c0a8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 -- 172.21.15.63:0/3032977798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c0a9800 con 0x7f2a1c1f6970 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.697+0000 7f2a13fff640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a1c1f6970 0x7f2a1c0aa950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400e7b0 tx=0x7f2a0400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.698+0000 7f2a137fe640 1 -- 172.21.15.63:0/3032977798 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040072e0 con 0x7f2a1c1f6970 2023-12-04T10:44:20.703 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.698+0000 7f2a137fe640 1 -- 172.21.15.63:0/3032977798 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a04007440 con 0x7f2a1c1f6970 2023-12-04T10:44:20.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.698+0000 7f2a137fe640 1 -- 172.21.15.63:0/3032977798 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a040057a0 con 0x7f2a1c1f6970 2023-12-04T10:44:20.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.698+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a1c0a9ae0 con 0x7f2a1c1f6970 2023-12-04T10:44:20.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.698+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a1c0af2f0 con 0x7f2a1c1f6970 2023-12-04T10:44:20.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.699+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a1c04e840 con 0x7f2a1c1f6970 2023-12-04T10:44:20.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.700+0000 7f2a137fe640 1 -- 172.21.15.63:0/3032977798 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2a04005900 con 0x7f2a1c1f6970 2023-12-04T10:44:20.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.702+0000 7f2a137fe640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f29fc06ae70 0x7f29fc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:20.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.702+0000 7f2a137fe640 1 -- 172.21.15.63:0/3032977798 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2a04089ab0 con 0x7f2a1c1f6970 2023-12-04T10:44:20.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.702+0000 7f2a1ad9d640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f29fc06ae70 0x7f29fc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:20.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.702+0000 7f2a1ad9d640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f29fc06ae70 0x7f29fc06d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0015b0 tx=0x7f2a0c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:20.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.706+0000 7f2a137fe640 1 -- 172.21.15.63:0/3032977798 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2a040547d0 con 0x7f2a1c1f6970 2023-12-04T10:44:20.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:20.937+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2a1c14a650 con 0x7f2a1c1f6970 2023-12-04T10:44:21.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.044+0000 7f2a137fe640 1 -- 172.21.15.63:0/3032977798 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2a04057df0 con 0x7f2a1c1f6970 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.047+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f29fc06ae70 msgr2=0x7f29fc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f29fc06ae70 0x7f29fc06d330 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c0015b0 tx=0x7f2a0c009040 comp rx=0 tx=0).stop 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a1c1f6970 msgr2=0x7f2a1c0aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a1c1f6970 0x7f2a1c0aa950 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a0400e7b0 tx=0x7f2a0400ec70 comp rx=0 tx=0).stop 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 shutdown_connections 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f29fc06ae70 0x7f29fc06d330 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2a1c0ad280 0x7f2a1c0ad700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2a1c1f6970 0x7f2a1c0aa950 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 --2- 172.21.15.63:0/3032977798 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2a08004d00 0x7f2a1c0a8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 >> 172.21.15.63:0/3032977798 conn(0x7f2a1c0b0860 msgr2=0x7f2a1c0b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:21.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 shutdown_connections 2023-12-04T10:44:21.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.048+0000 7f2a20900640 1 -- 172.21.15.63:0/3032977798 wait complete. 2023-12-04T10:44:21.070 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-04T10:44:21.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-04T10:44:21.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.301+0000 7f529d831640 1 Processor -- start 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.301+0000 7f529d831640 1 -- start start 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.302+0000 7f529d831640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f529815d5d0 0x7f52980d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.302+0000 7f529d831640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980ce8e0 0x7f52980d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.302+0000 7f529d831640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f52980d1de0 0x7f52980cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.302+0000 7f529d831640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52980d2290 con 0x7f529815d5d0 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.302+0000 7f529d831640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52980b2710 con 0x7f52980d1de0 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.302+0000 7f529d831640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52980ced70 con 0x7f52980ce8e0 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f5296ffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f529815d5d0 0x7f52980d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f5296ffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f529815d5d0 0x7f52980d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38844/0 (socket says 172.21.15.63:38844) 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f5296ffd640 1 -- 172.21.15.63:0/1281831889 learned_addr learned my addr 172.21.15.63:0/1281831889 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f52967fc640 1 --2- 172.21.15.63:0/1281831889 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980ce8e0 0x7f52980d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f5296ffd640 1 -- 172.21.15.63:0/1281831889 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980ce8e0 msgr2=0x7f52980d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:21.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f5296ffd640 1 --2- 172.21.15.63:0/1281831889 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980ce8e0 0x7f52980d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f5296ffd640 1 -- 172.21.15.63:0/1281831889 >> v2:172.21.15.66:3300/0 conn(0x7f52980d1de0 msgr2=0x7f52980cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f5296ffd640 1 --2- 172.21.15.63:0/1281831889 >> v2:172.21.15.66:3300/0 conn(0x7f52980d1de0 0x7f52980cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f5296ffd640 1 -- 172.21.15.63:0/1281831889 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52980cf050 con 0x7f529815d5d0 2023-12-04T10:44:21.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.303+0000 7f52967fc640 1 --2- 172.21.15.63:0/1281831889 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980ce8e0 0x7f52980d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.304+0000 7f5296ffd640 1 --2- 172.21.15.63:0/1281831889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529815d5d0 0x7f52980d3a40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f52980a1240 tx=0x7f528802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f069f0f1b4ef030c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f5295ffb640 1 -- 172.21.15.63:0/1281831889 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288031870 con 0x7f529815d5d0 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f5295ffb640 1 -- 172.21.15.63:0/1281831889 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52880319d0 con 0x7f529815d5d0 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f5295ffb640 1 -- 172.21.15.63:0/1281831889 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5288031d60 con 0x7f529815d5d0 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 -- 172.21.15.63:0/1281831889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529815d5d0 msgr2=0x7f52980d3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 --2- 172.21.15.63:0/1281831889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529815d5d0 0x7f52980d3a40 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f52980a1240 tx=0x7f528802b910 comp rx=0 tx=0).stop 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 -- 172.21.15.63:0/1281831889 shutdown_connections 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 --2- 172.21.15.63:0/1281831889 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980ce8e0 0x7f52980d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 --2- 172.21.15.63:0/1281831889 >> v2:172.21.15.66:3300/0 conn(0x7f52980d1de0 0x7f52980cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 --2- 172.21.15.63:0/1281831889 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f529815d5d0 0x7f52980d3a40 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 -- 172.21.15.63:0/1281831889 >> 172.21.15.63:0/1281831889 conn(0x7f529809c600 msgr2=0x7f52980d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 -- 172.21.15.63:0/1281831889 shutdown_connections 2023-12-04T10:44:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.305+0000 7f529d831640 1 -- 172.21.15.63:0/1281831889 wait complete. 2023-12-04T10:44:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.307+0000 7f529d831640 1 Processor -- start 2023-12-04T10:44:21.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.307+0000 7f529d831640 1 -- start start 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.308+0000 7f529d831640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980d1de0 0x7f529815de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.308+0000 7f529d831640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f529815d5d0 0x7f52980b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.308+0000 7f529d831640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52981527e0 0x7f52980cf620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.308+0000 7f529d831640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52980b89d0 con 0x7f52981527e0 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.308+0000 7f529d831640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f529815e540 con 0x7f529815d5d0 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.308+0000 7f529d831640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f529815e820 con 0x7f52980d1de0 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52981527e0 0x7f52980cf620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52981527e0 0x7f52980cf620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38854/0 (socket says 172.21.15.63:38854) 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52977fe640 1 -- 172.21.15.63:0/1869622943 learned_addr learned my addr 172.21.15.63:0/1869622943 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f5296ffd640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980d1de0 0x7f529815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:21.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52967fc640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f529815d5d0 0x7f52980b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52977fe640 1 -- 172.21.15.63:0/1869622943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980d1de0 msgr2=0x7f529815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52977fe640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980d1de0 0x7f529815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52977fe640 1 -- 172.21.15.63:0/1869622943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f529815d5d0 msgr2=0x7f52980b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52977fe640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f529815d5d0 0x7f52980b8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.309+0000 7f52977fe640 1 -- 172.21.15.63:0/1869622943 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52880094d0 con 0x7f52981527e0 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.310+0000 7f52977fe640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52981527e0 0x7f52980cf620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f529000b970 tx=0x7f529000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.310+0000 7f528ffff640 1 -- 172.21.15.63:0/1869622943 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f529000cb40 con 0x7f52981527e0 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.310+0000 7f528ffff640 1 -- 172.21.15.63:0/1869622943 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f529000ccc0 con 0x7f52981527e0 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.310+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f529815eb00 con 0x7f52981527e0 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.310+0000 7f528ffff640 1 -- 172.21.15.63:0/1869622943 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5290014680 con 0x7f52981527e0 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.310+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f529815f0c0 con 0x7f52981527e0 2023-12-04T10:44:21.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.311+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f529815f2e0 con 0x7f52981527e0 2023-12-04T10:44:21.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.312+0000 7f528ffff640 1 -- 172.21.15.63:0/1869622943 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f529001d3b0 con 0x7f52981527e0 2023-12-04T10:44:21.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.313+0000 7f528ffff640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f527806ae40 0x7f527806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:21.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.314+0000 7f528ffff640 1 -- 172.21.15.63:0/1869622943 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52900899b0 con 0x7f52981527e0 2023-12-04T10:44:21.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.314+0000 7f5296ffd640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f527806ae40 0x7f527806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:21.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.314+0000 7f5296ffd640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f527806ae40 0x7f527806d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5288036000 tx=0x7f528803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:21.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.318+0000 7f528ffff640 1 -- 172.21.15.63:0/1869622943 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5290054640 con 0x7f52981527e0 2023-12-04T10:44:21.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:21.554+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f5298068710 con 0x7f52981527e0 2023-12-04T10:44:22.063 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.060+0000 7f528ffff640 1 -- 172.21.15.63:0/1869622943 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5290019020 con 0x7f52981527e0 2023-12-04T10:44:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.064+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f527806ae40 msgr2=0x7f527806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.064+0000 7f529d831640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f527806ae40 0x7f527806d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5288036000 tx=0x7f528803c040 comp rx=0 tx=0).stop 2023-12-04T10:44:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.064+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52981527e0 msgr2=0x7f52980cf620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.064+0000 7f529d831640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52981527e0 0x7f52980cf620 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f529000b970 tx=0x7f529000be30 comp rx=0 tx=0).stop 2023-12-04T10:44:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.064+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 shutdown_connections 2023-12-04T10:44:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.064+0000 7f529d831640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f527806ae40 0x7f527806d300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.064+0000 7f529d831640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f52981527e0 0x7f52980cf620 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.064+0000 7f529d831640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f529815d5d0 0x7f52980b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.065+0000 7f529d831640 1 --2- 172.21.15.63:0/1869622943 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52980d1de0 0x7f529815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.065+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 >> 172.21.15.63:0/1869622943 conn(0x7f529809c600 msgr2=0x7f52980d2a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:22.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.065+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 shutdown_connections 2023-12-04T10:44:22.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.065+0000 7f529d831640 1 -- 172.21.15.63:0/1869622943 wait complete. 2023-12-04T10:44:22.088 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-04T10:44:22.089 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:44:22.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.304+0000 7fe143b89640 1 Processor -- start 2023-12-04T10:44:22.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.304+0000 7fe143b89640 1 -- start start 2023-12-04T10:44:22.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe143b89640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe13c15b1e0 0x7fe13c0ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe143b89640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe13c0caba0 0x7fe13c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe143b89640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 0x7fe13c0c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe143b89640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13c15aa30 con 0x7fe13c15b1e0 2023-12-04T10:44:22.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe143b89640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe13c0cb000 con 0x7fe13c0caba0 2023-12-04T10:44:22.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe143b89640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c15b5c0 con 0x7fe13c071600 2023-12-04T10:44:22.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe141925640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe13c15b1e0 0x7fe13c0ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe141925640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe13c15b1e0 0x7fe13c0ca660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38862/0 (socket says 172.21.15.63:38862) 2023-12-04T10:44:22.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.306+0000 7fe141925640 1 -- 172.21.15.63:0/1720805920 learned_addr learned my addr 172.21.15.63:0/1720805920 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:22.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.307+0000 7fe142126640 1 --2- 172.21.15.63:0/1720805920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 0x7fe13c0c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.307+0000 7fe141124640 1 --2- 172.21.15.63:0/1720805920 >> v2:172.21.15.66:3300/0 conn(0x7fe13c0caba0 0x7fe13c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.307+0000 7fe141925640 1 -- 172.21.15.63:0/1720805920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 msgr2=0x7fe13c0c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:22.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.307+0000 7fe141925640 1 --2- 172.21.15.63:0/1720805920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 0x7fe13c0c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.307+0000 7fe141925640 1 -- 172.21.15.63:0/1720805920 >> v2:172.21.15.66:3300/0 conn(0x7fe13c0caba0 msgr2=0x7fe13c0710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:22.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.307+0000 7fe141925640 1 --2- 172.21.15.63:0/1720805920 >> v2:172.21.15.66:3300/0 conn(0x7fe13c0caba0 0x7fe13c0710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.307+0000 7fe141925640 1 -- 172.21.15.63:0/1720805920 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe13c071dd0 con 0x7fe13c15b1e0 2023-12-04T10:44:22.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.308+0000 7fe141925640 1 --2- 172.21.15.63:0/1720805920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c15b1e0 0x7fe13c0ca660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0746a0 tx=0x7fe13802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5856bcdbebb88cce server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:22.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.308+0000 7fe140923640 1 -- 172.21.15.63:0/1720805920 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138031870 con 0x7fe13c15b1e0 2023-12-04T10:44:22.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.308+0000 7fe140923640 1 -- 172.21.15.63:0/1720805920 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1380319d0 con 0x7fe13c15b1e0 2023-12-04T10:44:22.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.308+0000 7fe140923640 1 -- 172.21.15.63:0/1720805920 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe138031d60 con 0x7fe13c15b1e0 2023-12-04T10:44:22.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 -- 172.21.15.63:0/1720805920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c15b1e0 msgr2=0x7fe13c0ca660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 --2- 172.21.15.63:0/1720805920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c15b1e0 0x7fe13c0ca660 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fe13c0746a0 tx=0x7fe13802b910 comp rx=0 tx=0).stop 2023-12-04T10:44:22.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 -- 172.21.15.63:0/1720805920 shutdown_connections 2023-12-04T10:44:22.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 --2- 172.21.15.63:0/1720805920 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 0x7fe13c0c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 --2- 172.21.15.63:0/1720805920 >> v2:172.21.15.66:3300/0 conn(0x7fe13c0caba0 0x7fe13c0710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 --2- 172.21.15.63:0/1720805920 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c15b1e0 0x7fe13c0ca660 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 -- 172.21.15.63:0/1720805920 >> 172.21.15.63:0/1720805920 conn(0x7fe13c0cee80 msgr2=0x7fe13c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:22.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 -- 172.21.15.63:0/1720805920 shutdown_connections 2023-12-04T10:44:22.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.309+0000 7fe143b89640 1 -- 172.21.15.63:0/1720805920 wait complete. 2023-12-04T10:44:22.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.312+0000 7fe143b89640 1 Processor -- start 2023-12-04T10:44:22.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.312+0000 7fe143b89640 1 -- start start 2023-12-04T10:44:22.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.313+0000 7fe143b89640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 0x7fe13c1437f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.313+0000 7fe143b89640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0caba0 0x7fe13c142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.313+0000 7fe143b89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c15b1e0 0x7fe13c1478b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.313+0000 7fe143b89640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c149280 con 0x7fe13c0caba0 2023-12-04T10:44:22.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.313+0000 7fe143b89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c166580 con 0x7fe13c15b1e0 2023-12-04T10:44:22.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.313+0000 7fe143b89640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe13c144060 con 0x7fe13c071600 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.313+0000 7fe141124640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0caba0 0x7fe13c142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe141124640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0caba0 0x7fe13c142140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38874/0 (socket says 172.21.15.63:38874) 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe141124640 1 -- 172.21.15.63:0/3900415870 learned_addr learned my addr 172.21.15.63:0/3900415870 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe141925640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 0x7fe13c1437f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe142126640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c15b1e0 0x7fe13c1478b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe141124640 1 -- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 msgr2=0x7fe13c1437f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe141124640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 0x7fe13c1437f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe141124640 1 -- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c15b1e0 msgr2=0x7fe13c1478b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe141124640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c15b1e0 0x7fe13c1478b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe141124640 1 -- 172.21.15.63:0/3900415870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1380094d0 con 0x7fe13c0caba0 2023-12-04T10:44:22.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.314+0000 7fe142126640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c15b1e0 0x7fe13c1478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:22.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.315+0000 7fe141124640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0caba0 0x7fe13c142140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00d800 tx=0x7fe12c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:22.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.315+0000 7fe1327fc640 1 -- 172.21.15.63:0/3900415870 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00b6c0 con 0x7fe13c0caba0 2023-12-04T10:44:22.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.315+0000 7fe1327fc640 1 -- 172.21.15.63:0/3900415870 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe12c00b820 con 0x7fe13c0caba0 2023-12-04T10:44:22.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.315+0000 7fe1327fc640 1 -- 172.21.15.63:0/3900415870 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe12c00bbb0 con 0x7fe13c0caba0 2023-12-04T10:44:22.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.315+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe13c149a70 con 0x7fe13c0caba0 2023-12-04T10:44:22.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.315+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe13c147df0 con 0x7fe13c0caba0 2023-12-04T10:44:22.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.316+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe13c068710 con 0x7fe13c0caba0 2023-12-04T10:44:22.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.317+0000 7fe1327fc640 1 -- 172.21.15.63:0/3900415870 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe12c00bd10 con 0x7fe13c0caba0 2023-12-04T10:44:22.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.318+0000 7fe1327fc640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe12006ae40 0x7fe12006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.318+0000 7fe1327fc640 1 -- 172.21.15.63:0/3900415870 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe12c089d40 con 0x7fe13c0caba0 2023-12-04T10:44:22.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.318+0000 7fe141925640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe12006ae40 0x7fe12006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.319+0000 7fe141925640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe12006ae40 0x7fe12006d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe138036000 tx=0x7fe13803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:22.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.323+0000 7fe1327fc640 1 -- 172.21.15.63:0/3900415870 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe12c054b90 con 0x7fe13c0caba0 2023-12-04T10:44:22.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.558+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe13c0cb220 con 0x7fe13c0caba0 2023-12-04T10:44:22.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.559+0000 7fe1327fc640 1 -- 172.21.15.63:0/3900415870 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fe12c0581b0 con 0x7fe13c0caba0 2023-12-04T10:44:22.562 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:22.562 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:44:21.556693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T10:44:22.562 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2023-12-04T10:44:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe12006ae40 msgr2=0x7fe12006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe12006ae40 0x7fe12006d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe138036000 tx=0x7fe13803c040 comp rx=0 tx=0).stop 2023-12-04T10:44:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0caba0 msgr2=0x7fe13c142140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0caba0 0x7fe13c142140 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fe12c00d800 tx=0x7fe12c00dcc0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 shutdown_connections 2023-12-04T10:44:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe12006ae40 0x7fe12006d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe13c15b1e0 0x7fe13c1478b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe13c0caba0 0x7fe13c142140 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 --2- 172.21.15.63:0/3900415870 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe13c071600 0x7fe13c1437f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 >> 172.21.15.63:0/3900415870 conn(0x7fe13c0cee80 msgr2=0x7fe13c0ccf40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.562+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 shutdown_connections 2023-12-04T10:44:22.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.563+0000 7fe143b89640 1 -- 172.21.15.63:0/3900415870 wait complete. 2023-12-04T10:44:22.584 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:22.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.805+0000 7fd4fe727640 1 Processor -- start 2023-12-04T10:44:22.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.805+0000 7fd4fe727640 1 -- start start 2023-12-04T10:44:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.807+0000 7fd4fe727640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4f815d710 0x7fd4f80ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.807+0000 7fd4fe727640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 0x7fd4f80b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.807+0000 7fd4fe727640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4f80cef40 con 0x7fd4f80d16b0 2023-12-04T10:44:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.807+0000 7fd4fe727640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4f80b25c0 con 0x7fd4f815d710 2023-12-04T10:44:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.807+0000 7fd4fe727640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f80b28a0 con 0x7fd4f80d3cd0 2023-12-04T10:44:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.807+0000 7fd4fd725640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd4f80d16b0 0x7fd4f80d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38498/0 (socket says 172.21.15.63:38498) 2023-12-04T10:44:22.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.807+0000 7fd4fd725640 1 -- 172.21.15.63:0/940965633 learned_addr learned my addr 172.21.15.63:0/940965633 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:22.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.807+0000 7fd4fcf24640 1 --2- 172.21.15.63:0/940965633 >> v2:172.21.15.63:3300/0 conn(0x7fd4f815d710 0x7fd4f80ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.808+0000 7fd4fdf26640 1 --2- 172.21.15.63:0/940965633 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 0x7fd4f80b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.808+0000 7fd4effff640 1 -- 172.21.15.63:0/940965633 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3769708359 0 0) 0x7fd4f80cef40 con 0x7fd4f80d16b0 2023-12-04T10:44:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.808+0000 7fd4effff640 1 -- 172.21.15.63:0/940965633 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4e4003520 con 0x7fd4f80d16b0 2023-12-04T10:44:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.808+0000 7fd4fcf24640 1 -- 172.21.15.63:0/940965633 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 msgr2=0x7fd4f80b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.808+0000 7fd4fcf24640 1 --2- 172.21.15.63:0/940965633 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 0x7fd4f80b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.808+0000 7fd4fcf24640 1 -- 172.21.15.63:0/940965633 >> v1:172.21.15.63:6789/0 conn(0x7fd4f80d16b0 legacy=0x7fd4f80d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.808+0000 7fd4fcf24640 1 -- 172.21.15.63:0/940965633 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f80b2b80 con 0x7fd4f815d710 2023-12-04T10:44:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.809+0000 7fd4fcf24640 1 --2- 172.21.15.63:0/940965633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f815d710 0x7fd4f80ce6f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80097a0 tx=0x7fd4e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a91a98e77dfae11 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.809+0000 7fd4effff640 1 -- 172.21.15.63:0/940965633 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e802e070 con 0x7fd4f815d710 2023-12-04T10:44:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.809+0000 7fd4effff640 1 -- 172.21.15.63:0/940965633 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4e80315a0 con 0x7fd4f815d710 2023-12-04T10:44:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.809+0000 7fd4effff640 1 -- 172.21.15.63:0/940965633 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4e8031930 con 0x7fd4f815d710 2023-12-04T10:44:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.810+0000 7fd4fe727640 1 -- 172.21.15.63:0/940965633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f815d710 msgr2=0x7fd4f80ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.810+0000 7fd4fe727640 1 --2- 172.21.15.63:0/940965633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f815d710 0x7fd4f80ce6f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd4e80097a0 tx=0x7fd4e802b840 comp rx=0 tx=0).stop 2023-12-04T10:44:22.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.810+0000 7fd4fe727640 1 -- 172.21.15.63:0/940965633 shutdown_connections 2023-12-04T10:44:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.810+0000 7fd4fe727640 1 --2- 172.21.15.63:0/940965633 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 0x7fd4f80b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.810+0000 7fd4fe727640 1 --2- 172.21.15.63:0/940965633 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f815d710 0x7fd4f80ce6f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.810+0000 7fd4fe727640 1 -- 172.21.15.63:0/940965633 >> 172.21.15.63:0/940965633 conn(0x7fd4f80d30d0 msgr2=0x7fd4f80d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.811+0000 7fd4fe727640 1 -- 172.21.15.63:0/940965633 shutdown_connections 2023-12-04T10:44:22.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.811+0000 7fd4fe727640 1 -- 172.21.15.63:0/940965633 wait complete. 2023-12-04T10:44:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.812+0000 7fd4fe727640 1 Processor -- start 2023-12-04T10:44:22.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.813+0000 7fd4fe727640 1 -- start start 2023-12-04T10:44:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fe727640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f80d16b0 0x7fd4f80cced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fe727640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 0x7fd4f80cb000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fe727640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4f815d710 0x7fd4f815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fe727640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f80cb540 con 0x7fd4f80d16b0 2023-12-04T10:44:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fe727640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f815c0f0 con 0x7fd4f815d710 2023-12-04T10:44:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fe727640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f80ca240 con 0x7fd4f80d3cd0 2023-12-04T10:44:22.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fd725640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f80d16b0 0x7fd4f80cced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fd725640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f80d16b0 0x7fd4f80cced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38884/0 (socket says 172.21.15.63:38884) 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fd725640 1 -- 172.21.15.63:0/3691403887 learned_addr learned my addr 172.21.15.63:0/3691403887 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fcf24640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 0x7fd4f80cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fd725640 1 -- 172.21.15.63:0/3691403887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 msgr2=0x7fd4f80cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fdf26640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4f815d710 0x7fd4f815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fd725640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 0x7fd4f80cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fd725640 1 -- 172.21.15.63:0/3691403887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4f815d710 msgr2=0x7fd4f815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fd725640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4f815d710 0x7fd4f815b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:22.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.814+0000 7fd4fd725640 1 -- 172.21.15.63:0/3691403887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e8009400 con 0x7fd4f80d16b0 2023-12-04T10:44:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.815+0000 7fd4fd725640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f80d16b0 0x7fd4f80cced0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c500 tx=0x7fd4f400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.815+0000 7fd4edffb640 1 -- 172.21.15.63:0/3691403887 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4005ce0 con 0x7fd4f80d16b0 2023-12-04T10:44:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.815+0000 7fd4edffb640 1 -- 172.21.15.63:0/3691403887 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f4005e40 con 0x7fd4f80d16b0 2023-12-04T10:44:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.815+0000 7fd4edffb640 1 -- 172.21.15.63:0/3691403887 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f4007330 con 0x7fd4f80d16b0 2023-12-04T10:44:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.815+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f80ca520 con 0x7fd4f80d16b0 2023-12-04T10:44:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.815+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f80caae0 con 0x7fd4f80d16b0 2023-12-04T10:44:22.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.816+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f804e840 con 0x7fd4f80d16b0 2023-12-04T10:44:22.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.817+0000 7fd4edffb640 1 -- 172.21.15.63:0/3691403887 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4f4007490 con 0x7fd4f80d16b0 2023-12-04T10:44:22.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.818+0000 7fd4edffb640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd4dc06ae70 0x7fd4dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:22.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.818+0000 7fd4edffb640 1 -- 172.21.15.63:0/3691403887 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd4f4088f00 con 0x7fd4f80d16b0 2023-12-04T10:44:22.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.818+0000 7fd4fcf24640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd4dc06ae70 0x7fd4dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:22.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.819+0000 7fd4fcf24640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd4dc06ae70 0x7fd4dc06d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8036000 tx=0x7fd4e803d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:22.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:22.824+0000 7fd4edffb640 1 -- 172.21.15.63:0/3691403887 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4f4053e10 con 0x7fd4f80d16b0 2023-12-04T10:44:23.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.021+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4f80cdf60 con 0x7fd4f80d16b0 2023-12-04T10:44:23.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.024+0000 7fd4edffb640 1 -- 172.21.15.63:0/3691403887 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fd4f4017020 con 0x7fd4f80d16b0 2023-12-04T10:44:23.030 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:23.030 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd4dc06ae70 msgr2=0x7fd4dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd4dc06ae70 0x7fd4dc06d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd4e8036000 tx=0x7fd4e803d040 comp rx=0 tx=0).stop 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f80d16b0 msgr2=0x7fd4f80cced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f80d16b0 0x7fd4f80cced0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd4f400c500 tx=0x7fd4f400c9c0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 shutdown_connections 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd4dc06ae70 0x7fd4dc06d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4f80d3cd0 0x7fd4f80cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4f815d710 0x7fd4f815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 --2- 172.21.15.63:0/3691403887 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4f80d16b0 0x7fd4f80cced0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 >> 172.21.15.63:0/3691403887 conn(0x7fd4f80d30d0 msgr2=0x7fd4f806c600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 shutdown_connections 2023-12-04T10:44:23.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.027+0000 7fd4fe727640 1 -- 172.21.15.63:0/3691403887 wait complete. 2023-12-04T10:44:23.047 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T10:44:23.047 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T10:44:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.267+0000 7f0ba8161640 1 Processor -- start 2023-12-04T10:44:23.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.267+0000 7f0ba8161640 1 -- start start 2023-12-04T10:44:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.268+0000 7f0ba8161640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0ba015d350 0x7f0ba00d3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.268+0000 7f0ba8161640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba00b2500 0x7f0ba00d3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.268+0000 7f0ba8161640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ba00b0450 con 0x7f0ba015d730 2023-12-04T10:44:23.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.268+0000 7f0ba8161640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ba00d3b90 con 0x7f0ba015d350 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.268+0000 7f0ba8161640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00b0730 con 0x7f0ba00b2500 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba56fc640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0ba015d730 0x7f0ba00b2ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:38508/0 (socket says 172.21.15.63:38508) 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba56fc640 1 -- 172.21.15.63:0/115818997 learned_addr learned my addr 172.21.15.63:0/115818997 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba5efd640 1 --2- 172.21.15.63:0/115818997 >> v2:172.21.15.66:3300/0 conn(0x7f0ba015d350 0x7f0ba00d3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba66fe640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba00b2500 0x7f0ba00d3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1090131172 0 0) 0x7f0ba00b0450 con 0x7f0ba015d730 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b8c003520 con 0x7f0ba015d730 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2169894824 0 0) 0x7f0b8c003520 con 0x7f0ba015d730 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba00b2500 msgr2=0x7f0ba00d3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba00b2500 0x7f0ba00d3650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 >> v2:172.21.15.66:3300/0 conn(0x7f0ba015d350 msgr2=0x7f0ba00d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 --2- 172.21.15.63:0/115818997 >> v2:172.21.15.66:3300/0 conn(0x7f0ba015d350 0x7f0ba00d3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba00b0a10 con 0x7f0ba015d730 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f0b90001670 con 0x7f0ba015d730 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.269+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 >> v1:172.21.15.63:6789/0 conn(0x7f0ba015d730 legacy=0x7f0ba00b2ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba4efb640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba00b2500 0x7f0b8c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba4efb640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c003fa0 0x7f0b8c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba4efb640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b8c004d00 0x7f0b8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00b0730 con 0x7f0b8c004d00 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c00bac0 con 0x7f0b8c003fa0 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b8c00bc80 con 0x7f0ba00b2500 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba5efd640 1 --2- 172.21.15.63:0/115818997 >> v2:172.21.15.66:3300/0 conn(0x7f0ba015d350 0x7f0ba00d3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba66fe640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b8c004d00 0x7f0b8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba56fc640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c003fa0 0x7f0b8c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba66fe640 1 -- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba00b2500 msgr2=0x7f0b8c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba66fe640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba00b2500 0x7f0b8c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba66fe640 1 -- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c003fa0 msgr2=0x7f0b8c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba66fe640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c003fa0 0x7f0b8c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba66fe640 1 -- 172.21.15.63:0/115818997 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b8c003520 con 0x7f0b8c004d00 2023-12-04T10:44:23.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.270+0000 7f0ba56fc640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c003fa0 0x7f0b8c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.271+0000 7f0ba66fe640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b8c004d00 0x7f0b8c005180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b98007360 tx=0x7f0b8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639addc90a43a584 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b9802ccf0 con 0x7f0b8c004d00 2023-12-04T10:44:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b9802ce50 con 0x7f0b8c004d00 2023-12-04T10:44:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba4efb640 1 -- 172.21.15.63:0/115818997 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b98034660 con 0x7f0b8c004d00 2023-12-04T10:44:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba8161640 1 -- 172.21.15.63:0/115818997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b8c004d00 msgr2=0x7f0b8c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba8161640 1 --2- 172.21.15.63:0/115818997 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0b8c004d00 0x7f0b8c005180 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b98007360 tx=0x7f0b8c0057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba66fe640 1 -- 172.21.15.63:0/115818997 reap_dead start 2023-12-04T10:44:23.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba8161640 1 -- 172.21.15.63:0/115818997 shutdown_connections 2023-12-04T10:44:23.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba8161640 1 -- 172.21.15.63:0/115818997 >> 172.21.15.63:0/115818997 conn(0x7f0ba008cc80 msgr2=0x7f0ba009c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:23.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba8161640 1 -- 172.21.15.63:0/115818997 shutdown_connections 2023-12-04T10:44:23.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.272+0000 7f0ba8161640 1 -- 172.21.15.63:0/115818997 wait complete. 2023-12-04T10:44:23.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.274+0000 7f0ba8161640 1 Processor -- start 2023-12-04T10:44:23.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.274+0000 7f0ba8161640 1 -- start start 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.275+0000 7f0ba8161640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c004d00 0x7f0ba00cceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.275+0000 7f0ba8161640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ba00ca330 0x7f0ba01570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.275+0000 7f0ba8161640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba015e5e0 0x7f0ba015fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.275+0000 7f0ba8161640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba00b78d0 con 0x7f0ba00ca330 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.275+0000 7f0ba8161640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba01f29d0 con 0x7f0b8c004d00 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.275+0000 7f0ba8161640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba0157600 con 0x7f0ba015e5e0 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ba00ca330 0x7f0ba01570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ba00ca330 0x7f0ba01570c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38908/0 (socket says 172.21.15.63:38908) 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 -- 172.21.15.63:0/3841601856 learned_addr learned my addr 172.21.15.63:0/3841601856 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba66fe640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba015e5e0 0x7f0ba015fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba5efd640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c004d00 0x7f0ba00cceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 -- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba015e5e0 msgr2=0x7f0ba015fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba015e5e0 0x7f0ba015fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 -- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c004d00 msgr2=0x7f0ba00cceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c004d00 0x7f0ba00cceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 -- 172.21.15.63:0/3841601856 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba015eda0 con 0x7f0ba00ca330 2023-12-04T10:44:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba5efd640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c004d00 0x7f0ba00cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.276+0000 7f0ba56fc640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ba00ca330 0x7f0ba01570c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000d8c0 tx=0x7f0b9000dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.277+0000 7f0b967fc640 1 -- 172.21.15.63:0/3841601856 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b900074e0 con 0x7f0ba00ca330 2023-12-04T10:44:23.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.277+0000 7f0b967fc640 1 -- 172.21.15.63:0/3841601856 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b90007640 con 0x7f0ba00ca330 2023-12-04T10:44:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.277+0000 7f0b967fc640 1 -- 172.21.15.63:0/3841601856 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b90004a00 con 0x7f0ba00ca330 2023-12-04T10:44:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.277+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba00b7210 con 0x7f0ba00ca330 2023-12-04T10:44:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.277+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba015ea60 con 0x7f0ba00ca330 2023-12-04T10:44:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.278+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba0068710 con 0x7f0ba00ca330 2023-12-04T10:44:23.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.279+0000 7f0b967fc640 1 -- 172.21.15.63:0/3841601856 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0b90004b60 con 0x7f0ba00ca330 2023-12-04T10:44:23.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.281+0000 7f0b967fc640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0b8406ae70 0x7f0b8406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.281+0000 7f0b967fc640 1 -- 172.21.15.63:0/3841601856 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0b900892c0 con 0x7f0ba00ca330 2023-12-04T10:44:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.281+0000 7f0ba5efd640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0b8406ae70 0x7f0b8406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.282+0000 7f0ba5efd640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0b8406ae70 0x7f0b8406d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00d940 tx=0x7f0b9c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:23.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.285+0000 7f0b967fc640 1 -- 172.21.15.63:0/3841601856 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0b90054070 con 0x7f0ba00ca330 2023-12-04T10:44:23.479 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.477+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 --> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0ba00d10d0 con 0x7f0b8406ae70 2023-12-04T10:44:23.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.495+0000 7f0b967fc640 1 -- 172.21.15.63:0/3841601856 <== mgr.4107 v2:172.21.15.63:6832/2779630096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345071 (secure 0 0 0) 0x7f0b9c00d550 con 0x7f0b8406ae70 2023-12-04T10:44:23.502 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:23.504 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.501+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0b8406ae70 msgr2=0x7f0b8406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.501+0000 7f0ba8161640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0b8406ae70 0x7f0b8406d330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c00d940 tx=0x7f0b9c008040 comp rx=0 tx=0).stop 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.501+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ba00ca330 msgr2=0x7f0ba01570c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.501+0000 7f0ba8161640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ba00ca330 0x7f0ba01570c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000d8c0 tx=0x7f0b9000dd80 comp rx=0 tx=0).stop 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.502+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 shutdown_connections 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.502+0000 7f0ba8161640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0b8406ae70 0x7f0b8406d330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.502+0000 7f0ba8161640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0ba015e5e0 0x7f0ba015fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.502+0000 7f0ba8161640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0ba00ca330 0x7f0ba01570c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.502+0000 7f0ba8161640 1 --2- 172.21.15.63:0/3841601856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0b8c004d00 0x7f0ba00cceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.502+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 >> 172.21.15.63:0/3841601856 conn(0x7f0ba008cc80 msgr2=0x7f0ba006bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:23.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.502+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 shutdown_connections 2023-12-04T10:44:23.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.502+0000 7f0ba8161640 1 -- 172.21.15.63:0/3841601856 wait complete. 2023-12-04T10:44:23.523 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-12-04T10:44:21.973274+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219596,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755124,"statfs":{"total":773094113280,"available":772869246976,"internally_reserved":0,"allocated":3514368,"data_stored":2085782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005051"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039141+0000","last_change":"2023-12-04T10:43:52.262642+0000","last_active":"2023-12-04T10:43:58.039141+0000","last_peered":"2023-12-04T10:43:58.039141+0000","last_clean":"2023-12-04T10:43:58.039141+0000","last_became_active":"2023-12-04T10:43:52.262376+0000","last_became_peered":"2023-12-04T10:43:52.262376+0000","last_unstale":"2023-12-04T10:43:58.039141+0000","last_undegraded":"2023-12-04T10:43:58.039141+0000","last_fullsized":"2023-12-04T10:43:58.039141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022140+0000","last_change":"2023-12-04T10:43:52.985649+0000","last_active":"2023-12-04T10:43:58.022140+0000","last_peered":"2023-12-04T10:43:58.022140+0000","last_clean":"2023-12-04T10:43:58.022140+0000","last_became_active":"2023-12-04T10:43:52.980842+0000","last_became_peered":"2023-12-04T10:43:52.980842+0000","last_unstale":"2023-12-04T10:43:58.022140+0000","last_undegraded":"2023-12-04T10:43:58.022140+0000","last_fullsized":"2023-12-04T10:43:58.022140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:35:03.536961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702614+0000","last_change":"2023-12-04T10:43:58.234310+0000","last_active":"2023-12-04T10:43:58.702614+0000","last_peered":"2023-12-04T10:43:58.702614+0000","last_clean":"2023-12-04T10:43:58.702614+0000","last_became_active":"2023-12-04T10:43:58.233037+0000","last_became_peered":"2023-12-04T10:43:58.233037+0000","last_unstale":"2023-12-04T10:43:58.702614+0000","last_undegraded":"2023-12-04T10:43:58.702614+0000","last_fullsized":"2023-12-04T10:43:58.702614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:45:11.650821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022299+0000","last_change":"2023-12-04T10:43:52.244397+0000","last_active":"2023-12-04T10:43:58.022299+0000","last_peered":"2023-12-04T10:43:58.022299+0000","last_clean":"2023-12-04T10:43:58.022299+0000","last_became_active":"2023-12-04T10:43:52.244095+0000","last_became_peered":"2023-12-04T10:43:52.244095+0000","last_unstale":"2023-12-04T10:43:58.022299+0000","last_undegraded":"2023-12-04T10:43:58.022299+0000","last_fullsized":"2023-12-04T10:43:58.022299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:12:59.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037025+0000","last_change":"2023-12-04T10:43:52.991593+0000","last_active":"2023-12-04T10:43:58.037025+0000","last_peered":"2023-12-04T10:43:58.037025+0000","last_clean":"2023-12-04T10:43:58.037025+0000","last_became_active":"2023-12-04T10:43:52.991219+0000","last_became_peered":"2023-12-04T10:43:52.991219+0000","last_unstale":"2023-12-04T10:43:58.037025+0000","last_undegraded":"2023-12-04T10:43:58.037025+0000","last_fullsized":"2023-12-04T10:43:58.037025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704700+0000","last_change":"2023-12-04T10:43:58.054950+0000","last_active":"2023-12-04T10:43:58.704700+0000","last_peered":"2023-12-04T10:43:58.704700+0000","last_clean":"2023-12-04T10:43:58.704700+0000","last_became_active":"2023-12-04T10:43:58.054476+0000","last_became_peered":"2023-12-04T10:43:58.054476+0000","last_unstale":"2023-12-04T10:43:58.704700+0000","last_undegraded":"2023-12-04T10:43:58.704700+0000","last_fullsized":"2023-12-04T10:43:58.704700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:12.751001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219571+0000","last_change":"2023-12-04T10:43:52.267072+0000","last_active":"2023-12-04T10:43:58.219571+0000","last_peered":"2023-12-04T10:43:58.219571+0000","last_clean":"2023-12-04T10:43:58.219571+0000","last_became_active":"2023-12-04T10:43:52.266736+0000","last_became_peered":"2023-12-04T10:43:52.266736+0000","last_unstale":"2023-12-04T10:43:58.219571+0000","last_undegraded":"2023-12-04T10:43:58.219571+0000","last_fullsized":"2023-12-04T10:43:58.219571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:24.986256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040614+0000","last_change":"2023-12-04T10:43:52.973354+0000","last_active":"2023-12-04T10:43:58.040614+0000","last_peered":"2023-12-04T10:43:58.040614+0000","last_clean":"2023-12-04T10:43:58.040614+0000","last_became_active":"2023-12-04T10:43:52.973024+0000","last_became_peered":"2023-12-04T10:43:52.973024+0000","last_unstale":"2023-12-04T10:43:58.040614+0000","last_undegraded":"2023-12-04T10:43:58.040614+0000","last_fullsized":"2023-12-04T10:43:58.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703606+0000","last_change":"2023-12-04T10:43:58.052885+0000","last_active":"2023-12-04T10:43:58.703606+0000","last_peered":"2023-12-04T10:43:58.703606+0000","last_clean":"2023-12-04T10:43:58.703606+0000","last_became_active":"2023-12-04T10:43:58.052363+0000","last_became_peered":"2023-12-04T10:43:58.052363+0000","last_unstale":"2023-12-04T10:43:58.703606+0000","last_undegraded":"2023-12-04T10:43:58.703606+0000","last_fullsized":"2023-12-04T10:43:58.703606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:46.891581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.215836+0000","last_change":"2023-12-04T10:43:52.270824+0000","last_active":"2023-12-04T10:43:58.215836+0000","last_peered":"2023-12-04T10:43:58.215836+0000","last_clean":"2023-12-04T10:43:58.215836+0000","last_became_active":"2023-12-04T10:43:52.270451+0000","last_became_peered":"2023-12-04T10:43:52.270451+0000","last_unstale":"2023-12-04T10:43:58.215836+0000","last_undegraded":"2023-12-04T10:43:58.215836+0000","last_fullsized":"2023-12-04T10:43:58.215836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:09.555889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040349+0000","last_change":"2023-12-04T10:43:52.975366+0000","last_active":"2023-12-04T10:43:58.040349+0000","last_peered":"2023-12-04T10:43:58.040349+0000","last_clean":"2023-12-04T10:43:58.040349+0000","last_became_active":"2023-12-04T10:43:52.975083+0000","last_became_peered":"2023-12-04T10:43:52.975083+0000","last_unstale":"2023-12-04T10:43:58.040349+0000","last_undegraded":"2023-12-04T10:43:58.040349+0000","last_fullsized":"2023-12-04T10:43:58.040349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:46.964865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703374+0000","last_change":"2023-12-04T10:43:58.056032+0000","last_active":"2023-12-04T10:43:58.703374+0000","last_peered":"2023-12-04T10:43:58.703374+0000","last_clean":"2023-12-04T10:43:58.703374+0000","last_became_active":"2023-12-04T10:43:58.055534+0000","last_became_peered":"2023-12-04T10:43:58.055534+0000","last_unstale":"2023-12-04T10:43:58.703374+0000","last_undegraded":"2023-12-04T10:43:58.703374+0000","last_fullsized":"2023-12-04T10:43:58.703374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:17:56.402589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048799+0000","last_change":"2023-12-04T10:43:52.985238+0000","last_active":"2023-12-04T10:43:58.048799+0000","last_peered":"2023-12-04T10:43:58.048799+0000","last_clean":"2023-12-04T10:43:58.048799+0000","last_became_active":"2023-12-04T10:43:52.984911+0000","last_became_peered":"2023-12-04T10:43:52.984911+0000","last_unstale":"2023-12-04T10:43:58.048799+0000","last_undegraded":"2023-12-04T10:43:58.048799+0000","last_fullsized":"2023-12-04T10:43:58.048799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216522+0000","last_change":"2023-12-04T10:43:52.269729+0000","last_active":"2023-12-04T10:43:58.216522+0000","last_peered":"2023-12-04T10:43:58.216522+0000","last_clean":"2023-12-04T10:43:58.216522+0000","last_became_active":"2023-12-04T10:43:52.268943+0000","last_became_peered":"2023-12-04T10:43:52.268943+0000","last_unstale":"2023-12-04T10:43:58.216522+0000","last_undegraded":"2023-12-04T10:43:58.216522+0000","last_fullsized":"2023-12-04T10:43:58.216522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:47.791989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.705778+0000","last_change":"2023-12-04T10:43:58.054574+0000","last_active":"2023-12-04T10:43:58.705778+0000","last_peered":"2023-12-04T10:43:58.705778+0000","last_clean":"2023-12-04T10:43:58.705778+0000","last_became_active":"2023-12-04T10:43:58.052778+0000","last_became_peered":"2023-12-04T10:43:58.052778+0000","last_unstale":"2023-12-04T10:43:58.705778+0000","last_undegraded":"2023-12-04T10:43:58.705778+0000","last_fullsized":"2023-12-04T10:43:58.705778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:14:13.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021096+0000","last_change":"2023-12-04T10:43:52.980176+0000","last_active":"2023-12-04T10:43:58.021096+0000","last_peered":"2023-12-04T10:43:58.021096+0000","last_clean":"2023-12-04T10:43:58.021096+0000","last_became_active":"2023-12-04T10:43:52.979878+0000","last_became_peered":"2023-12-04T10:43:52.979878+0000","last_unstale":"2023-12-04T10:43:58.021096+0000","last_undegraded":"2023-12-04T10:43:58.021096+0000","last_fullsized":"2023-12-04T10:43:58.021096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.031512+0000","last_change":"2023-12-04T10:43:52.251368+0000","last_active":"2023-12-04T10:43:58.031512+0000","last_peered":"2023-12-04T10:43:58.031512+0000","last_clean":"2023-12-04T10:43:58.031512+0000","last_became_active":"2023-12-04T10:43:52.248421+0000","last_became_peered":"2023-12-04T10:43:52.248421+0000","last_unstale":"2023-12-04T10:43:58.031512+0000","last_undegraded":"2023-12-04T10:43:58.031512+0000","last_fullsized":"2023-12-04T10:43:58.031512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:01:30.452121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704063+0000","last_change":"2023-12-04T10:43:58.050763+0000","last_active":"2023-12-04T10:43:58.704063+0000","last_peered":"2023-12-04T10:43:58.704063+0000","last_clean":"2023-12-04T10:43:58.704063+0000","last_became_active":"2023-12-04T10:43:58.050229+0000","last_became_peered":"2023-12-04T10:43:58.050229+0000","last_unstale":"2023-12-04T10:43:58.704063+0000","last_undegraded":"2023-12-04T10:43:58.704063+0000","last_fullsized":"2023-12-04T10:43:58.704063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:49:06.824707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021858+0000","last_change":"2023-12-04T10:43:52.980604+0000","last_active":"2023-12-04T10:43:58.021858+0000","last_peered":"2023-12-04T10:43:58.021858+0000","last_clean":"2023-12-04T10:43:58.021858+0000","last_became_active":"2023-12-04T10:43:52.980217+0000","last_became_peered":"2023-12-04T10:43:52.980217+0000","last_unstale":"2023-12-04T10:43:58.021858+0000","last_undegraded":"2023-12-04T10:43:58.021858+0000","last_fullsized":"2023-12-04T10:43:58.021858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030984+0000","last_change":"2023-12-04T10:43:52.261622+0000","last_active":"2023-12-04T10:43:58.030984+0000","last_peered":"2023-12-04T10:43:58.030984+0000","last_clean":"2023-12-04T10:43:58.030984+0000","last_became_active":"2023-12-04T10:43:52.261298+0000","last_became_peered":"2023-12-04T10:43:52.261298+0000","last_unstale":"2023-12-04T10:43:58.030984+0000","last_undegraded":"2023-12-04T10:43:58.030984+0000","last_fullsized":"2023-12-04T10:43:58.030984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:47.544355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.000863+0000","last_change":"2023-12-04T10:43:58.226091+0000","last_active":"2023-12-04T10:43:59.000863+0000","last_peered":"2023-12-04T10:43:59.000863+0000","last_clean":"2023-12-04T10:43:59.000863+0000","last_became_active":"2023-12-04T10:43:58.225330+0000","last_became_peered":"2023-12-04T10:43:58.225330+0000","last_unstale":"2023-12-04T10:43:59.000863+0000","last_undegraded":"2023-12-04T10:43:59.000863+0000","last_fullsized":"2023-12-04T10:43:59.000863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:55:33.240134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030673+0000","last_change":"2023-12-04T10:43:52.982076+0000","last_active":"2023-12-04T10:43:58.030673+0000","last_peered":"2023-12-04T10:43:58.030673+0000","last_clean":"2023-12-04T10:43:58.030673+0000","last_became_active":"2023-12-04T10:43:52.972016+0000","last_became_peered":"2023-12-04T10:43:52.972016+0000","last_unstale":"2023-12-04T10:43:58.030673+0000","last_undegraded":"2023-12-04T10:43:58.030673+0000","last_fullsized":"2023-12-04T10:43:58.030673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:46:15.950875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.214559+0000","last_change":"2023-12-04T10:43:52.266409+0000","last_active":"2023-12-04T10:43:58.214559+0000","last_peered":"2023-12-04T10:43:58.214559+0000","last_clean":"2023-12-04T10:43:58.214559+0000","last_became_active":"2023-12-04T10:43:52.265294+0000","last_became_peered":"2023-12-04T10:43:52.265294+0000","last_unstale":"2023-12-04T10:43:58.214559+0000","last_undegraded":"2023-12-04T10:43:58.214559+0000","last_fullsized":"2023-12-04T10:43:58.214559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:30:30.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704052+0000","last_change":"2023-12-04T10:43:58.054026+0000","last_active":"2023-12-04T10:43:58.704052+0000","last_peered":"2023-12-04T10:43:58.704052+0000","last_clean":"2023-12-04T10:43:58.704052+0000","last_became_active":"2023-12-04T10:43:58.053503+0000","last_became_peered":"2023-12-04T10:43:58.053503+0000","last_unstale":"2023-12-04T10:43:58.704052+0000","last_undegraded":"2023-12-04T10:43:58.704052+0000","last_fullsized":"2023-12-04T10:43:58.704052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:16:07.199657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039992+0000","last_change":"2023-12-04T10:43:52.985148+0000","last_active":"2023-12-04T10:43:58.039992+0000","last_peered":"2023-12-04T10:43:58.039992+0000","last_clean":"2023-12-04T10:43:58.039992+0000","last_became_active":"2023-12-04T10:43:52.984813+0000","last_became_peered":"2023-12-04T10:43:52.984813+0000","last_unstale":"2023-12-04T10:43:58.039992+0000","last_undegraded":"2023-12-04T10:43:58.039992+0000","last_fullsized":"2023-12-04T10:43:58.039992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049600+0000","last_change":"2023-12-04T10:43:52.270015+0000","last_active":"2023-12-04T10:43:58.049600+0000","last_peered":"2023-12-04T10:43:58.049600+0000","last_clean":"2023-12-04T10:43:58.049600+0000","last_became_active":"2023-12-04T10:43:52.269682+0000","last_became_peered":"2023-12-04T10:43:52.269682+0000","last_unstale":"2023-12-04T10:43:58.049600+0000","last_undegraded":"2023-12-04T10:43:58.049600+0000","last_fullsized":"2023-12-04T10:43:58.049600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703352+0000","last_change":"2023-12-04T10:43:58.223739+0000","last_active":"2023-12-04T10:43:58.703352+0000","last_peered":"2023-12-04T10:43:58.703352+0000","last_clean":"2023-12-04T10:43:58.703352+0000","last_became_active":"2023-12-04T10:43:58.223091+0000","last_became_peered":"2023-12-04T10:43:58.223091+0000","last_unstale":"2023-12-04T10:43:58.703352+0000","last_undegraded":"2023-12-04T10:43:58.703352+0000","last_fullsized":"2023-12-04T10:43:58.703352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:20:24.266893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.023237+0000","last_change":"2023-12-04T10:43:52.980989+0000","last_active":"2023-12-04T10:43:58.023237+0000","last_peered":"2023-12-04T10:43:58.023237+0000","last_clean":"2023-12-04T10:43:58.023237+0000","last_became_active":"2023-12-04T10:43:52.980436+0000","last_became_peered":"2023-12-04T10:43:52.980436+0000","last_unstale":"2023-12-04T10:43:58.023237+0000","last_undegraded":"2023-12-04T10:43:58.023237+0000","last_fullsized":"2023-12-04T10:43:58.023237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030910+0000","last_change":"2023-12-04T10:43:52.258606+0000","last_active":"2023-12-04T10:43:58.030910+0000","last_peered":"2023-12-04T10:43:58.030910+0000","last_clean":"2023-12-04T10:43:58.030910+0000","last_became_active":"2023-12-04T10:43:52.258209+0000","last_became_peered":"2023-12-04T10:43:52.258209+0000","last_unstale":"2023-12-04T10:43:58.030910+0000","last_undegraded":"2023-12-04T10:43:58.030910+0000","last_fullsized":"2023-12-04T10:43:58.030910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:15:20.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702285+0000","last_change":"2023-12-04T10:43:58.215546+0000","last_active":"2023-12-04T10:43:58.702285+0000","last_peered":"2023-12-04T10:43:58.702285+0000","last_clean":"2023-12-04T10:43:58.702285+0000","last_became_active":"2023-12-04T10:43:58.214293+0000","last_became_peered":"2023-12-04T10:43:58.214293+0000","last_unstale":"2023-12-04T10:43:58.702285+0000","last_undegraded":"2023-12-04T10:43:58.702285+0000","last_fullsized":"2023-12-04T10:43:58.702285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:57:02.248236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034123+0000","last_change":"2023-12-04T10:43:52.973852+0000","last_active":"2023-12-04T10:43:58.034123+0000","last_peered":"2023-12-04T10:43:58.034123+0000","last_clean":"2023-12-04T10:43:58.034123+0000","last_became_active":"2023-12-04T10:43:52.972253+0000","last_became_peered":"2023-12-04T10:43:52.972253+0000","last_unstale":"2023-12-04T10:43:58.034123+0000","last_undegraded":"2023-12-04T10:43:58.034123+0000","last_fullsized":"2023-12-04T10:43:58.034123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:20:19.481533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.220155+0000","last_change":"2023-12-04T10:43:52.261351+0000","last_active":"2023-12-04T10:43:58.220155+0000","last_peered":"2023-12-04T10:43:58.220155+0000","last_clean":"2023-12-04T10:43:58.220155+0000","last_became_active":"2023-12-04T10:43:52.261052+0000","last_became_peered":"2023-12-04T10:43:52.261052+0000","last_unstale":"2023-12-04T10:43:58.220155+0000","last_undegraded":"2023-12-04T10:43:58.220155+0000","last_fullsized":"2023-12-04T10:43:58.220155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:03.065751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995773+0000","last_change":"2023-12-04T10:43:58.215971+0000","last_active":"2023-12-04T10:43:58.995773+0000","last_peered":"2023-12-04T10:43:58.995773+0000","last_clean":"2023-12-04T10:43:58.995773+0000","last_became_active":"2023-12-04T10:43:58.214859+0000","last_became_peered":"2023-12-04T10:43:58.214859+0000","last_unstale":"2023-12-04T10:43:58.995773+0000","last_undegraded":"2023-12-04T10:43:58.995773+0000","last_fullsized":"2023-12-04T10:43:58.995773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:32:49.715432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040441+0000","last_change":"2023-12-04T10:43:52.994569+0000","last_active":"2023-12-04T10:43:58.040441+0000","last_peered":"2023-12-04T10:43:58.040441+0000","last_clean":"2023-12-04T10:43:58.040441+0000","last_became_active":"2023-12-04T10:43:52.994301+0000","last_became_peered":"2023-12-04T10:43:52.994301+0000","last_unstale":"2023-12-04T10:43:58.040441+0000","last_undegraded":"2023-12-04T10:43:58.040441+0000","last_fullsized":"2023-12-04T10:43:58.040441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:21.236244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034230+0000","last_change":"2023-12-04T10:43:52.249758+0000","last_active":"2023-12-04T10:43:58.034230+0000","last_peered":"2023-12-04T10:43:58.034230+0000","last_clean":"2023-12-04T10:43:58.034230+0000","last_became_active":"2023-12-04T10:43:52.248998+0000","last_became_peered":"2023-12-04T10:43:52.248998+0000","last_unstale":"2023-12-04T10:43:58.034230+0000","last_undegraded":"2023-12-04T10:43:58.034230+0000","last_fullsized":"2023-12-04T10:43:58.034230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:18:12.560014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.998783+0000","last_change":"2023-12-04T10:43:58.049867+0000","last_active":"2023-12-04T10:43:58.998783+0000","last_peered":"2023-12-04T10:43:58.998783+0000","last_clean":"2023-12-04T10:43:58.998783+0000","last_became_active":"2023-12-04T10:43:58.049454+0000","last_became_peered":"2023-12-04T10:43:58.049454+0000","last_unstale":"2023-12-04T10:43:58.998783+0000","last_undegraded":"2023-12-04T10:43:58.998783+0000","last_fullsized":"2023-12-04T10:43:58.998783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:14:13.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037424+0000","last_change":"2023-12-04T10:43:52.980950+0000","last_active":"2023-12-04T10:43:58.037424+0000","last_peered":"2023-12-04T10:43:58.037424+0000","last_clean":"2023-12-04T10:43:58.037424+0000","last_became_active":"2023-12-04T10:43:52.980633+0000","last_became_peered":"2023-12-04T10:43:52.980633+0000","last_unstale":"2023-12-04T10:43:58.037424+0000","last_undegraded":"2023-12-04T10:43:58.037424+0000","last_fullsized":"2023-12-04T10:43:58.037424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:24:23.025254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.035013+0000","last_change":"2023-12-04T10:43:52.259456+0000","last_active":"2023-12-04T10:43:58.035013+0000","last_peered":"2023-12-04T10:43:58.035013+0000","last_clean":"2023-12-04T10:43:58.035013+0000","last_became_active":"2023-12-04T10:43:52.254414+0000","last_became_peered":"2023-12-04T10:43:52.254414+0000","last_unstale":"2023-12-04T10:43:58.035013+0000","last_undegraded":"2023-12-04T10:43:58.035013+0000","last_fullsized":"2023-12-04T10:43:58.035013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:03.065751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.000962+0000","last_change":"2023-12-04T10:43:58.053734+0000","last_active":"2023-12-04T10:43:59.000962+0000","last_peered":"2023-12-04T10:43:59.000962+0000","last_clean":"2023-12-04T10:43:59.000962+0000","last_became_active":"2023-12-04T10:43:58.053373+0000","last_became_peered":"2023-12-04T10:43:58.053373+0000","last_unstale":"2023-12-04T10:43:59.000962+0000","last_undegraded":"2023-12-04T10:43:59.000962+0000","last_fullsized":"2023-12-04T10:43:59.000962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:22:58.696286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030598+0000","last_change":"2023-12-04T10:43:52.974356+0000","last_active":"2023-12-04T10:43:58.030598+0000","last_peered":"2023-12-04T10:43:58.030598+0000","last_clean":"2023-12-04T10:43:58.030598+0000","last_became_active":"2023-12-04T10:43:52.974025+0000","last_became_peered":"2023-12-04T10:43:52.974025+0000","last_unstale":"2023-12-04T10:43:58.030598+0000","last_undegraded":"2023-12-04T10:43:58.030598+0000","last_fullsized":"2023-12-04T10:43:58.030598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:02:21.706862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.044424+0000","last_change":"2023-12-04T10:43:52.251063+0000","last_active":"2023-12-04T10:43:58.044424+0000","last_peered":"2023-12-04T10:43:58.044424+0000","last_clean":"2023-12-04T10:43:58.044424+0000","last_became_active":"2023-12-04T10:43:52.250274+0000","last_became_peered":"2023-12-04T10:43:52.250274+0000","last_unstale":"2023-12-04T10:43:58.044424+0000","last_undegraded":"2023-12-04T10:43:58.044424+0000","last_fullsized":"2023-12-04T10:43:58.044424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:20.848140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.001269+0000","last_change":"2023-12-04T10:43:58.046943+0000","last_active":"2023-12-04T10:43:59.001269+0000","last_peered":"2023-12-04T10:43:59.001269+0000","last_clean":"2023-12-04T10:43:59.001269+0000","last_became_active":"2023-12-04T10:43:58.046583+0000","last_became_peered":"2023-12-04T10:43:58.046583+0000","last_unstale":"2023-12-04T10:43:59.001269+0000","last_undegraded":"2023-12-04T10:43:59.001269+0000","last_fullsized":"2023-12-04T10:43:59.001269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:18:58.227614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.032594+0000","last_change":"2023-12-04T10:43:52.973314+0000","last_active":"2023-12-04T10:43:58.032594+0000","last_peered":"2023-12-04T10:43:58.032594+0000","last_clean":"2023-12-04T10:43:58.032594+0000","last_became_active":"2023-12-04T10:43:52.973027+0000","last_became_peered":"2023-12-04T10:43:52.973027+0000","last_unstale":"2023-12-04T10:43:58.032594+0000","last_undegraded":"2023-12-04T10:43:58.032594+0000","last_fullsized":"2023-12-04T10:43:58.032594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216818+0000","last_change":"2023-12-04T10:43:52.264881+0000","last_active":"2023-12-04T10:43:58.216818+0000","last_peered":"2023-12-04T10:43:58.216818+0000","last_clean":"2023-12-04T10:43:58.216818+0000","last_became_active":"2023-12-04T10:43:52.262303+0000","last_became_peered":"2023-12-04T10:43:52.262303+0000","last_unstale":"2023-12-04T10:43:58.216818+0000","last_undegraded":"2023-12-04T10:43:58.216818+0000","last_fullsized":"2023-12-04T10:43:58.216818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995766+0000","last_change":"2023-12-04T10:43:58.235583+0000","last_active":"2023-12-04T10:43:58.995766+0000","last_peered":"2023-12-04T10:43:58.995766+0000","last_clean":"2023-12-04T10:43:58.995766+0000","last_became_active":"2023-12-04T10:43:58.231876+0000","last_became_peered":"2023-12-04T10:43:58.231876+0000","last_unstale":"2023-12-04T10:43:58.995766+0000","last_undegraded":"2023-12-04T10:43:58.995766+0000","last_fullsized":"2023-12-04T10:43:58.995766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:59.475236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020643+0000","last_change":"2023-12-04T10:43:52.988166+0000","last_active":"2023-12-04T10:43:58.020643+0000","last_peered":"2023-12-04T10:43:58.020643+0000","last_clean":"2023-12-04T10:43:58.020643+0000","last_became_active":"2023-12-04T10:43:52.987801+0000","last_became_peered":"2023-12-04T10:43:52.987801+0000","last_unstale":"2023-12-04T10:43:58.020643+0000","last_undegraded":"2023-12-04T10:43:58.020643+0000","last_fullsized":"2023-12-04T10:43:58.020643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041216+0000","last_change":"2023-12-04T10:43:52.261710+0000","last_active":"2023-12-04T10:43:58.041216+0000","last_peered":"2023-12-04T10:43:58.041216+0000","last_clean":"2023-12-04T10:43:58.041216+0000","last_became_active":"2023-12-04T10:43:52.253457+0000","last_became_peered":"2023-12-04T10:43:52.253457+0000","last_unstale":"2023-12-04T10:43:58.041216+0000","last_undegraded":"2023-12-04T10:43:58.041216+0000","last_fullsized":"2023-12-04T10:43:58.041216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:24.986256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.215951+0000","last_change":"2023-12-04T10:43:48.111279+0000","last_active":"2023-12-04T10:43:58.215951+0000","last_peered":"2023-12-04T10:43:58.215951+0000","last_clean":"2023-12-04T10:43:58.215951+0000","last_became_active":"2023-12-04T10:43:48.108038+0000","last_became_peered":"2023-12-04T10:43:48.108038+0000","last_unstale":"2023-12-04T10:43:58.215951+0000","last_undegraded":"2023-12-04T10:43:58.215951+0000","last_fullsized":"2023-12-04T10:43:58.215951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_clean_scrub_stamp":"2023-12-04T10:43:46.528449+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:31:15.475210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.707014+0000","last_change":"2023-12-04T10:43:58.229941+0000","last_active":"2023-12-04T10:43:58.707014+0000","last_peered":"2023-12-04T10:43:58.707014+0000","last_clean":"2023-12-04T10:43:58.707014+0000","last_became_active":"2023-12-04T10:43:58.225120+0000","last_became_peered":"2023-12-04T10:43:58.225120+0000","last_unstale":"2023-12-04T10:43:58.707014+0000","last_undegraded":"2023-12-04T10:43:58.707014+0000","last_fullsized":"2023-12-04T10:43:58.707014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:15.863508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219407+0000","last_change":"2023-12-04T10:43:52.982313+0000","last_active":"2023-12-04T10:43:58.219407+0000","last_peered":"2023-12-04T10:43:58.219407+0000","last_clean":"2023-12-04T10:43:58.219407+0000","last_became_active":"2023-12-04T10:43:52.979562+0000","last_became_peered":"2023-12-04T10:43:52.979562+0000","last_unstale":"2023-12-04T10:43:58.219407+0000","last_undegraded":"2023-12-04T10:43:58.219407+0000","last_fullsized":"2023-12-04T10:43:58.219407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:46.964865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049829+0000","last_change":"2023-12-04T10:43:52.267801+0000","last_active":"2023-12-04T10:43:58.049829+0000","last_peered":"2023-12-04T10:43:58.049829+0000","last_clean":"2023-12-04T10:43:58.049829+0000","last_became_active":"2023-12-04T10:43:52.267514+0000","last_became_peered":"2023-12-04T10:43:52.267514+0000","last_unstale":"2023-12-04T10:43:58.049829+0000","last_undegraded":"2023-12-04T10:43:58.049829+0000","last_fullsized":"2023-12-04T10:43:58.049829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:46:14.667542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.705960+0000","last_change":"2023-12-04T10:43:58.218053+0000","last_active":"2023-12-04T10:43:58.705960+0000","last_peered":"2023-12-04T10:43:58.705960+0000","last_clean":"2023-12-04T10:43:58.705960+0000","last_became_active":"2023-12-04T10:43:58.216729+0000","last_became_peered":"2023-12-04T10:43:58.216729+0000","last_unstale":"2023-12-04T10:43:58.705960+0000","last_undegraded":"2023-12-04T10:43:58.705960+0000","last_fullsized":"2023-12-04T10:43:58.705960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:05.657652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040709+0000","last_change":"2023-12-04T10:43:52.993942+0000","last_active":"2023-12-04T10:43:58.040709+0000","last_peered":"2023-12-04T10:43:58.040709+0000","last_clean":"2023-12-04T10:43:58.040709+0000","last_became_active":"2023-12-04T10:43:52.993613+0000","last_became_peered":"2023-12-04T10:43:52.993613+0000","last_unstale":"2023-12-04T10:43:58.040709+0000","last_undegraded":"2023-12-04T10:43:58.040709+0000","last_fullsized":"2023-12-04T10:43:58.040709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:11.078149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030147+0000","last_change":"2023-12-04T10:43:52.253522+0000","last_active":"2023-12-04T10:43:58.030147+0000","last_peered":"2023-12-04T10:43:58.030147+0000","last_clean":"2023-12-04T10:43:58.030147+0000","last_became_active":"2023-12-04T10:43:52.253254+0000","last_became_peered":"2023-12-04T10:43:52.253254+0000","last_unstale":"2023-12-04T10:43:58.030147+0000","last_undegraded":"2023-12-04T10:43:58.030147+0000","last_fullsized":"2023-12-04T10:43:58.030147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:59.001748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.996252+0000","last_change":"2023-12-04T10:43:58.049520+0000","last_active":"2023-12-04T10:43:58.996252+0000","last_peered":"2023-12-04T10:43:58.996252+0000","last_clean":"2023-12-04T10:43:58.996252+0000","last_became_active":"2023-12-04T10:43:58.049110+0000","last_became_peered":"2023-12-04T10:43:58.049110+0000","last_unstale":"2023-12-04T10:43:58.996252+0000","last_undegraded":"2023-12-04T10:43:58.996252+0000","last_fullsized":"2023-12-04T10:43:58.996252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:29.332279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.221876+0000","last_change":"2023-12-04T10:43:52.992408+0000","last_active":"2023-12-04T10:43:58.221876+0000","last_peered":"2023-12-04T10:43:58.221876+0000","last_clean":"2023-12-04T10:43:58.221876+0000","last_became_active":"2023-12-04T10:43:52.992078+0000","last_became_peered":"2023-12-04T10:43:52.992078+0000","last_unstale":"2023-12-04T10:43:58.221876+0000","last_undegraded":"2023-12-04T10:43:58.221876+0000","last_fullsized":"2023-12-04T10:43:58.221876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:24.546919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.046433+0000","last_change":"2023-12-04T10:43:52.251057+0000","last_active":"2023-12-04T10:43:58.046433+0000","last_peered":"2023-12-04T10:43:58.046433+0000","last_clean":"2023-12-04T10:43:58.046433+0000","last_became_active":"2023-12-04T10:43:52.250572+0000","last_became_peered":"2023-12-04T10:43:52.250572+0000","last_unstale":"2023-12-04T10:43:58.046433+0000","last_undegraded":"2023-12-04T10:43:58.046433+0000","last_fullsized":"2023-12-04T10:43:58.046433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:24:21.741921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.996401+0000","last_change":"2023-12-04T10:43:58.228293+0000","last_active":"2023-12-04T10:43:58.996401+0000","last_peered":"2023-12-04T10:43:58.996401+0000","last_clean":"2023-12-04T10:43:58.996401+0000","last_became_active":"2023-12-04T10:43:58.227230+0000","last_became_peered":"2023-12-04T10:43:58.227230+0000","last_unstale":"2023-12-04T10:43:58.996401+0000","last_undegraded":"2023-12-04T10:43:58.996401+0000","last_fullsized":"2023-12-04T10:43:58.996401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:45:11.650821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219484+0000","last_change":"2023-12-04T10:43:52.986513+0000","last_active":"2023-12-04T10:43:58.219484+0000","last_peered":"2023-12-04T10:43:58.219484+0000","last_clean":"2023-12-04T10:43:58.219484+0000","last_became_active":"2023-12-04T10:43:52.985480+0000","last_became_peered":"2023-12-04T10:43:52.985480+0000","last_unstale":"2023-12-04T10:43:58.219484+0000","last_undegraded":"2023-12-04T10:43:58.219484+0000","last_fullsized":"2023-12-04T10:43:58.219484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:54.689876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033674+0000","last_change":"2023-12-04T10:43:52.248849+0000","last_active":"2023-12-04T10:43:58.033674+0000","last_peered":"2023-12-04T10:43:58.033674+0000","last_clean":"2023-12-04T10:43:58.033674+0000","last_became_active":"2023-12-04T10:43:52.248072+0000","last_became_peered":"2023-12-04T10:43:52.248072+0000","last_unstale":"2023-12-04T10:43:58.033674+0000","last_undegraded":"2023-12-04T10:43:58.033674+0000","last_fullsized":"2023-12-04T10:43:58.033674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:55:50.076235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704337+0000","last_change":"2023-12-04T10:43:58.054851+0000","last_active":"2023-12-04T10:43:58.704337+0000","last_peered":"2023-12-04T10:43:58.704337+0000","last_clean":"2023-12-04T10:43:58.704337+0000","last_became_active":"2023-12-04T10:43:58.053543+0000","last_became_peered":"2023-12-04T10:43:58.053543+0000","last_unstale":"2023-12-04T10:43:58.704337+0000","last_undegraded":"2023-12-04T10:43:58.704337+0000","last_fullsized":"2023-12-04T10:43:58.704337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:36.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.217048+0000","last_change":"2023-12-04T10:43:52.988930+0000","last_active":"2023-12-04T10:43:58.217048+0000","last_peered":"2023-12-04T10:43:58.217048+0000","last_clean":"2023-12-04T10:43:58.217048+0000","last_became_active":"2023-12-04T10:43:52.988638+0000","last_became_peered":"2023-12-04T10:43:52.988638+0000","last_unstale":"2023-12-04T10:43:58.217048+0000","last_undegraded":"2023-12-04T10:43:58.217048+0000","last_fullsized":"2023-12-04T10:43:58.217048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041474+0000","last_change":"2023-12-04T10:43:52.245850+0000","last_active":"2023-12-04T10:43:58.041474+0000","last_peered":"2023-12-04T10:43:58.041474+0000","last_clean":"2023-12-04T10:43:58.041474+0000","last_became_active":"2023-12-04T10:43:52.245241+0000","last_became_peered":"2023-12-04T10:43:52.245241+0000","last_unstale":"2023-12-04T10:43:58.041474+0000","last_undegraded":"2023-12-04T10:43:58.041474+0000","last_fullsized":"2023-12-04T10:43:58.041474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:01:30.452121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995405+0000","last_change":"2023-12-04T10:43:58.057996+0000","last_active":"2023-12-04T10:43:58.995405+0000","last_peered":"2023-12-04T10:43:58.995405+0000","last_clean":"2023-12-04T10:43:58.995405+0000","last_became_active":"2023-12-04T10:43:58.052353+0000","last_became_peered":"2023-12-04T10:43:58.052353+0000","last_unstale":"2023-12-04T10:43:58.995405+0000","last_undegraded":"2023-12-04T10:43:58.995405+0000","last_fullsized":"2023-12-04T10:43:58.995405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:44.810269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048575+0000","last_change":"2023-12-04T10:43:52.986974+0000","last_active":"2023-12-04T10:43:58.048575+0000","last_peered":"2023-12-04T10:43:58.048575+0000","last_clean":"2023-12-04T10:43:58.048575+0000","last_became_active":"2023-12-04T10:43:52.986644+0000","last_became_peered":"2023-12-04T10:43:52.986644+0000","last_unstale":"2023-12-04T10:43:58.048575+0000","last_undegraded":"2023-12-04T10:43:58.048575+0000","last_fullsized":"2023-12-04T10:43:58.048575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048730+0000","last_change":"2023-12-04T10:43:52.262403+0000","last_active":"2023-12-04T10:43:58.048730+0000","last_peered":"2023-12-04T10:43:58.048730+0000","last_clean":"2023-12-04T10:43:58.048730+0000","last_became_active":"2023-12-04T10:43:52.261992+0000","last_became_peered":"2023-12-04T10:43:52.261992+0000","last_unstale":"2023-12-04T10:43:58.048730+0000","last_undegraded":"2023-12-04T10:43:58.048730+0000","last_fullsized":"2023-12-04T10:43:58.048730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:53:18.654556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704536+0000","last_change":"2023-12-04T10:43:58.227429+0000","last_active":"2023-12-04T10:43:58.704536+0000","last_peered":"2023-12-04T10:43:58.704536+0000","last_clean":"2023-12-04T10:43:58.704536+0000","last_became_active":"2023-12-04T10:43:58.226172+0000","last_became_peered":"2023-12-04T10:43:58.226172+0000","last_unstale":"2023-12-04T10:43:58.704536+0000","last_undegraded":"2023-12-04T10:43:58.704536+0000","last_fullsized":"2023-12-04T10:43:58.704536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:24:19.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216035+0000","last_change":"2023-12-04T10:43:52.991297+0000","last_active":"2023-12-04T10:43:58.216035+0000","last_peered":"2023-12-04T10:43:58.216035+0000","last_clean":"2023-12-04T10:43:58.216035+0000","last_became_active":"2023-12-04T10:43:52.990881+0000","last_became_peered":"2023-12-04T10:43:52.990881+0000","last_unstale":"2023-12-04T10:43:58.216035+0000","last_undegraded":"2023-12-04T10:43:58.216035+0000","last_fullsized":"2023-12-04T10:43:58.216035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:11.078149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034868+0000","last_change":"2023-12-04T10:43:52.262989+0000","last_active":"2023-12-04T10:43:58.034868+0000","last_peered":"2023-12-04T10:43:58.034868+0000","last_clean":"2023-12-04T10:43:58.034868+0000","last_became_active":"2023-12-04T10:43:52.262666+0000","last_became_peered":"2023-12-04T10:43:52.262666+0000","last_unstale":"2023-12-04T10:43:58.034868+0000","last_undegraded":"2023-12-04T10:43:58.034868+0000","last_fullsized":"2023-12-04T10:43:58.034868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:25.093855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703956+0000","last_change":"2023-12-04T10:43:58.215319+0000","last_active":"2023-12-04T10:43:58.703956+0000","last_peered":"2023-12-04T10:43:58.703956+0000","last_clean":"2023-12-04T10:43:58.703956+0000","last_became_active":"2023-12-04T10:43:58.214315+0000","last_became_peered":"2023-12-04T10:43:58.214315+0000","last_unstale":"2023-12-04T10:43:58.703956+0000","last_undegraded":"2023-12-04T10:43:58.703956+0000","last_fullsized":"2023-12-04T10:43:58.703956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:20:30.277031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033921+0000","last_change":"2023-12-04T10:43:52.977398+0000","last_active":"2023-12-04T10:43:58.033921+0000","last_peered":"2023-12-04T10:43:58.033921+0000","last_clean":"2023-12-04T10:43:58.033921+0000","last_became_active":"2023-12-04T10:43:52.977024+0000","last_became_peered":"2023-12-04T10:43:52.977024+0000","last_unstale":"2023-12-04T10:43:58.033921+0000","last_undegraded":"2023-12-04T10:43:58.033921+0000","last_fullsized":"2023-12-04T10:43:58.033921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039616+0000","last_change":"2023-12-04T10:43:52.255501+0000","last_active":"2023-12-04T10:43:58.039616+0000","last_peered":"2023-12-04T10:43:58.039616+0000","last_clean":"2023-12-04T10:43:58.039616+0000","last_became_active":"2023-12-04T10:43:52.255013+0000","last_became_peered":"2023-12-04T10:43:52.255013+0000","last_unstale":"2023-12-04T10:43:58.039616+0000","last_undegraded":"2023-12-04T10:43:58.039616+0000","last_fullsized":"2023-12-04T10:43:58.039616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.999729+0000","last_change":"2023-12-04T10:43:58.216747+0000","last_active":"2023-12-04T10:43:58.999729+0000","last_peered":"2023-12-04T10:43:58.999729+0000","last_clean":"2023-12-04T10:43:58.999729+0000","last_became_active":"2023-12-04T10:43:58.215380+0000","last_became_peered":"2023-12-04T10:43:58.215380+0000","last_unstale":"2023-12-04T10:43:58.999729+0000","last_undegraded":"2023-12-04T10:43:58.999729+0000","last_fullsized":"2023-12-04T10:43:58.999729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:06:26.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219253+0000","last_change":"2023-12-04T10:43:52.986160+0000","last_active":"2023-12-04T10:43:58.219253+0000","last_peered":"2023-12-04T10:43:58.219253+0000","last_clean":"2023-12-04T10:43:58.219253+0000","last_became_active":"2023-12-04T10:43:52.985651+0000","last_became_peered":"2023-12-04T10:43:52.985651+0000","last_unstale":"2023-12-04T10:43:58.219253+0000","last_undegraded":"2023-12-04T10:43:58.219253+0000","last_fullsized":"2023-12-04T10:43:58.219253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:21.236244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:44:13.361227+0000","last_change":"2023-12-04T10:43:52.259456+0000","last_active":"2023-12-04T10:44:13.361227+0000","last_peered":"2023-12-04T10:44:13.361227+0000","last_clean":"2023-12-04T10:44:13.361227+0000","last_became_active":"2023-12-04T10:43:52.259142+0000","last_became_peered":"2023-12-04T10:43:52.259142+0000","last_unstale":"2023-12-04T10:44:13.361227+0000","last_undegraded":"2023-12-04T10:44:13.361227+0000","last_fullsized":"2023-12-04T10:44:13.361227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:14:32.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.999714+0000","last_change":"2023-12-04T10:43:58.055299+0000","last_active":"2023-12-04T10:43:58.999714+0000","last_peered":"2023-12-04T10:43:58.999714+0000","last_clean":"2023-12-04T10:43:58.999714+0000","last_became_active":"2023-12-04T10:43:58.054806+0000","last_became_peered":"2023-12-04T10:43:58.054806+0000","last_unstale":"2023-12-04T10:43:58.999714+0000","last_undegraded":"2023-12-04T10:43:58.999714+0000","last_fullsized":"2023-12-04T10:43:58.999714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:15:21.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.038505+0000","last_change":"2023-12-04T10:43:52.980883+0000","last_active":"2023-12-04T10:43:58.038505+0000","last_peered":"2023-12-04T10:43:58.038505+0000","last_clean":"2023-12-04T10:43:58.038505+0000","last_became_active":"2023-12-04T10:43:52.980510+0000","last_became_peered":"2023-12-04T10:43:52.980510+0000","last_unstale":"2023-12-04T10:43:58.038505+0000","last_undegraded":"2023-12-04T10:43:58.038505+0000","last_fullsized":"2023-12-04T10:43:58.038505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:48.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030038+0000","last_change":"2023-12-04T10:43:52.256393+0000","last_active":"2023-12-04T10:43:58.030038+0000","last_peered":"2023-12-04T10:43:58.030038+0000","last_clean":"2023-12-04T10:43:58.030038+0000","last_became_active":"2023-12-04T10:43:52.256172+0000","last_became_peered":"2023-12-04T10:43:52.256172+0000","last_unstale":"2023-12-04T10:43:58.030038+0000","last_undegraded":"2023-12-04T10:43:58.030038+0000","last_fullsized":"2023-12-04T10:43:58.030038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:50:43.248614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704573+0000","last_change":"2023-12-04T10:43:58.053865+0000","last_active":"2023-12-04T10:43:58.704573+0000","last_peered":"2023-12-04T10:43:58.704573+0000","last_clean":"2023-12-04T10:43:58.704573+0000","last_became_active":"2023-12-04T10:43:58.053350+0000","last_became_peered":"2023-12-04T10:43:58.053350+0000","last_unstale":"2023-12-04T10:43:58.704573+0000","last_undegraded":"2023-12-04T10:43:58.704573+0000","last_fullsized":"2023-12-04T10:43:58.704573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:53:18.451370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039041+0000","last_change":"2023-12-04T10:43:52.979625+0000","last_active":"2023-12-04T10:43:58.039041+0000","last_peered":"2023-12-04T10:43:58.039041+0000","last_clean":"2023-12-04T10:43:58.039041+0000","last_became_active":"2023-12-04T10:43:52.979301+0000","last_became_peered":"2023-12-04T10:43:52.979301+0000","last_unstale":"2023-12-04T10:43:58.039041+0000","last_undegraded":"2023-12-04T10:43:58.039041+0000","last_fullsized":"2023-12-04T10:43:58.039041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040479+0000","last_change":"2023-12-04T10:43:52.256384+0000","last_active":"2023-12-04T10:43:58.040479+0000","last_peered":"2023-12-04T10:43:58.040479+0000","last_clean":"2023-12-04T10:43:58.040479+0000","last_became_active":"2023-12-04T10:43:52.255923+0000","last_became_peered":"2023-12-04T10:43:52.255923+0000","last_unstale":"2023-12-04T10:43:58.040479+0000","last_undegraded":"2023-12-04T10:43:58.040479+0000","last_fullsized":"2023-12-04T10:43:58.040479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:25.210732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702798+0000","last_change":"2023-12-04T10:43:58.052271+0000","last_active":"2023-12-04T10:43:58.702798+0000","last_peered":"2023-12-04T10:43:58.702798+0000","last_clean":"2023-12-04T10:43:58.702798+0000","last_became_active":"2023-12-04T10:43:58.051959+0000","last_became_peered":"2023-12-04T10:43:58.051959+0000","last_unstale":"2023-12-04T10:43:58.702798+0000","last_undegraded":"2023-12-04T10:43:58.702798+0000","last_fullsized":"2023-12-04T10:43:58.702798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:06:26.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040336+0000","last_change":"2023-12-04T10:43:52.982397+0000","last_active":"2023-12-04T10:43:58.040336+0000","last_peered":"2023-12-04T10:43:58.040336+0000","last_clean":"2023-12-04T10:43:58.040336+0000","last_became_active":"2023-12-04T10:43:52.979862+0000","last_became_peered":"2023-12-04T10:43:52.979862+0000","last_unstale":"2023-12-04T10:43:58.040336+0000","last_undegraded":"2023-12-04T10:43:58.040336+0000","last_fullsized":"2023-12-04T10:43:58.040336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:40.024910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049485+0000","last_change":"2023-12-04T10:43:52.267763+0000","last_active":"2023-12-04T10:43:58.049485+0000","last_peered":"2023-12-04T10:43:58.049485+0000","last_clean":"2023-12-04T10:43:58.049485+0000","last_became_active":"2023-12-04T10:43:52.267415+0000","last_became_peered":"2023-12-04T10:43:52.267415+0000","last_unstale":"2023-12-04T10:43:58.049485+0000","last_undegraded":"2023-12-04T10:43:58.049485+0000","last_fullsized":"2023-12-04T10:43:58.049485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702869+0000","last_change":"2023-12-04T10:43:58.225596+0000","last_active":"2023-12-04T10:43:58.702869+0000","last_peered":"2023-12-04T10:43:58.702869+0000","last_clean":"2023-12-04T10:43:58.702869+0000","last_became_active":"2023-12-04T10:43:58.225115+0000","last_became_peered":"2023-12-04T10:43:58.225115+0000","last_unstale":"2023-12-04T10:43:58.702869+0000","last_undegraded":"2023-12-04T10:43:58.702869+0000","last_fullsized":"2023-12-04T10:43:58.702869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:53.914156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995318+0000","last_change":"2023-12-04T10:43:58.235031+0000","last_active":"2023-12-04T10:43:58.995318+0000","last_peered":"2023-12-04T10:43:58.995318+0000","last_clean":"2023-12-04T10:43:58.995318+0000","last_became_active":"2023-12-04T10:43:58.231370+0000","last_became_peered":"2023-12-04T10:43:58.231370+0000","last_unstale":"2023-12-04T10:43:58.995318+0000","last_undegraded":"2023-12-04T10:43:58.995318+0000","last_fullsized":"2023-12-04T10:43:58.995318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:51.750224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030753+0000","last_change":"2023-12-04T10:43:52.970184+0000","last_active":"2023-12-04T10:43:58.030753+0000","last_peered":"2023-12-04T10:43:58.030753+0000","last_clean":"2023-12-04T10:43:58.030753+0000","last_became_active":"2023-12-04T10:43:52.967857+0000","last_became_peered":"2023-12-04T10:43:52.967857+0000","last_unstale":"2023-12-04T10:43:58.030753+0000","last_undegraded":"2023-12-04T10:43:58.030753+0000","last_fullsized":"2023-12-04T10:43:58.030753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:17:13.264517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033298+0000","last_change":"2023-12-04T10:43:52.257154+0000","last_active":"2023-12-04T10:43:58.033298+0000","last_peered":"2023-12-04T10:43:58.033298+0000","last_clean":"2023-12-04T10:43:58.033298+0000","last_became_active":"2023-12-04T10:43:52.256821+0000","last_became_peered":"2023-12-04T10:43:52.256821+0000","last_unstale":"2023-12-04T10:43:58.033298+0000","last_undegraded":"2023-12-04T10:43:58.033298+0000","last_fullsized":"2023-12-04T10:43:58.033298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.707431+0000","last_change":"2023-12-04T10:43:58.063557+0000","last_active":"2023-12-04T10:43:58.707431+0000","last_peered":"2023-12-04T10:43:58.707431+0000","last_clean":"2023-12-04T10:43:58.707431+0000","last_became_active":"2023-12-04T10:43:58.062970+0000","last_became_peered":"2023-12-04T10:43:58.062970+0000","last_unstale":"2023-12-04T10:43:58.707431+0000","last_undegraded":"2023-12-04T10:43:58.707431+0000","last_fullsized":"2023-12-04T10:43:58.707431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:26.021604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021732+0000","last_change":"2023-12-04T10:43:52.984856+0000","last_active":"2023-12-04T10:43:58.021732+0000","last_peered":"2023-12-04T10:43:58.021732+0000","last_clean":"2023-12-04T10:43:58.021732+0000","last_became_active":"2023-12-04T10:43:52.983649+0000","last_became_peered":"2023-12-04T10:43:52.983649+0000","last_unstale":"2023-12-04T10:43:58.021732+0000","last_undegraded":"2023-12-04T10:43:58.021732+0000","last_fullsized":"2023-12-04T10:43:58.021732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022422+0000","last_change":"2023-12-04T10:43:52.251972+0000","last_active":"2023-12-04T10:43:58.022422+0000","last_peered":"2023-12-04T10:43:58.022422+0000","last_clean":"2023-12-04T10:43:58.022422+0000","last_became_active":"2023-12-04T10:43:52.251253+0000","last_became_peered":"2023-12-04T10:43:52.251253+0000","last_unstale":"2023-12-04T10:43:58.022422+0000","last_undegraded":"2023-12-04T10:43:58.022422+0000","last_fullsized":"2023-12-04T10:43:58.022422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:51.960369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048941+0000","last_change":"2023-12-04T10:43:52.260562+0000","last_active":"2023-12-04T10:43:58.048941+0000","last_peered":"2023-12-04T10:43:58.048941+0000","last_clean":"2023-12-04T10:43:58.048941+0000","last_became_active":"2023-12-04T10:43:52.260219+0000","last_became_peered":"2023-12-04T10:43:52.260219+0000","last_unstale":"2023-12-04T10:43:58.048941+0000","last_undegraded":"2023-12-04T10:43:58.048941+0000","last_fullsized":"2023-12-04T10:43:58.048941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:12:59.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041543+0000","last_change":"2023-12-04T10:43:52.987240+0000","last_active":"2023-12-04T10:43:58.041543+0000","last_peered":"2023-12-04T10:43:58.041543+0000","last_clean":"2023-12-04T10:43:58.041543+0000","last_became_active":"2023-12-04T10:43:52.986937+0000","last_became_peered":"2023-12-04T10:43:52.986937+0000","last_unstale":"2023-12-04T10:43:58.041543+0000","last_undegraded":"2023-12-04T10:43:58.041543+0000","last_fullsized":"2023-12-04T10:43:58.041543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.997827+0000","last_change":"2023-12-04T10:43:58.051595+0000","last_active":"2023-12-04T10:43:58.997827+0000","last_peered":"2023-12-04T10:43:58.997827+0000","last_clean":"2023-12-04T10:43:58.997827+0000","last_became_active":"2023-12-04T10:43:58.051043+0000","last_became_peered":"2023-12-04T10:43:58.051043+0000","last_unstale":"2023-12-04T10:43:58.997827+0000","last_undegraded":"2023-12-04T10:43:58.997827+0000","last_fullsized":"2023-12-04T10:43:58.997827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:16:05.070439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021505+0000","last_change":"2023-12-04T10:43:52.265562+0000","last_active":"2023-12-04T10:43:58.021505+0000","last_peered":"2023-12-04T10:43:58.021505+0000","last_clean":"2023-12-04T10:43:58.021505+0000","last_became_active":"2023-12-04T10:43:52.265254+0000","last_became_peered":"2023-12-04T10:43:52.265254+0000","last_unstale":"2023-12-04T10:43:58.021505+0000","last_undegraded":"2023-12-04T10:43:58.021505+0000","last_fullsized":"2023-12-04T10:43:58.021505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:09.555889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.035837+0000","last_change":"2023-12-04T10:43:52.980838+0000","last_active":"2023-12-04T10:43:58.035837+0000","last_peered":"2023-12-04T10:43:58.035837+0000","last_clean":"2023-12-04T10:43:58.035837+0000","last_became_active":"2023-12-04T10:43:52.980492+0000","last_became_peered":"2023-12-04T10:43:52.980492+0000","last_unstale":"2023-12-04T10:43:58.035837+0000","last_undegraded":"2023-12-04T10:43:58.035837+0000","last_fullsized":"2023-12-04T10:43:58.035837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:22.131473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703967+0000","last_change":"2023-12-04T10:43:58.049380+0000","last_active":"2023-12-04T10:43:58.703967+0000","last_peered":"2023-12-04T10:43:58.703967+0000","last_clean":"2023-12-04T10:43:58.703967+0000","last_became_active":"2023-12-04T10:43:58.048992+0000","last_became_peered":"2023-12-04T10:43:58.048992+0000","last_unstale":"2023-12-04T10:43:58.703967+0000","last_undegraded":"2023-12-04T10:43:58.703967+0000","last_fullsized":"2023-12-04T10:43:58.703967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:53:06.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048566+0000","last_change":"2023-12-04T10:43:52.980960+0000","last_active":"2023-12-04T10:43:58.048566+0000","last_peered":"2023-12-04T10:43:58.048566+0000","last_clean":"2023-12-04T10:43:58.048566+0000","last_became_active":"2023-12-04T10:43:52.980414+0000","last_became_peered":"2023-12-04T10:43:52.980414+0000","last_unstale":"2023-12-04T10:43:58.048566+0000","last_undegraded":"2023-12-04T10:43:58.048566+0000","last_fullsized":"2023-12-04T10:43:58.048566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:26.269589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.044326+0000","last_change":"2023-12-04T10:43:52.991417+0000","last_active":"2023-12-04T10:43:58.044326+0000","last_peered":"2023-12-04T10:43:58.044326+0000","last_clean":"2023-12-04T10:43:58.044326+0000","last_became_active":"2023-12-04T10:43:52.991128+0000","last_became_peered":"2023-12-04T10:43:52.991128+0000","last_unstale":"2023-12-04T10:43:58.044326+0000","last_undegraded":"2023-12-04T10:43:58.044326+0000","last_fullsized":"2023-12-04T10:43:58.044326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:48.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034634+0000","last_change":"2023-12-04T10:43:52.979726+0000","last_active":"2023-12-04T10:43:58.034634+0000","last_peered":"2023-12-04T10:43:58.034634+0000","last_clean":"2023-12-04T10:43:58.034634+0000","last_became_active":"2023-12-04T10:43:52.979418+0000","last_became_peered":"2023-12-04T10:43:52.979418+0000","last_unstale":"2023-12-04T10:43:58.034634+0000","last_undegraded":"2023-12-04T10:43:58.034634+0000","last_fullsized":"2023-12-04T10:43:58.034634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:35:03.536961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037625+0000","last_change":"2023-12-04T10:43:52.983306+0000","last_active":"2023-12-04T10:43:58.037625+0000","last_peered":"2023-12-04T10:43:58.037625+0000","last_clean":"2023-12-04T10:43:58.037625+0000","last_became_active":"2023-12-04T10:43:52.982993+0000","last_became_peered":"2023-12-04T10:43:52.982993+0000","last_unstale":"2023-12-04T10:43:58.037625+0000","last_undegraded":"2023-12-04T10:43:58.037625+0000","last_fullsized":"2023-12-04T10:43:58.037625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:26.269589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021434+0000","last_change":"2023-12-04T10:43:52.977063+0000","last_active":"2023-12-04T10:43:58.021434+0000","last_peered":"2023-12-04T10:43:58.021434+0000","last_clean":"2023-12-04T10:43:58.021434+0000","last_became_active":"2023-12-04T10:43:52.975971+0000","last_became_peered":"2023-12-04T10:43:52.975971+0000","last_unstale":"2023-12-04T10:43:58.021434+0000","last_undegraded":"2023-12-04T10:43:58.021434+0000","last_fullsized":"2023-12-04T10:43:58.021434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.029916+0000","last_change":"2023-12-04T10:43:52.982380+0000","last_active":"2023-12-04T10:43:58.029916+0000","last_peered":"2023-12-04T10:43:58.029916+0000","last_clean":"2023-12-04T10:43:58.029916+0000","last_became_active":"2023-12-04T10:43:52.981200+0000","last_became_peered":"2023-12-04T10:43:52.981200+0000","last_unstale":"2023-12-04T10:43:58.029916+0000","last_undegraded":"2023-12-04T10:43:58.029916+0000","last_fullsized":"2023-12-04T10:43:58.029916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:35:52.376732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.050824+0000","last_change":"2023-12-04T10:43:52.987443+0000","last_active":"2023-12-04T10:43:58.050824+0000","last_peered":"2023-12-04T10:43:58.050824+0000","last_clean":"2023-12-04T10:43:58.050824+0000","last_became_active":"2023-12-04T10:43:52.987177+0000","last_became_peered":"2023-12-04T10:43:52.987177+0000","last_unstale":"2023-12-04T10:43:58.050824+0000","last_undegraded":"2023-12-04T10:43:58.050824+0000","last_fullsized":"2023-12-04T10:43:58.050824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.023146+0000","last_change":"2023-12-04T10:43:52.986477+0000","last_active":"2023-12-04T10:43:58.023146+0000","last_peered":"2023-12-04T10:43:58.023146+0000","last_clean":"2023-12-04T10:43:58.023146+0000","last_became_active":"2023-12-04T10:43:52.986072+0000","last_became_peered":"2023-12-04T10:43:52.986072+0000","last_unstale":"2023-12-04T10:43:58.023146+0000","last_undegraded":"2023-12-04T10:43:58.023146+0000","last_fullsized":"2023-12-04T10:43:58.023146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033092+0000","last_change":"2023-12-04T10:43:52.993638+0000","last_active":"2023-12-04T10:43:58.033092+0000","last_peered":"2023-12-04T10:43:58.033092+0000","last_clean":"2023-12-04T10:43:58.033092+0000","last_became_active":"2023-12-04T10:43:52.993364+0000","last_became_peered":"2023-12-04T10:43:52.993364+0000","last_unstale":"2023-12-04T10:43:58.033092+0000","last_undegraded":"2023-12-04T10:43:58.033092+0000","last_fullsized":"2023-12-04T10:43:58.033092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022326+0000","last_change":"2023-12-04T10:43:52.986640+0000","last_active":"2023-12-04T10:43:58.022326+0000","last_peered":"2023-12-04T10:43:58.022326+0000","last_clean":"2023-12-04T10:43:58.022326+0000","last_became_active":"2023-12-04T10:43:52.983310+0000","last_became_peered":"2023-12-04T10:43:52.983310+0000","last_unstale":"2023-12-04T10:43:58.022326+0000","last_undegraded":"2023-12-04T10:43:58.022326+0000","last_fullsized":"2023-12-04T10:43:58.022326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034400+0000","last_change":"2023-12-04T10:43:52.982396+0000","last_active":"2023-12-04T10:43:58.034400+0000","last_peered":"2023-12-04T10:43:58.034400+0000","last_clean":"2023-12-04T10:43:58.034400+0000","last_became_active":"2023-12-04T10:43:52.980007+0000","last_became_peered":"2023-12-04T10:43:52.980007+0000","last_unstale":"2023-12-04T10:43:58.034400+0000","last_undegraded":"2023-12-04T10:43:58.034400+0000","last_fullsized":"2023-12-04T10:43:58.034400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037514+0000","last_change":"2023-12-04T10:43:52.979531+0000","last_active":"2023-12-04T10:43:58.037514+0000","last_peered":"2023-12-04T10:43:58.037514+0000","last_clean":"2023-12-04T10:43:58.037514+0000","last_became_active":"2023-12-04T10:43:52.979210+0000","last_became_peered":"2023-12-04T10:43:52.979210+0000","last_unstale":"2023-12-04T10:43:58.037514+0000","last_undegraded":"2023-12-04T10:43:58.037514+0000","last_fullsized":"2023-12-04T10:43:58.037514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:14:33.669944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048898+0000","last_change":"2023-12-04T10:43:52.986872+0000","last_active":"2023-12-04T10:43:58.048898+0000","last_peered":"2023-12-04T10:43:58.048898+0000","last_clean":"2023-12-04T10:43:58.048898+0000","last_became_active":"2023-12-04T10:43:52.981778+0000","last_became_peered":"2023-12-04T10:43:52.981778+0000","last_unstale":"2023-12-04T10:43:58.048898+0000","last_undegraded":"2023-12-04T10:43:58.048898+0000","last_fullsized":"2023-12-04T10:43:58.048898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219648+0000","last_change":"2023-12-04T10:43:52.985981+0000","last_active":"2023-12-04T10:43:58.219648+0000","last_peered":"2023-12-04T10:43:58.219648+0000","last_clean":"2023-12-04T10:43:58.219648+0000","last_became_active":"2023-12-04T10:43:52.982061+0000","last_became_peered":"2023-12-04T10:43:52.982061+0000","last_unstale":"2023-12-04T10:43:58.219648+0000","last_undegraded":"2023-12-04T10:43:58.219648+0000","last_fullsized":"2023-12-04T10:43:58.219648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:40.024910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.046541+0000","last_change":"2023-12-04T10:43:52.973616+0000","last_active":"2023-12-04T10:43:58.046541+0000","last_peered":"2023-12-04T10:43:58.046541+0000","last_clean":"2023-12-04T10:43:58.046541+0000","last_became_active":"2023-12-04T10:43:52.973295+0000","last_became_peered":"2023-12-04T10:43:52.973295+0000","last_unstale":"2023-12-04T10:43:58.046541+0000","last_undegraded":"2023-12-04T10:43:58.046541+0000","last_fullsized":"2023-12-04T10:43:58.046541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:57:45.678858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041620+0000","last_change":"2023-12-04T10:43:52.988142+0000","last_active":"2023-12-04T10:43:58.041620+0000","last_peered":"2023-12-04T10:43:58.041620+0000","last_clean":"2023-12-04T10:43:58.041620+0000","last_became_active":"2023-12-04T10:43:52.979726+0000","last_became_peered":"2023-12-04T10:43:52.979726+0000","last_unstale":"2023-12-04T10:43:58.041620+0000","last_undegraded":"2023-12-04T10:43:58.041620+0000","last_fullsized":"2023-12-04T10:43:58.041620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:54.689876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.032829+0000","last_change":"2023-12-04T10:43:52.979067+0000","last_active":"2023-12-04T10:43:58.032829+0000","last_peered":"2023-12-04T10:43:58.032829+0000","last_clean":"2023-12-04T10:43:58.032829+0000","last_became_active":"2023-12-04T10:43:52.978720+0000","last_became_peered":"2023-12-04T10:43:52.978720+0000","last_unstale":"2023-12-04T10:43:58.032829+0000","last_undegraded":"2023-12-04T10:43:58.032829+0000","last_fullsized":"2023-12-04T10:43:58.032829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030859+0000","last_change":"2023-12-04T10:43:52.976129+0000","last_active":"2023-12-04T10:43:58.030859+0000","last_peered":"2023-12-04T10:43:58.030859+0000","last_clean":"2023-12-04T10:43:58.030859+0000","last_became_active":"2023-12-04T10:43:52.975844+0000","last_became_peered":"2023-12-04T10:43:52.975844+0000","last_unstale":"2023-12-04T10:43:58.030859+0000","last_undegraded":"2023-12-04T10:43:58.030859+0000","last_fullsized":"2023-12-04T10:43:58.030859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:37:49.291916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033802+0000","last_change":"2023-12-04T10:43:52.984631+0000","last_active":"2023-12-04T10:43:58.033802+0000","last_peered":"2023-12-04T10:43:58.033802+0000","last_clean":"2023-12-04T10:43:58.033802+0000","last_became_active":"2023-12-04T10:43:52.984276+0000","last_became_peered":"2023-12-04T10:43:52.984276+0000","last_unstale":"2023-12-04T10:43:58.033802+0000","last_undegraded":"2023-12-04T10:43:58.033802+0000","last_fullsized":"2023-12-04T10:43:58.033802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:53:19.937888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020905+0000","last_change":"2023-12-04T10:43:52.978860+0000","last_active":"2023-12-04T10:43:58.020905+0000","last_peered":"2023-12-04T10:43:58.020905+0000","last_clean":"2023-12-04T10:43:58.020905+0000","last_became_active":"2023-12-04T10:43:52.978564+0000","last_became_peered":"2023-12-04T10:43:52.978564+0000","last_unstale":"2023-12-04T10:43:58.020905+0000","last_undegraded":"2023-12-04T10:43:58.020905+0000","last_fullsized":"2023-12-04T10:43:58.020905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.038398+0000","last_change":"2023-12-04T10:43:52.973000+0000","last_active":"2023-12-04T10:43:58.038398+0000","last_peered":"2023-12-04T10:43:58.038398+0000","last_clean":"2023-12-04T10:43:58.038398+0000","last_became_active":"2023-12-04T10:43:52.972621+0000","last_became_peered":"2023-12-04T10:43:52.972621+0000","last_unstale":"2023-12-04T10:43:58.038398+0000","last_undegraded":"2023-12-04T10:43:58.038398+0000","last_fullsized":"2023-12-04T10:43:58.038398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:57:45.678858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049439+0000","last_change":"2023-12-04T10:43:52.982066+0000","last_active":"2023-12-04T10:43:58.049439+0000","last_peered":"2023-12-04T10:43:58.049439+0000","last_clean":"2023-12-04T10:43:58.049439+0000","last_became_active":"2023-12-04T10:43:52.981727+0000","last_became_peered":"2023-12-04T10:43:52.981727+0000","last_unstale":"2023-12-04T10:43:58.049439+0000","last_undegraded":"2023-12-04T10:43:58.049439+0000","last_fullsized":"2023-12-04T10:43:58.049439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.050796+0000","last_change":"2023-12-04T10:43:52.983361+0000","last_active":"2023-12-04T10:43:58.050796+0000","last_peered":"2023-12-04T10:43:58.050796+0000","last_clean":"2023-12-04T10:43:58.050796+0000","last_became_active":"2023-12-04T10:43:52.983081+0000","last_became_peered":"2023-12-04T10:43:52.983081+0000","last_unstale":"2023-12-04T10:43:58.050796+0000","last_undegraded":"2023-12-04T10:43:58.050796+0000","last_fullsized":"2023-12-04T10:43:58.050796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.221587+0000","last_change":"2023-12-04T10:43:52.994001+0000","last_active":"2023-12-04T10:43:58.221587+0000","last_peered":"2023-12-04T10:43:58.221587+0000","last_clean":"2023-12-04T10:43:58.221587+0000","last_became_active":"2023-12-04T10:43:52.993633+0000","last_became_peered":"2023-12-04T10:43:52.993633+0000","last_unstale":"2023-12-04T10:43:58.221587+0000","last_undegraded":"2023-12-04T10:43:58.221587+0000","last_fullsized":"2023-12-04T10:43:58.221587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:50:20.802003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020739+0000","last_change":"2023-12-04T10:43:52.988344+0000","last_active":"2023-12-04T10:43:58.020739+0000","last_peered":"2023-12-04T10:43:58.020739+0000","last_clean":"2023-12-04T10:43:58.020739+0000","last_became_active":"2023-12-04T10:43:52.988051+0000","last_became_peered":"2023-12-04T10:43:52.988051+0000","last_unstale":"2023-12-04T10:43:58.020739+0000","last_undegraded":"2023-12-04T10:43:58.020739+0000","last_fullsized":"2023-12-04T10:43:58.020739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.213667+0000","last_change":"2023-12-04T10:43:52.977848+0000","last_active":"2023-12-04T10:43:58.213667+0000","last_peered":"2023-12-04T10:43:58.213667+0000","last_clean":"2023-12-04T10:43:58.213667+0000","last_became_active":"2023-12-04T10:43:52.977443+0000","last_became_peered":"2023-12-04T10:43:52.977443+0000","last_unstale":"2023-12-04T10:43:58.213667+0000","last_undegraded":"2023-12-04T10:43:58.213667+0000","last_fullsized":"2023-12-04T10:43:58.213667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034180+0000","last_change":"2023-12-04T10:43:52.978013+0000","last_active":"2023-12-04T10:43:58.034180+0000","last_peered":"2023-12-04T10:43:58.034180+0000","last_clean":"2023-12-04T10:43:58.034180+0000","last_became_active":"2023-12-04T10:43:52.976233+0000","last_became_peered":"2023-12-04T10:43:52.976233+0000","last_unstale":"2023-12-04T10:43:58.034180+0000","last_undegraded":"2023-12-04T10:43:58.034180+0000","last_fullsized":"2023-12-04T10:43:58.034180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216255+0000","last_change":"2023-12-04T10:43:52.987505+0000","last_active":"2023-12-04T10:43:58.216255+0000","last_peered":"2023-12-04T10:43:58.216255+0000","last_clean":"2023-12-04T10:43:58.216255+0000","last_became_active":"2023-12-04T10:43:52.982436+0000","last_became_peered":"2023-12-04T10:43:52.982436+0000","last_unstale":"2023-12-04T10:43:58.216255+0000","last_undegraded":"2023-12-04T10:43:58.216255+0000","last_fullsized":"2023-12-04T10:43:58.216255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040439+0000","last_change":"2023-12-04T10:43:52.988667+0000","last_active":"2023-12-04T10:43:58.040439+0000","last_peered":"2023-12-04T10:43:58.040439+0000","last_clean":"2023-12-04T10:43:58.040439+0000","last_became_active":"2023-12-04T10:43:52.988296+0000","last_became_peered":"2023-12-04T10:43:52.988296+0000","last_unstale":"2023-12-04T10:43:58.040439+0000","last_undegraded":"2023-12-04T10:43:58.040439+0000","last_fullsized":"2023-12-04T10:43:58.040439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037780+0000","last_change":"2023-12-04T10:43:52.983801+0000","last_active":"2023-12-04T10:43:58.037780+0000","last_peered":"2023-12-04T10:43:58.037780+0000","last_clean":"2023-12-04T10:43:58.037780+0000","last_became_active":"2023-12-04T10:43:52.981238+0000","last_became_peered":"2023-12-04T10:43:52.981238+0000","last_unstale":"2023-12-04T10:43:58.037780+0000","last_undegraded":"2023-12-04T10:43:58.037780+0000","last_fullsized":"2023-12-04T10:43:58.037780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030806+0000","last_change":"2023-12-04T10:43:52.978663+0000","last_active":"2023-12-04T10:43:58.030806+0000","last_peered":"2023-12-04T10:43:58.030806+0000","last_clean":"2023-12-04T10:43:58.030806+0000","last_became_active":"2023-12-04T10:43:52.978251+0000","last_became_peered":"2023-12-04T10:43:52.978251+0000","last_unstale":"2023-12-04T10:43:58.030806+0000","last_undegraded":"2023-12-04T10:43:58.030806+0000","last_fullsized":"2023-12-04T10:43:58.030806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:17:51.617229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.220292+0000","last_change":"2023-12-04T10:43:52.985634+0000","last_active":"2023-12-04T10:43:58.220292+0000","last_peered":"2023-12-04T10:43:58.220292+0000","last_clean":"2023-12-04T10:43:58.220292+0000","last_became_active":"2023-12-04T10:43:52.981676+0000","last_became_peered":"2023-12-04T10:43:52.981676+0000","last_unstale":"2023-12-04T10:43:58.220292+0000","last_undegraded":"2023-12-04T10:43:58.220292+0000","last_fullsized":"2023-12-04T10:43:58.220292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:32:44.930072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":702921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.722}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":112061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.97}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.901}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":702977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":112097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":111971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5649999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.681}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T10:44:23.533 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T10:44:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.796+0000 7f42c168a640 1 Processor -- start 2023-12-04T10:44:23.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.796+0000 7f42c168a640 1 -- start start 2023-12-04T10:44:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.798+0000 7f42c168a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.798+0000 7f42c168a640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42bc15b470 0x7f42bc0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.798+0000 7f42c168a640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42bc0cc7f0 con 0x7f42bc06e0b0 2023-12-04T10:44:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.798+0000 7f42c168a640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42bc0cca40 con 0x7f42bc15b470 2023-12-04T10:44:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.798+0000 7f42c168a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0ccd20 con 0x7f42bc151ca0 2023-12-04T10:44:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.798+0000 7f42b3fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42bc15b470 0x7f42bc0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.798+0000 7f42b3fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f42bc15b470 0x7f42bc0cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38910/0 (socket says 172.21.15.63:38910) 2023-12-04T10:44:23.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.798+0000 7f42b3fff640 1 -- 172.21.15.63:0/2048586508 learned_addr learned my addr 172.21.15.63:0/2048586508 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.799+0000 7f42bbfff640 1 --2- 172.21.15.63:0/2048586508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.799+0000 7f42b3fff640 1 -- 172.21.15.63:0/2048586508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 msgr2=0x7f42bc06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.799+0000 7f42b3fff640 1 --2- 172.21.15.63:0/2048586508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.799+0000 7f42b3fff640 1 -- 172.21.15.63:0/2048586508 >> v1:172.21.15.66:6789/0 conn(0x7f42bc06e0b0 legacy=0x7f42bc071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.799+0000 7f42b3fff640 1 -- 172.21.15.63:0/2048586508 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc0cd000 con 0x7f42bc15b470 2023-12-04T10:44:23.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.799+0000 7f42bbfff640 1 --2- 172.21.15.63:0/2048586508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.800+0000 7f42b3fff640 1 --2- 172.21.15.63:0/2048586508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc15b470 0x7f42bc0cb570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009870 tx=0x7f42a402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159f71ead76286c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.800+0000 7f42bb7fe640 1 -- 172.21.15.63:0/2048586508 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a40317c0 con 0x7f42bc15b470 2023-12-04T10:44:23.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42bb7fe640 1 -- 172.21.15.63:0/2048586508 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42a4031920 con 0x7f42bc15b470 2023-12-04T10:44:23.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42bb7fe640 1 -- 172.21.15.63:0/2048586508 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42a4031cb0 con 0x7f42bc15b470 2023-12-04T10:44:23.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42c168a640 1 -- 172.21.15.63:0/2048586508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc15b470 msgr2=0x7f42bc0cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42c168a640 1 --2- 172.21.15.63:0/2048586508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc15b470 0x7f42bc0cb570 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f42a4009870 tx=0x7f42a402b860 comp rx=0 tx=0).stop 2023-12-04T10:44:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42c168a640 1 -- 172.21.15.63:0/2048586508 shutdown_connections 2023-12-04T10:44:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42c168a640 1 --2- 172.21.15.63:0/2048586508 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc15b470 0x7f42bc0cb570 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42c168a640 1 --2- 172.21.15.63:0/2048586508 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42c168a640 1 -- 172.21.15.63:0/2048586508 >> 172.21.15.63:0/2048586508 conn(0x7f42bc0b07f0 msgr2=0x7f42bc0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42c168a640 1 -- 172.21.15.63:0/2048586508 shutdown_connections 2023-12-04T10:44:23.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.801+0000 7f42c168a640 1 -- 172.21.15.63:0/2048586508 wait complete. 2023-12-04T10:44:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.803+0000 7f42c168a640 1 Processor -- start 2023-12-04T10:44:23.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.803+0000 7f42c168a640 1 -- start start 2023-12-04T10:44:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.804+0000 7f42c168a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc06e0b0 0x7f42bc0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.804+0000 7f42c168a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc0b29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.804+0000 7f42c168a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42bc1583a0 0x7f42bc158850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42c168a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc1f3e60 con 0x7f42bc06e0b0 2023-12-04T10:44:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42c168a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc0c8b40 con 0x7f42bc1583a0 2023-12-04T10:44:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42c168a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc1f3250 con 0x7f42bc151ca0 2023-12-04T10:44:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42bbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc06e0b0 0x7f42bc0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42bbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc06e0b0 0x7f42bc0c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38912/0 (socket says 172.21.15.63:38912) 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42bbfff640 1 -- 172.21.15.63:0/4013004816 learned_addr learned my addr 172.21.15.63:0/4013004816 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42c0e89640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42bc1583a0 0x7f42bc158850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42b3fff640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc0b29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42bbfff640 1 -- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 msgr2=0x7f42bc0b29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42bbfff640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc0b29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42bbfff640 1 -- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42bc1583a0 msgr2=0x7f42bc158850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42bbfff640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42bc1583a0 0x7f42bc158850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42bbfff640 1 -- 172.21.15.63:0/4013004816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42a40094d0 con 0x7f42bc06e0b0 2023-12-04T10:44:23.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.805+0000 7f42c0e89640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42bc1583a0 0x7f42bc158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:23.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.806+0000 7f42bbfff640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc06e0b0 0x7f42bc0c8600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c7f0 tx=0x7f42ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:23.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.806+0000 7f42b97fa640 1 -- 172.21.15.63:0/4013004816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac007a30 con 0x7f42bc06e0b0 2023-12-04T10:44:23.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.806+0000 7f42b97fa640 1 -- 172.21.15.63:0/4013004816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42ac007b90 con 0x7f42bc06e0b0 2023-12-04T10:44:23.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.806+0000 7f42b97fa640 1 -- 172.21.15.63:0/4013004816 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42ac00ce40 con 0x7f42bc06e0b0 2023-12-04T10:44:23.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.806+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42bc1f3530 con 0x7f42bc06e0b0 2023-12-04T10:44:23.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.806+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42bc1f3af0 con 0x7f42bc06e0b0 2023-12-04T10:44:23.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.807+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42bc071fe0 con 0x7f42bc06e0b0 2023-12-04T10:44:23.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.808+0000 7f42b97fa640 1 -- 172.21.15.63:0/4013004816 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42ac0113f0 con 0x7f42bc06e0b0 2023-12-04T10:44:23.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.809+0000 7f42b97fa640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f429c06ae70 0x7f429c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:23.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.809+0000 7f42b97fa640 1 -- 172.21.15.63:0/4013004816 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42ac089a50 con 0x7f42bc06e0b0 2023-12-04T10:44:23.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.809+0000 7f42b3fff640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f429c06ae70 0x7f429c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:23.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.810+0000 7f42b3fff640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f429c06ae70 0x7f429c06d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42a4036000 tx=0x7f42a403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:23.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:23.814+0000 7f42b97fa640 1 -- 172.21.15.63:0/4013004816 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42ac054810 con 0x7f42bc06e0b0 2023-12-04T10:44:24.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.007+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 --> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42bc152080 con 0x7f429c06ae70 2023-12-04T10:44:24.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.018+0000 7f42b97fa640 1 -- 172.21.15.63:0/4013004816 <== mgr.4107 v2:172.21.15.63:6832/2779630096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345070 (secure 0 0 0) 0x7f42a4031b90 con 0x7f429c06ae70 2023-12-04T10:44:24.022 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:24.027 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f429c06ae70 msgr2=0x7f429c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f429c06ae70 0x7f429c06d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f42a4036000 tx=0x7f42a403d040 comp rx=0 tx=0).stop 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc06e0b0 msgr2=0x7f42bc0c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc06e0b0 0x7f42bc0c8600 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f42ac00c7f0 tx=0x7f42ac00cbf0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 shutdown_connections 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f429c06ae70 0x7f429c06d330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42bc151ca0 0x7f42bc0b29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42bc1583a0 0x7f42bc158850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 --2- 172.21.15.63:0/4013004816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42bc06e0b0 0x7f42bc0c8600 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 >> 172.21.15.63:0/4013004816 conn(0x7f42bc0b07f0 msgr2=0x7f42bc151290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:24.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 shutdown_connections 2023-12-04T10:44:24.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.026+0000 7f42c168a640 1 -- 172.21.15.63:0/4013004816 wait complete. 2023-12-04T10:44:24.047 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2023-12-04T10:44:23.974421+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219596,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755124,"statfs":{"total":773094113280,"available":772869246976,"internally_reserved":0,"allocated":3514368,"data_stored":2085782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005609"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039141+0000","last_change":"2023-12-04T10:43:52.262642+0000","last_active":"2023-12-04T10:43:58.039141+0000","last_peered":"2023-12-04T10:43:58.039141+0000","last_clean":"2023-12-04T10:43:58.039141+0000","last_became_active":"2023-12-04T10:43:52.262376+0000","last_became_peered":"2023-12-04T10:43:52.262376+0000","last_unstale":"2023-12-04T10:43:58.039141+0000","last_undegraded":"2023-12-04T10:43:58.039141+0000","last_fullsized":"2023-12-04T10:43:58.039141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022140+0000","last_change":"2023-12-04T10:43:52.985649+0000","last_active":"2023-12-04T10:43:58.022140+0000","last_peered":"2023-12-04T10:43:58.022140+0000","last_clean":"2023-12-04T10:43:58.022140+0000","last_became_active":"2023-12-04T10:43:52.980842+0000","last_became_peered":"2023-12-04T10:43:52.980842+0000","last_unstale":"2023-12-04T10:43:58.022140+0000","last_undegraded":"2023-12-04T10:43:58.022140+0000","last_fullsized":"2023-12-04T10:43:58.022140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:35:03.536961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702614+0000","last_change":"2023-12-04T10:43:58.234310+0000","last_active":"2023-12-04T10:43:58.702614+0000","last_peered":"2023-12-04T10:43:58.702614+0000","last_clean":"2023-12-04T10:43:58.702614+0000","last_became_active":"2023-12-04T10:43:58.233037+0000","last_became_peered":"2023-12-04T10:43:58.233037+0000","last_unstale":"2023-12-04T10:43:58.702614+0000","last_undegraded":"2023-12-04T10:43:58.702614+0000","last_fullsized":"2023-12-04T10:43:58.702614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:45:11.650821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022299+0000","last_change":"2023-12-04T10:43:52.244397+0000","last_active":"2023-12-04T10:43:58.022299+0000","last_peered":"2023-12-04T10:43:58.022299+0000","last_clean":"2023-12-04T10:43:58.022299+0000","last_became_active":"2023-12-04T10:43:52.244095+0000","last_became_peered":"2023-12-04T10:43:52.244095+0000","last_unstale":"2023-12-04T10:43:58.022299+0000","last_undegraded":"2023-12-04T10:43:58.022299+0000","last_fullsized":"2023-12-04T10:43:58.022299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:12:59.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037025+0000","last_change":"2023-12-04T10:43:52.991593+0000","last_active":"2023-12-04T10:43:58.037025+0000","last_peered":"2023-12-04T10:43:58.037025+0000","last_clean":"2023-12-04T10:43:58.037025+0000","last_became_active":"2023-12-04T10:43:52.991219+0000","last_became_peered":"2023-12-04T10:43:52.991219+0000","last_unstale":"2023-12-04T10:43:58.037025+0000","last_undegraded":"2023-12-04T10:43:58.037025+0000","last_fullsized":"2023-12-04T10:43:58.037025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704700+0000","last_change":"2023-12-04T10:43:58.054950+0000","last_active":"2023-12-04T10:43:58.704700+0000","last_peered":"2023-12-04T10:43:58.704700+0000","last_clean":"2023-12-04T10:43:58.704700+0000","last_became_active":"2023-12-04T10:43:58.054476+0000","last_became_peered":"2023-12-04T10:43:58.054476+0000","last_unstale":"2023-12-04T10:43:58.704700+0000","last_undegraded":"2023-12-04T10:43:58.704700+0000","last_fullsized":"2023-12-04T10:43:58.704700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:12.751001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219571+0000","last_change":"2023-12-04T10:43:52.267072+0000","last_active":"2023-12-04T10:43:58.219571+0000","last_peered":"2023-12-04T10:43:58.219571+0000","last_clean":"2023-12-04T10:43:58.219571+0000","last_became_active":"2023-12-04T10:43:52.266736+0000","last_became_peered":"2023-12-04T10:43:52.266736+0000","last_unstale":"2023-12-04T10:43:58.219571+0000","last_undegraded":"2023-12-04T10:43:58.219571+0000","last_fullsized":"2023-12-04T10:43:58.219571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:24.986256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040614+0000","last_change":"2023-12-04T10:43:52.973354+0000","last_active":"2023-12-04T10:43:58.040614+0000","last_peered":"2023-12-04T10:43:58.040614+0000","last_clean":"2023-12-04T10:43:58.040614+0000","last_became_active":"2023-12-04T10:43:52.973024+0000","last_became_peered":"2023-12-04T10:43:52.973024+0000","last_unstale":"2023-12-04T10:43:58.040614+0000","last_undegraded":"2023-12-04T10:43:58.040614+0000","last_fullsized":"2023-12-04T10:43:58.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703606+0000","last_change":"2023-12-04T10:43:58.052885+0000","last_active":"2023-12-04T10:43:58.703606+0000","last_peered":"2023-12-04T10:43:58.703606+0000","last_clean":"2023-12-04T10:43:58.703606+0000","last_became_active":"2023-12-04T10:43:58.052363+0000","last_became_peered":"2023-12-04T10:43:58.052363+0000","last_unstale":"2023-12-04T10:43:58.703606+0000","last_undegraded":"2023-12-04T10:43:58.703606+0000","last_fullsized":"2023-12-04T10:43:58.703606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:46.891581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.215836+0000","last_change":"2023-12-04T10:43:52.270824+0000","last_active":"2023-12-04T10:43:58.215836+0000","last_peered":"2023-12-04T10:43:58.215836+0000","last_clean":"2023-12-04T10:43:58.215836+0000","last_became_active":"2023-12-04T10:43:52.270451+0000","last_became_peered":"2023-12-04T10:43:52.270451+0000","last_unstale":"2023-12-04T10:43:58.215836+0000","last_undegraded":"2023-12-04T10:43:58.215836+0000","last_fullsized":"2023-12-04T10:43:58.215836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:09.555889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040349+0000","last_change":"2023-12-04T10:43:52.975366+0000","last_active":"2023-12-04T10:43:58.040349+0000","last_peered":"2023-12-04T10:43:58.040349+0000","last_clean":"2023-12-04T10:43:58.040349+0000","last_became_active":"2023-12-04T10:43:52.975083+0000","last_became_peered":"2023-12-04T10:43:52.975083+0000","last_unstale":"2023-12-04T10:43:58.040349+0000","last_undegraded":"2023-12-04T10:43:58.040349+0000","last_fullsized":"2023-12-04T10:43:58.040349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:46.964865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703374+0000","last_change":"2023-12-04T10:43:58.056032+0000","last_active":"2023-12-04T10:43:58.703374+0000","last_peered":"2023-12-04T10:43:58.703374+0000","last_clean":"2023-12-04T10:43:58.703374+0000","last_became_active":"2023-12-04T10:43:58.055534+0000","last_became_peered":"2023-12-04T10:43:58.055534+0000","last_unstale":"2023-12-04T10:43:58.703374+0000","last_undegraded":"2023-12-04T10:43:58.703374+0000","last_fullsized":"2023-12-04T10:43:58.703374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:17:56.402589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048799+0000","last_change":"2023-12-04T10:43:52.985238+0000","last_active":"2023-12-04T10:43:58.048799+0000","last_peered":"2023-12-04T10:43:58.048799+0000","last_clean":"2023-12-04T10:43:58.048799+0000","last_became_active":"2023-12-04T10:43:52.984911+0000","last_became_peered":"2023-12-04T10:43:52.984911+0000","last_unstale":"2023-12-04T10:43:58.048799+0000","last_undegraded":"2023-12-04T10:43:58.048799+0000","last_fullsized":"2023-12-04T10:43:58.048799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216522+0000","last_change":"2023-12-04T10:43:52.269729+0000","last_active":"2023-12-04T10:43:58.216522+0000","last_peered":"2023-12-04T10:43:58.216522+0000","last_clean":"2023-12-04T10:43:58.216522+0000","last_became_active":"2023-12-04T10:43:52.268943+0000","last_became_peered":"2023-12-04T10:43:52.268943+0000","last_unstale":"2023-12-04T10:43:58.216522+0000","last_undegraded":"2023-12-04T10:43:58.216522+0000","last_fullsized":"2023-12-04T10:43:58.216522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:47.791989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.705778+0000","last_change":"2023-12-04T10:43:58.054574+0000","last_active":"2023-12-04T10:43:58.705778+0000","last_peered":"2023-12-04T10:43:58.705778+0000","last_clean":"2023-12-04T10:43:58.705778+0000","last_became_active":"2023-12-04T10:43:58.052778+0000","last_became_peered":"2023-12-04T10:43:58.052778+0000","last_unstale":"2023-12-04T10:43:58.705778+0000","last_undegraded":"2023-12-04T10:43:58.705778+0000","last_fullsized":"2023-12-04T10:43:58.705778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:14:13.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021096+0000","last_change":"2023-12-04T10:43:52.980176+0000","last_active":"2023-12-04T10:43:58.021096+0000","last_peered":"2023-12-04T10:43:58.021096+0000","last_clean":"2023-12-04T10:43:58.021096+0000","last_became_active":"2023-12-04T10:43:52.979878+0000","last_became_peered":"2023-12-04T10:43:52.979878+0000","last_unstale":"2023-12-04T10:43:58.021096+0000","last_undegraded":"2023-12-04T10:43:58.021096+0000","last_fullsized":"2023-12-04T10:43:58.021096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.031512+0000","last_change":"2023-12-04T10:43:52.251368+0000","last_active":"2023-12-04T10:43:58.031512+0000","last_peered":"2023-12-04T10:43:58.031512+0000","last_clean":"2023-12-04T10:43:58.031512+0000","last_became_active":"2023-12-04T10:43:52.248421+0000","last_became_peered":"2023-12-04T10:43:52.248421+0000","last_unstale":"2023-12-04T10:43:58.031512+0000","last_undegraded":"2023-12-04T10:43:58.031512+0000","last_fullsized":"2023-12-04T10:43:58.031512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:01:30.452121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704063+0000","last_change":"2023-12-04T10:43:58.050763+0000","last_active":"2023-12-04T10:43:58.704063+0000","last_peered":"2023-12-04T10:43:58.704063+0000","last_clean":"2023-12-04T10:43:58.704063+0000","last_became_active":"2023-12-04T10:43:58.050229+0000","last_became_peered":"2023-12-04T10:43:58.050229+0000","last_unstale":"2023-12-04T10:43:58.704063+0000","last_undegraded":"2023-12-04T10:43:58.704063+0000","last_fullsized":"2023-12-04T10:43:58.704063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:49:06.824707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021858+0000","last_change":"2023-12-04T10:43:52.980604+0000","last_active":"2023-12-04T10:43:58.021858+0000","last_peered":"2023-12-04T10:43:58.021858+0000","last_clean":"2023-12-04T10:43:58.021858+0000","last_became_active":"2023-12-04T10:43:52.980217+0000","last_became_peered":"2023-12-04T10:43:52.980217+0000","last_unstale":"2023-12-04T10:43:58.021858+0000","last_undegraded":"2023-12-04T10:43:58.021858+0000","last_fullsized":"2023-12-04T10:43:58.021858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030984+0000","last_change":"2023-12-04T10:43:52.261622+0000","last_active":"2023-12-04T10:43:58.030984+0000","last_peered":"2023-12-04T10:43:58.030984+0000","last_clean":"2023-12-04T10:43:58.030984+0000","last_became_active":"2023-12-04T10:43:52.261298+0000","last_became_peered":"2023-12-04T10:43:52.261298+0000","last_unstale":"2023-12-04T10:43:58.030984+0000","last_undegraded":"2023-12-04T10:43:58.030984+0000","last_fullsized":"2023-12-04T10:43:58.030984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:47.544355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.000863+0000","last_change":"2023-12-04T10:43:58.226091+0000","last_active":"2023-12-04T10:43:59.000863+0000","last_peered":"2023-12-04T10:43:59.000863+0000","last_clean":"2023-12-04T10:43:59.000863+0000","last_became_active":"2023-12-04T10:43:58.225330+0000","last_became_peered":"2023-12-04T10:43:58.225330+0000","last_unstale":"2023-12-04T10:43:59.000863+0000","last_undegraded":"2023-12-04T10:43:59.000863+0000","last_fullsized":"2023-12-04T10:43:59.000863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:55:33.240134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030673+0000","last_change":"2023-12-04T10:43:52.982076+0000","last_active":"2023-12-04T10:43:58.030673+0000","last_peered":"2023-12-04T10:43:58.030673+0000","last_clean":"2023-12-04T10:43:58.030673+0000","last_became_active":"2023-12-04T10:43:52.972016+0000","last_became_peered":"2023-12-04T10:43:52.972016+0000","last_unstale":"2023-12-04T10:43:58.030673+0000","last_undegraded":"2023-12-04T10:43:58.030673+0000","last_fullsized":"2023-12-04T10:43:58.030673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:46:15.950875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.214559+0000","last_change":"2023-12-04T10:43:52.266409+0000","last_active":"2023-12-04T10:43:58.214559+0000","last_peered":"2023-12-04T10:43:58.214559+0000","last_clean":"2023-12-04T10:43:58.214559+0000","last_became_active":"2023-12-04T10:43:52.265294+0000","last_became_peered":"2023-12-04T10:43:52.265294+0000","last_unstale":"2023-12-04T10:43:58.214559+0000","last_undegraded":"2023-12-04T10:43:58.214559+0000","last_fullsized":"2023-12-04T10:43:58.214559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:30:30.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704052+0000","last_change":"2023-12-04T10:43:58.054026+0000","last_active":"2023-12-04T10:43:58.704052+0000","last_peered":"2023-12-04T10:43:58.704052+0000","last_clean":"2023-12-04T10:43:58.704052+0000","last_became_active":"2023-12-04T10:43:58.053503+0000","last_became_peered":"2023-12-04T10:43:58.053503+0000","last_unstale":"2023-12-04T10:43:58.704052+0000","last_undegraded":"2023-12-04T10:43:58.704052+0000","last_fullsized":"2023-12-04T10:43:58.704052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:16:07.199657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039992+0000","last_change":"2023-12-04T10:43:52.985148+0000","last_active":"2023-12-04T10:43:58.039992+0000","last_peered":"2023-12-04T10:43:58.039992+0000","last_clean":"2023-12-04T10:43:58.039992+0000","last_became_active":"2023-12-04T10:43:52.984813+0000","last_became_peered":"2023-12-04T10:43:52.984813+0000","last_unstale":"2023-12-04T10:43:58.039992+0000","last_undegraded":"2023-12-04T10:43:58.039992+0000","last_fullsized":"2023-12-04T10:43:58.039992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049600+0000","last_change":"2023-12-04T10:43:52.270015+0000","last_active":"2023-12-04T10:43:58.049600+0000","last_peered":"2023-12-04T10:43:58.049600+0000","last_clean":"2023-12-04T10:43:58.049600+0000","last_became_active":"2023-12-04T10:43:52.269682+0000","last_became_peered":"2023-12-04T10:43:52.269682+0000","last_unstale":"2023-12-04T10:43:58.049600+0000","last_undegraded":"2023-12-04T10:43:58.049600+0000","last_fullsized":"2023-12-04T10:43:58.049600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703352+0000","last_change":"2023-12-04T10:43:58.223739+0000","last_active":"2023-12-04T10:43:58.703352+0000","last_peered":"2023-12-04T10:43:58.703352+0000","last_clean":"2023-12-04T10:43:58.703352+0000","last_became_active":"2023-12-04T10:43:58.223091+0000","last_became_peered":"2023-12-04T10:43:58.223091+0000","last_unstale":"2023-12-04T10:43:58.703352+0000","last_undegraded":"2023-12-04T10:43:58.703352+0000","last_fullsized":"2023-12-04T10:43:58.703352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:20:24.266893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.023237+0000","last_change":"2023-12-04T10:43:52.980989+0000","last_active":"2023-12-04T10:43:58.023237+0000","last_peered":"2023-12-04T10:43:58.023237+0000","last_clean":"2023-12-04T10:43:58.023237+0000","last_became_active":"2023-12-04T10:43:52.980436+0000","last_became_peered":"2023-12-04T10:43:52.980436+0000","last_unstale":"2023-12-04T10:43:58.023237+0000","last_undegraded":"2023-12-04T10:43:58.023237+0000","last_fullsized":"2023-12-04T10:43:58.023237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030910+0000","last_change":"2023-12-04T10:43:52.258606+0000","last_active":"2023-12-04T10:43:58.030910+0000","last_peered":"2023-12-04T10:43:58.030910+0000","last_clean":"2023-12-04T10:43:58.030910+0000","last_became_active":"2023-12-04T10:43:52.258209+0000","last_became_peered":"2023-12-04T10:43:52.258209+0000","last_unstale":"2023-12-04T10:43:58.030910+0000","last_undegraded":"2023-12-04T10:43:58.030910+0000","last_fullsized":"2023-12-04T10:43:58.030910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:15:20.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702285+0000","last_change":"2023-12-04T10:43:58.215546+0000","last_active":"2023-12-04T10:43:58.702285+0000","last_peered":"2023-12-04T10:43:58.702285+0000","last_clean":"2023-12-04T10:43:58.702285+0000","last_became_active":"2023-12-04T10:43:58.214293+0000","last_became_peered":"2023-12-04T10:43:58.214293+0000","last_unstale":"2023-12-04T10:43:58.702285+0000","last_undegraded":"2023-12-04T10:43:58.702285+0000","last_fullsized":"2023-12-04T10:43:58.702285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:57:02.248236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034123+0000","last_change":"2023-12-04T10:43:52.973852+0000","last_active":"2023-12-04T10:43:58.034123+0000","last_peered":"2023-12-04T10:43:58.034123+0000","last_clean":"2023-12-04T10:43:58.034123+0000","last_became_active":"2023-12-04T10:43:52.972253+0000","last_became_peered":"2023-12-04T10:43:52.972253+0000","last_unstale":"2023-12-04T10:43:58.034123+0000","last_undegraded":"2023-12-04T10:43:58.034123+0000","last_fullsized":"2023-12-04T10:43:58.034123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:20:19.481533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.220155+0000","last_change":"2023-12-04T10:43:52.261351+0000","last_active":"2023-12-04T10:43:58.220155+0000","last_peered":"2023-12-04T10:43:58.220155+0000","last_clean":"2023-12-04T10:43:58.220155+0000","last_became_active":"2023-12-04T10:43:52.261052+0000","last_became_peered":"2023-12-04T10:43:52.261052+0000","last_unstale":"2023-12-04T10:43:58.220155+0000","last_undegraded":"2023-12-04T10:43:58.220155+0000","last_fullsized":"2023-12-04T10:43:58.220155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:03.065751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995773+0000","last_change":"2023-12-04T10:43:58.215971+0000","last_active":"2023-12-04T10:43:58.995773+0000","last_peered":"2023-12-04T10:43:58.995773+0000","last_clean":"2023-12-04T10:43:58.995773+0000","last_became_active":"2023-12-04T10:43:58.214859+0000","last_became_peered":"2023-12-04T10:43:58.214859+0000","last_unstale":"2023-12-04T10:43:58.995773+0000","last_undegraded":"2023-12-04T10:43:58.995773+0000","last_fullsized":"2023-12-04T10:43:58.995773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:32:49.715432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040441+0000","last_change":"2023-12-04T10:43:52.994569+0000","last_active":"2023-12-04T10:43:58.040441+0000","last_peered":"2023-12-04T10:43:58.040441+0000","last_clean":"2023-12-04T10:43:58.040441+0000","last_became_active":"2023-12-04T10:43:52.994301+0000","last_became_peered":"2023-12-04T10:43:52.994301+0000","last_unstale":"2023-12-04T10:43:58.040441+0000","last_undegraded":"2023-12-04T10:43:58.040441+0000","last_fullsized":"2023-12-04T10:43:58.040441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:21.236244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034230+0000","last_change":"2023-12-04T10:43:52.249758+0000","last_active":"2023-12-04T10:43:58.034230+0000","last_peered":"2023-12-04T10:43:58.034230+0000","last_clean":"2023-12-04T10:43:58.034230+0000","last_became_active":"2023-12-04T10:43:52.248998+0000","last_became_peered":"2023-12-04T10:43:52.248998+0000","last_unstale":"2023-12-04T10:43:58.034230+0000","last_undegraded":"2023-12-04T10:43:58.034230+0000","last_fullsized":"2023-12-04T10:43:58.034230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:18:12.560014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.998783+0000","last_change":"2023-12-04T10:43:58.049867+0000","last_active":"2023-12-04T10:43:58.998783+0000","last_peered":"2023-12-04T10:43:58.998783+0000","last_clean":"2023-12-04T10:43:58.998783+0000","last_became_active":"2023-12-04T10:43:58.049454+0000","last_became_peered":"2023-12-04T10:43:58.049454+0000","last_unstale":"2023-12-04T10:43:58.998783+0000","last_undegraded":"2023-12-04T10:43:58.998783+0000","last_fullsized":"2023-12-04T10:43:58.998783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:14:13.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037424+0000","last_change":"2023-12-04T10:43:52.980950+0000","last_active":"2023-12-04T10:43:58.037424+0000","last_peered":"2023-12-04T10:43:58.037424+0000","last_clean":"2023-12-04T10:43:58.037424+0000","last_became_active":"2023-12-04T10:43:52.980633+0000","last_became_peered":"2023-12-04T10:43:52.980633+0000","last_unstale":"2023-12-04T10:43:58.037424+0000","last_undegraded":"2023-12-04T10:43:58.037424+0000","last_fullsized":"2023-12-04T10:43:58.037424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:24:23.025254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.035013+0000","last_change":"2023-12-04T10:43:52.259456+0000","last_active":"2023-12-04T10:43:58.035013+0000","last_peered":"2023-12-04T10:43:58.035013+0000","last_clean":"2023-12-04T10:43:58.035013+0000","last_became_active":"2023-12-04T10:43:52.254414+0000","last_became_peered":"2023-12-04T10:43:52.254414+0000","last_unstale":"2023-12-04T10:43:58.035013+0000","last_undegraded":"2023-12-04T10:43:58.035013+0000","last_fullsized":"2023-12-04T10:43:58.035013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:03.065751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.000962+0000","last_change":"2023-12-04T10:43:58.053734+0000","last_active":"2023-12-04T10:43:59.000962+0000","last_peered":"2023-12-04T10:43:59.000962+0000","last_clean":"2023-12-04T10:43:59.000962+0000","last_became_active":"2023-12-04T10:43:58.053373+0000","last_became_peered":"2023-12-04T10:43:58.053373+0000","last_unstale":"2023-12-04T10:43:59.000962+0000","last_undegraded":"2023-12-04T10:43:59.000962+0000","last_fullsized":"2023-12-04T10:43:59.000962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:22:58.696286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030598+0000","last_change":"2023-12-04T10:43:52.974356+0000","last_active":"2023-12-04T10:43:58.030598+0000","last_peered":"2023-12-04T10:43:58.030598+0000","last_clean":"2023-12-04T10:43:58.030598+0000","last_became_active":"2023-12-04T10:43:52.974025+0000","last_became_peered":"2023-12-04T10:43:52.974025+0000","last_unstale":"2023-12-04T10:43:58.030598+0000","last_undegraded":"2023-12-04T10:43:58.030598+0000","last_fullsized":"2023-12-04T10:43:58.030598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:02:21.706862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.044424+0000","last_change":"2023-12-04T10:43:52.251063+0000","last_active":"2023-12-04T10:43:58.044424+0000","last_peered":"2023-12-04T10:43:58.044424+0000","last_clean":"2023-12-04T10:43:58.044424+0000","last_became_active":"2023-12-04T10:43:52.250274+0000","last_became_peered":"2023-12-04T10:43:52.250274+0000","last_unstale":"2023-12-04T10:43:58.044424+0000","last_undegraded":"2023-12-04T10:43:58.044424+0000","last_fullsized":"2023-12-04T10:43:58.044424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:20.848140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.001269+0000","last_change":"2023-12-04T10:43:58.046943+0000","last_active":"2023-12-04T10:43:59.001269+0000","last_peered":"2023-12-04T10:43:59.001269+0000","last_clean":"2023-12-04T10:43:59.001269+0000","last_became_active":"2023-12-04T10:43:58.046583+0000","last_became_peered":"2023-12-04T10:43:58.046583+0000","last_unstale":"2023-12-04T10:43:59.001269+0000","last_undegraded":"2023-12-04T10:43:59.001269+0000","last_fullsized":"2023-12-04T10:43:59.001269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:18:58.227614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.032594+0000","last_change":"2023-12-04T10:43:52.973314+0000","last_active":"2023-12-04T10:43:58.032594+0000","last_peered":"2023-12-04T10:43:58.032594+0000","last_clean":"2023-12-04T10:43:58.032594+0000","last_became_active":"2023-12-04T10:43:52.973027+0000","last_became_peered":"2023-12-04T10:43:52.973027+0000","last_unstale":"2023-12-04T10:43:58.032594+0000","last_undegraded":"2023-12-04T10:43:58.032594+0000","last_fullsized":"2023-12-04T10:43:58.032594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216818+0000","last_change":"2023-12-04T10:43:52.264881+0000","last_active":"2023-12-04T10:43:58.216818+0000","last_peered":"2023-12-04T10:43:58.216818+0000","last_clean":"2023-12-04T10:43:58.216818+0000","last_became_active":"2023-12-04T10:43:52.262303+0000","last_became_peered":"2023-12-04T10:43:52.262303+0000","last_unstale":"2023-12-04T10:43:58.216818+0000","last_undegraded":"2023-12-04T10:43:58.216818+0000","last_fullsized":"2023-12-04T10:43:58.216818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995766+0000","last_change":"2023-12-04T10:43:58.235583+0000","last_active":"2023-12-04T10:43:58.995766+0000","last_peered":"2023-12-04T10:43:58.995766+0000","last_clean":"2023-12-04T10:43:58.995766+0000","last_became_active":"2023-12-04T10:43:58.231876+0000","last_became_peered":"2023-12-04T10:43:58.231876+0000","last_unstale":"2023-12-04T10:43:58.995766+0000","last_undegraded":"2023-12-04T10:43:58.995766+0000","last_fullsized":"2023-12-04T10:43:58.995766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:59.475236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020643+0000","last_change":"2023-12-04T10:43:52.988166+0000","last_active":"2023-12-04T10:43:58.020643+0000","last_peered":"2023-12-04T10:43:58.020643+0000","last_clean":"2023-12-04T10:43:58.020643+0000","last_became_active":"2023-12-04T10:43:52.987801+0000","last_became_peered":"2023-12-04T10:43:52.987801+0000","last_unstale":"2023-12-04T10:43:58.020643+0000","last_undegraded":"2023-12-04T10:43:58.020643+0000","last_fullsized":"2023-12-04T10:43:58.020643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041216+0000","last_change":"2023-12-04T10:43:52.261710+0000","last_active":"2023-12-04T10:43:58.041216+0000","last_peered":"2023-12-04T10:43:58.041216+0000","last_clean":"2023-12-04T10:43:58.041216+0000","last_became_active":"2023-12-04T10:43:52.253457+0000","last_became_peered":"2023-12-04T10:43:52.253457+0000","last_unstale":"2023-12-04T10:43:58.041216+0000","last_undegraded":"2023-12-04T10:43:58.041216+0000","last_fullsized":"2023-12-04T10:43:58.041216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:24.986256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.215951+0000","last_change":"2023-12-04T10:43:48.111279+0000","last_active":"2023-12-04T10:43:58.215951+0000","last_peered":"2023-12-04T10:43:58.215951+0000","last_clean":"2023-12-04T10:43:58.215951+0000","last_became_active":"2023-12-04T10:43:48.108038+0000","last_became_peered":"2023-12-04T10:43:48.108038+0000","last_unstale":"2023-12-04T10:43:58.215951+0000","last_undegraded":"2023-12-04T10:43:58.215951+0000","last_fullsized":"2023-12-04T10:43:58.215951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_clean_scrub_stamp":"2023-12-04T10:43:46.528449+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:31:15.475210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.707014+0000","last_change":"2023-12-04T10:43:58.229941+0000","last_active":"2023-12-04T10:43:58.707014+0000","last_peered":"2023-12-04T10:43:58.707014+0000","last_clean":"2023-12-04T10:43:58.707014+0000","last_became_active":"2023-12-04T10:43:58.225120+0000","last_became_peered":"2023-12-04T10:43:58.225120+0000","last_unstale":"2023-12-04T10:43:58.707014+0000","last_undegraded":"2023-12-04T10:43:58.707014+0000","last_fullsized":"2023-12-04T10:43:58.707014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:15.863508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219407+0000","last_change":"2023-12-04T10:43:52.982313+0000","last_active":"2023-12-04T10:43:58.219407+0000","last_peered":"2023-12-04T10:43:58.219407+0000","last_clean":"2023-12-04T10:43:58.219407+0000","last_became_active":"2023-12-04T10:43:52.979562+0000","last_became_peered":"2023-12-04T10:43:52.979562+0000","last_unstale":"2023-12-04T10:43:58.219407+0000","last_undegraded":"2023-12-04T10:43:58.219407+0000","last_fullsized":"2023-12-04T10:43:58.219407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:46.964865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049829+0000","last_change":"2023-12-04T10:43:52.267801+0000","last_active":"2023-12-04T10:43:58.049829+0000","last_peered":"2023-12-04T10:43:58.049829+0000","last_clean":"2023-12-04T10:43:58.049829+0000","last_became_active":"2023-12-04T10:43:52.267514+0000","last_became_peered":"2023-12-04T10:43:52.267514+0000","last_unstale":"2023-12-04T10:43:58.049829+0000","last_undegraded":"2023-12-04T10:43:58.049829+0000","last_fullsized":"2023-12-04T10:43:58.049829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:46:14.667542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.705960+0000","last_change":"2023-12-04T10:43:58.218053+0000","last_active":"2023-12-04T10:43:58.705960+0000","last_peered":"2023-12-04T10:43:58.705960+0000","last_clean":"2023-12-04T10:43:58.705960+0000","last_became_active":"2023-12-04T10:43:58.216729+0000","last_became_peered":"2023-12-04T10:43:58.216729+0000","last_unstale":"2023-12-04T10:43:58.705960+0000","last_undegraded":"2023-12-04T10:43:58.705960+0000","last_fullsized":"2023-12-04T10:43:58.705960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:05.657652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040709+0000","last_change":"2023-12-04T10:43:52.993942+0000","last_active":"2023-12-04T10:43:58.040709+0000","last_peered":"2023-12-04T10:43:58.040709+0000","last_clean":"2023-12-04T10:43:58.040709+0000","last_became_active":"2023-12-04T10:43:52.993613+0000","last_became_peered":"2023-12-04T10:43:52.993613+0000","last_unstale":"2023-12-04T10:43:58.040709+0000","last_undegraded":"2023-12-04T10:43:58.040709+0000","last_fullsized":"2023-12-04T10:43:58.040709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:11.078149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030147+0000","last_change":"2023-12-04T10:43:52.253522+0000","last_active":"2023-12-04T10:43:58.030147+0000","last_peered":"2023-12-04T10:43:58.030147+0000","last_clean":"2023-12-04T10:43:58.030147+0000","last_became_active":"2023-12-04T10:43:52.253254+0000","last_became_peered":"2023-12-04T10:43:52.253254+0000","last_unstale":"2023-12-04T10:43:58.030147+0000","last_undegraded":"2023-12-04T10:43:58.030147+0000","last_fullsized":"2023-12-04T10:43:58.030147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:59.001748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.996252+0000","last_change":"2023-12-04T10:43:58.049520+0000","last_active":"2023-12-04T10:43:58.996252+0000","last_peered":"2023-12-04T10:43:58.996252+0000","last_clean":"2023-12-04T10:43:58.996252+0000","last_became_active":"2023-12-04T10:43:58.049110+0000","last_became_peered":"2023-12-04T10:43:58.049110+0000","last_unstale":"2023-12-04T10:43:58.996252+0000","last_undegraded":"2023-12-04T10:43:58.996252+0000","last_fullsized":"2023-12-04T10:43:58.996252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:29.332279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.221876+0000","last_change":"2023-12-04T10:43:52.992408+0000","last_active":"2023-12-04T10:43:58.221876+0000","last_peered":"2023-12-04T10:43:58.221876+0000","last_clean":"2023-12-04T10:43:58.221876+0000","last_became_active":"2023-12-04T10:43:52.992078+0000","last_became_peered":"2023-12-04T10:43:52.992078+0000","last_unstale":"2023-12-04T10:43:58.221876+0000","last_undegraded":"2023-12-04T10:43:58.221876+0000","last_fullsized":"2023-12-04T10:43:58.221876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:24.546919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.046433+0000","last_change":"2023-12-04T10:43:52.251057+0000","last_active":"2023-12-04T10:43:58.046433+0000","last_peered":"2023-12-04T10:43:58.046433+0000","last_clean":"2023-12-04T10:43:58.046433+0000","last_became_active":"2023-12-04T10:43:52.250572+0000","last_became_peered":"2023-12-04T10:43:52.250572+0000","last_unstale":"2023-12-04T10:43:58.046433+0000","last_undegraded":"2023-12-04T10:43:58.046433+0000","last_fullsized":"2023-12-04T10:43:58.046433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:24:21.741921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.996401+0000","last_change":"2023-12-04T10:43:58.228293+0000","last_active":"2023-12-04T10:43:58.996401+0000","last_peered":"2023-12-04T10:43:58.996401+0000","last_clean":"2023-12-04T10:43:58.996401+0000","last_became_active":"2023-12-04T10:43:58.227230+0000","last_became_peered":"2023-12-04T10:43:58.227230+0000","last_unstale":"2023-12-04T10:43:58.996401+0000","last_undegraded":"2023-12-04T10:43:58.996401+0000","last_fullsized":"2023-12-04T10:43:58.996401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:45:11.650821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219484+0000","last_change":"2023-12-04T10:43:52.986513+0000","last_active":"2023-12-04T10:43:58.219484+0000","last_peered":"2023-12-04T10:43:58.219484+0000","last_clean":"2023-12-04T10:43:58.219484+0000","last_became_active":"2023-12-04T10:43:52.985480+0000","last_became_peered":"2023-12-04T10:43:52.985480+0000","last_unstale":"2023-12-04T10:43:58.219484+0000","last_undegraded":"2023-12-04T10:43:58.219484+0000","last_fullsized":"2023-12-04T10:43:58.219484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:54.689876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033674+0000","last_change":"2023-12-04T10:43:52.248849+0000","last_active":"2023-12-04T10:43:58.033674+0000","last_peered":"2023-12-04T10:43:58.033674+0000","last_clean":"2023-12-04T10:43:58.033674+0000","last_became_active":"2023-12-04T10:43:52.248072+0000","last_became_peered":"2023-12-04T10:43:52.248072+0000","last_unstale":"2023-12-04T10:43:58.033674+0000","last_undegraded":"2023-12-04T10:43:58.033674+0000","last_fullsized":"2023-12-04T10:43:58.033674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:55:50.076235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704337+0000","last_change":"2023-12-04T10:43:58.054851+0000","last_active":"2023-12-04T10:43:58.704337+0000","last_peered":"2023-12-04T10:43:58.704337+0000","last_clean":"2023-12-04T10:43:58.704337+0000","last_became_active":"2023-12-04T10:43:58.053543+0000","last_became_peered":"2023-12-04T10:43:58.053543+0000","last_unstale":"2023-12-04T10:43:58.704337+0000","last_undegraded":"2023-12-04T10:43:58.704337+0000","last_fullsized":"2023-12-04T10:43:58.704337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:36.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.217048+0000","last_change":"2023-12-04T10:43:52.988930+0000","last_active":"2023-12-04T10:43:58.217048+0000","last_peered":"2023-12-04T10:43:58.217048+0000","last_clean":"2023-12-04T10:43:58.217048+0000","last_became_active":"2023-12-04T10:43:52.988638+0000","last_became_peered":"2023-12-04T10:43:52.988638+0000","last_unstale":"2023-12-04T10:43:58.217048+0000","last_undegraded":"2023-12-04T10:43:58.217048+0000","last_fullsized":"2023-12-04T10:43:58.217048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041474+0000","last_change":"2023-12-04T10:43:52.245850+0000","last_active":"2023-12-04T10:43:58.041474+0000","last_peered":"2023-12-04T10:43:58.041474+0000","last_clean":"2023-12-04T10:43:58.041474+0000","last_became_active":"2023-12-04T10:43:52.245241+0000","last_became_peered":"2023-12-04T10:43:52.245241+0000","last_unstale":"2023-12-04T10:43:58.041474+0000","last_undegraded":"2023-12-04T10:43:58.041474+0000","last_fullsized":"2023-12-04T10:43:58.041474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:01:30.452121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995405+0000","last_change":"2023-12-04T10:43:58.057996+0000","last_active":"2023-12-04T10:43:58.995405+0000","last_peered":"2023-12-04T10:43:58.995405+0000","last_clean":"2023-12-04T10:43:58.995405+0000","last_became_active":"2023-12-04T10:43:58.052353+0000","last_became_peered":"2023-12-04T10:43:58.052353+0000","last_unstale":"2023-12-04T10:43:58.995405+0000","last_undegraded":"2023-12-04T10:43:58.995405+0000","last_fullsized":"2023-12-04T10:43:58.995405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:44.810269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048575+0000","last_change":"2023-12-04T10:43:52.986974+0000","last_active":"2023-12-04T10:43:58.048575+0000","last_peered":"2023-12-04T10:43:58.048575+0000","last_clean":"2023-12-04T10:43:58.048575+0000","last_became_active":"2023-12-04T10:43:52.986644+0000","last_became_peered":"2023-12-04T10:43:52.986644+0000","last_unstale":"2023-12-04T10:43:58.048575+0000","last_undegraded":"2023-12-04T10:43:58.048575+0000","last_fullsized":"2023-12-04T10:43:58.048575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048730+0000","last_change":"2023-12-04T10:43:52.262403+0000","last_active":"2023-12-04T10:43:58.048730+0000","last_peered":"2023-12-04T10:43:58.048730+0000","last_clean":"2023-12-04T10:43:58.048730+0000","last_became_active":"2023-12-04T10:43:52.261992+0000","last_became_peered":"2023-12-04T10:43:52.261992+0000","last_unstale":"2023-12-04T10:43:58.048730+0000","last_undegraded":"2023-12-04T10:43:58.048730+0000","last_fullsized":"2023-12-04T10:43:58.048730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:53:18.654556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704536+0000","last_change":"2023-12-04T10:43:58.227429+0000","last_active":"2023-12-04T10:43:58.704536+0000","last_peered":"2023-12-04T10:43:58.704536+0000","last_clean":"2023-12-04T10:43:58.704536+0000","last_became_active":"2023-12-04T10:43:58.226172+0000","last_became_peered":"2023-12-04T10:43:58.226172+0000","last_unstale":"2023-12-04T10:43:58.704536+0000","last_undegraded":"2023-12-04T10:43:58.704536+0000","last_fullsized":"2023-12-04T10:43:58.704536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:24:19.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216035+0000","last_change":"2023-12-04T10:43:52.991297+0000","last_active":"2023-12-04T10:43:58.216035+0000","last_peered":"2023-12-04T10:43:58.216035+0000","last_clean":"2023-12-04T10:43:58.216035+0000","last_became_active":"2023-12-04T10:43:52.990881+0000","last_became_peered":"2023-12-04T10:43:52.990881+0000","last_unstale":"2023-12-04T10:43:58.216035+0000","last_undegraded":"2023-12-04T10:43:58.216035+0000","last_fullsized":"2023-12-04T10:43:58.216035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:11.078149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034868+0000","last_change":"2023-12-04T10:43:52.262989+0000","last_active":"2023-12-04T10:43:58.034868+0000","last_peered":"2023-12-04T10:43:58.034868+0000","last_clean":"2023-12-04T10:43:58.034868+0000","last_became_active":"2023-12-04T10:43:52.262666+0000","last_became_peered":"2023-12-04T10:43:52.262666+0000","last_unstale":"2023-12-04T10:43:58.034868+0000","last_undegraded":"2023-12-04T10:43:58.034868+0000","last_fullsized":"2023-12-04T10:43:58.034868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:25.093855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703956+0000","last_change":"2023-12-04T10:43:58.215319+0000","last_active":"2023-12-04T10:43:58.703956+0000","last_peered":"2023-12-04T10:43:58.703956+0000","last_clean":"2023-12-04T10:43:58.703956+0000","last_became_active":"2023-12-04T10:43:58.214315+0000","last_became_peered":"2023-12-04T10:43:58.214315+0000","last_unstale":"2023-12-04T10:43:58.703956+0000","last_undegraded":"2023-12-04T10:43:58.703956+0000","last_fullsized":"2023-12-04T10:43:58.703956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:20:30.277031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033921+0000","last_change":"2023-12-04T10:43:52.977398+0000","last_active":"2023-12-04T10:43:58.033921+0000","last_peered":"2023-12-04T10:43:58.033921+0000","last_clean":"2023-12-04T10:43:58.033921+0000","last_became_active":"2023-12-04T10:43:52.977024+0000","last_became_peered":"2023-12-04T10:43:52.977024+0000","last_unstale":"2023-12-04T10:43:58.033921+0000","last_undegraded":"2023-12-04T10:43:58.033921+0000","last_fullsized":"2023-12-04T10:43:58.033921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039616+0000","last_change":"2023-12-04T10:43:52.255501+0000","last_active":"2023-12-04T10:43:58.039616+0000","last_peered":"2023-12-04T10:43:58.039616+0000","last_clean":"2023-12-04T10:43:58.039616+0000","last_became_active":"2023-12-04T10:43:52.255013+0000","last_became_peered":"2023-12-04T10:43:52.255013+0000","last_unstale":"2023-12-04T10:43:58.039616+0000","last_undegraded":"2023-12-04T10:43:58.039616+0000","last_fullsized":"2023-12-04T10:43:58.039616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.999729+0000","last_change":"2023-12-04T10:43:58.216747+0000","last_active":"2023-12-04T10:43:58.999729+0000","last_peered":"2023-12-04T10:43:58.999729+0000","last_clean":"2023-12-04T10:43:58.999729+0000","last_became_active":"2023-12-04T10:43:58.215380+0000","last_became_peered":"2023-12-04T10:43:58.215380+0000","last_unstale":"2023-12-04T10:43:58.999729+0000","last_undegraded":"2023-12-04T10:43:58.999729+0000","last_fullsized":"2023-12-04T10:43:58.999729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:06:26.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219253+0000","last_change":"2023-12-04T10:43:52.986160+0000","last_active":"2023-12-04T10:43:58.219253+0000","last_peered":"2023-12-04T10:43:58.219253+0000","last_clean":"2023-12-04T10:43:58.219253+0000","last_became_active":"2023-12-04T10:43:52.985651+0000","last_became_peered":"2023-12-04T10:43:52.985651+0000","last_unstale":"2023-12-04T10:43:58.219253+0000","last_undegraded":"2023-12-04T10:43:58.219253+0000","last_fullsized":"2023-12-04T10:43:58.219253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:21.236244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:44:13.361227+0000","last_change":"2023-12-04T10:43:52.259456+0000","last_active":"2023-12-04T10:44:13.361227+0000","last_peered":"2023-12-04T10:44:13.361227+0000","last_clean":"2023-12-04T10:44:13.361227+0000","last_became_active":"2023-12-04T10:43:52.259142+0000","last_became_peered":"2023-12-04T10:43:52.259142+0000","last_unstale":"2023-12-04T10:44:13.361227+0000","last_undegraded":"2023-12-04T10:44:13.361227+0000","last_fullsized":"2023-12-04T10:44:13.361227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:14:32.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.999714+0000","last_change":"2023-12-04T10:43:58.055299+0000","last_active":"2023-12-04T10:43:58.999714+0000","last_peered":"2023-12-04T10:43:58.999714+0000","last_clean":"2023-12-04T10:43:58.999714+0000","last_became_active":"2023-12-04T10:43:58.054806+0000","last_became_peered":"2023-12-04T10:43:58.054806+0000","last_unstale":"2023-12-04T10:43:58.999714+0000","last_undegraded":"2023-12-04T10:43:58.999714+0000","last_fullsized":"2023-12-04T10:43:58.999714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:15:21.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.038505+0000","last_change":"2023-12-04T10:43:52.980883+0000","last_active":"2023-12-04T10:43:58.038505+0000","last_peered":"2023-12-04T10:43:58.038505+0000","last_clean":"2023-12-04T10:43:58.038505+0000","last_became_active":"2023-12-04T10:43:52.980510+0000","last_became_peered":"2023-12-04T10:43:52.980510+0000","last_unstale":"2023-12-04T10:43:58.038505+0000","last_undegraded":"2023-12-04T10:43:58.038505+0000","last_fullsized":"2023-12-04T10:43:58.038505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:48.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030038+0000","last_change":"2023-12-04T10:43:52.256393+0000","last_active":"2023-12-04T10:43:58.030038+0000","last_peered":"2023-12-04T10:43:58.030038+0000","last_clean":"2023-12-04T10:43:58.030038+0000","last_became_active":"2023-12-04T10:43:52.256172+0000","last_became_peered":"2023-12-04T10:43:52.256172+0000","last_unstale":"2023-12-04T10:43:58.030038+0000","last_undegraded":"2023-12-04T10:43:58.030038+0000","last_fullsized":"2023-12-04T10:43:58.030038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:50:43.248614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704573+0000","last_change":"2023-12-04T10:43:58.053865+0000","last_active":"2023-12-04T10:43:58.704573+0000","last_peered":"2023-12-04T10:43:58.704573+0000","last_clean":"2023-12-04T10:43:58.704573+0000","last_became_active":"2023-12-04T10:43:58.053350+0000","last_became_peered":"2023-12-04T10:43:58.053350+0000","last_unstale":"2023-12-04T10:43:58.704573+0000","last_undegraded":"2023-12-04T10:43:58.704573+0000","last_fullsized":"2023-12-04T10:43:58.704573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:53:18.451370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039041+0000","last_change":"2023-12-04T10:43:52.979625+0000","last_active":"2023-12-04T10:43:58.039041+0000","last_peered":"2023-12-04T10:43:58.039041+0000","last_clean":"2023-12-04T10:43:58.039041+0000","last_became_active":"2023-12-04T10:43:52.979301+0000","last_became_peered":"2023-12-04T10:43:52.979301+0000","last_unstale":"2023-12-04T10:43:58.039041+0000","last_undegraded":"2023-12-04T10:43:58.039041+0000","last_fullsized":"2023-12-04T10:43:58.039041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040479+0000","last_change":"2023-12-04T10:43:52.256384+0000","last_active":"2023-12-04T10:43:58.040479+0000","last_peered":"2023-12-04T10:43:58.040479+0000","last_clean":"2023-12-04T10:43:58.040479+0000","last_became_active":"2023-12-04T10:43:52.255923+0000","last_became_peered":"2023-12-04T10:43:52.255923+0000","last_unstale":"2023-12-04T10:43:58.040479+0000","last_undegraded":"2023-12-04T10:43:58.040479+0000","last_fullsized":"2023-12-04T10:43:58.040479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:25.210732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702798+0000","last_change":"2023-12-04T10:43:58.052271+0000","last_active":"2023-12-04T10:43:58.702798+0000","last_peered":"2023-12-04T10:43:58.702798+0000","last_clean":"2023-12-04T10:43:58.702798+0000","last_became_active":"2023-12-04T10:43:58.051959+0000","last_became_peered":"2023-12-04T10:43:58.051959+0000","last_unstale":"2023-12-04T10:43:58.702798+0000","last_undegraded":"2023-12-04T10:43:58.702798+0000","last_fullsized":"2023-12-04T10:43:58.702798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:06:26.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040336+0000","last_change":"2023-12-04T10:43:52.982397+0000","last_active":"2023-12-04T10:43:58.040336+0000","last_peered":"2023-12-04T10:43:58.040336+0000","last_clean":"2023-12-04T10:43:58.040336+0000","last_became_active":"2023-12-04T10:43:52.979862+0000","last_became_peered":"2023-12-04T10:43:52.979862+0000","last_unstale":"2023-12-04T10:43:58.040336+0000","last_undegraded":"2023-12-04T10:43:58.040336+0000","last_fullsized":"2023-12-04T10:43:58.040336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:40.024910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049485+0000","last_change":"2023-12-04T10:43:52.267763+0000","last_active":"2023-12-04T10:43:58.049485+0000","last_peered":"2023-12-04T10:43:58.049485+0000","last_clean":"2023-12-04T10:43:58.049485+0000","last_became_active":"2023-12-04T10:43:52.267415+0000","last_became_peered":"2023-12-04T10:43:52.267415+0000","last_unstale":"2023-12-04T10:43:58.049485+0000","last_undegraded":"2023-12-04T10:43:58.049485+0000","last_fullsized":"2023-12-04T10:43:58.049485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702869+0000","last_change":"2023-12-04T10:43:58.225596+0000","last_active":"2023-12-04T10:43:58.702869+0000","last_peered":"2023-12-04T10:43:58.702869+0000","last_clean":"2023-12-04T10:43:58.702869+0000","last_became_active":"2023-12-04T10:43:58.225115+0000","last_became_peered":"2023-12-04T10:43:58.225115+0000","last_unstale":"2023-12-04T10:43:58.702869+0000","last_undegraded":"2023-12-04T10:43:58.702869+0000","last_fullsized":"2023-12-04T10:43:58.702869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:53.914156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995318+0000","last_change":"2023-12-04T10:43:58.235031+0000","last_active":"2023-12-04T10:43:58.995318+0000","last_peered":"2023-12-04T10:43:58.995318+0000","last_clean":"2023-12-04T10:43:58.995318+0000","last_became_active":"2023-12-04T10:43:58.231370+0000","last_became_peered":"2023-12-04T10:43:58.231370+0000","last_unstale":"2023-12-04T10:43:58.995318+0000","last_undegraded":"2023-12-04T10:43:58.995318+0000","last_fullsized":"2023-12-04T10:43:58.995318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:51.750224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030753+0000","last_change":"2023-12-04T10:43:52.970184+0000","last_active":"2023-12-04T10:43:58.030753+0000","last_peered":"2023-12-04T10:43:58.030753+0000","last_clean":"2023-12-04T10:43:58.030753+0000","last_became_active":"2023-12-04T10:43:52.967857+0000","last_became_peered":"2023-12-04T10:43:52.967857+0000","last_unstale":"2023-12-04T10:43:58.030753+0000","last_undegraded":"2023-12-04T10:43:58.030753+0000","last_fullsized":"2023-12-04T10:43:58.030753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:17:13.264517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033298+0000","last_change":"2023-12-04T10:43:52.257154+0000","last_active":"2023-12-04T10:43:58.033298+0000","last_peered":"2023-12-04T10:43:58.033298+0000","last_clean":"2023-12-04T10:43:58.033298+0000","last_became_active":"2023-12-04T10:43:52.256821+0000","last_became_peered":"2023-12-04T10:43:52.256821+0000","last_unstale":"2023-12-04T10:43:58.033298+0000","last_undegraded":"2023-12-04T10:43:58.033298+0000","last_fullsized":"2023-12-04T10:43:58.033298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.707431+0000","last_change":"2023-12-04T10:43:58.063557+0000","last_active":"2023-12-04T10:43:58.707431+0000","last_peered":"2023-12-04T10:43:58.707431+0000","last_clean":"2023-12-04T10:43:58.707431+0000","last_became_active":"2023-12-04T10:43:58.062970+0000","last_became_peered":"2023-12-04T10:43:58.062970+0000","last_unstale":"2023-12-04T10:43:58.707431+0000","last_undegraded":"2023-12-04T10:43:58.707431+0000","last_fullsized":"2023-12-04T10:43:58.707431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:26.021604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021732+0000","last_change":"2023-12-04T10:43:52.984856+0000","last_active":"2023-12-04T10:43:58.021732+0000","last_peered":"2023-12-04T10:43:58.021732+0000","last_clean":"2023-12-04T10:43:58.021732+0000","last_became_active":"2023-12-04T10:43:52.983649+0000","last_became_peered":"2023-12-04T10:43:52.983649+0000","last_unstale":"2023-12-04T10:43:58.021732+0000","last_undegraded":"2023-12-04T10:43:58.021732+0000","last_fullsized":"2023-12-04T10:43:58.021732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022422+0000","last_change":"2023-12-04T10:43:52.251972+0000","last_active":"2023-12-04T10:43:58.022422+0000","last_peered":"2023-12-04T10:43:58.022422+0000","last_clean":"2023-12-04T10:43:58.022422+0000","last_became_active":"2023-12-04T10:43:52.251253+0000","last_became_peered":"2023-12-04T10:43:52.251253+0000","last_unstale":"2023-12-04T10:43:58.022422+0000","last_undegraded":"2023-12-04T10:43:58.022422+0000","last_fullsized":"2023-12-04T10:43:58.022422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:51.960369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048941+0000","last_change":"2023-12-04T10:43:52.260562+0000","last_active":"2023-12-04T10:43:58.048941+0000","last_peered":"2023-12-04T10:43:58.048941+0000","last_clean":"2023-12-04T10:43:58.048941+0000","last_became_active":"2023-12-04T10:43:52.260219+0000","last_became_peered":"2023-12-04T10:43:52.260219+0000","last_unstale":"2023-12-04T10:43:58.048941+0000","last_undegraded":"2023-12-04T10:43:58.048941+0000","last_fullsized":"2023-12-04T10:43:58.048941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:12:59.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041543+0000","last_change":"2023-12-04T10:43:52.987240+0000","last_active":"2023-12-04T10:43:58.041543+0000","last_peered":"2023-12-04T10:43:58.041543+0000","last_clean":"2023-12-04T10:43:58.041543+0000","last_became_active":"2023-12-04T10:43:52.986937+0000","last_became_peered":"2023-12-04T10:43:52.986937+0000","last_unstale":"2023-12-04T10:43:58.041543+0000","last_undegraded":"2023-12-04T10:43:58.041543+0000","last_fullsized":"2023-12-04T10:43:58.041543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.997827+0000","last_change":"2023-12-04T10:43:58.051595+0000","last_active":"2023-12-04T10:43:58.997827+0000","last_peered":"2023-12-04T10:43:58.997827+0000","last_clean":"2023-12-04T10:43:58.997827+0000","last_became_active":"2023-12-04T10:43:58.051043+0000","last_became_peered":"2023-12-04T10:43:58.051043+0000","last_unstale":"2023-12-04T10:43:58.997827+0000","last_undegraded":"2023-12-04T10:43:58.997827+0000","last_fullsized":"2023-12-04T10:43:58.997827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:16:05.070439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021505+0000","last_change":"2023-12-04T10:43:52.265562+0000","last_active":"2023-12-04T10:43:58.021505+0000","last_peered":"2023-12-04T10:43:58.021505+0000","last_clean":"2023-12-04T10:43:58.021505+0000","last_became_active":"2023-12-04T10:43:52.265254+0000","last_became_peered":"2023-12-04T10:43:52.265254+0000","last_unstale":"2023-12-04T10:43:58.021505+0000","last_undegraded":"2023-12-04T10:43:58.021505+0000","last_fullsized":"2023-12-04T10:43:58.021505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:09.555889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.035837+0000","last_change":"2023-12-04T10:43:52.980838+0000","last_active":"2023-12-04T10:43:58.035837+0000","last_peered":"2023-12-04T10:43:58.035837+0000","last_clean":"2023-12-04T10:43:58.035837+0000","last_became_active":"2023-12-04T10:43:52.980492+0000","last_became_peered":"2023-12-04T10:43:52.980492+0000","last_unstale":"2023-12-04T10:43:58.035837+0000","last_undegraded":"2023-12-04T10:43:58.035837+0000","last_fullsized":"2023-12-04T10:43:58.035837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:22.131473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703967+0000","last_change":"2023-12-04T10:43:58.049380+0000","last_active":"2023-12-04T10:43:58.703967+0000","last_peered":"2023-12-04T10:43:58.703967+0000","last_clean":"2023-12-04T10:43:58.703967+0000","last_became_active":"2023-12-04T10:43:58.048992+0000","last_became_peered":"2023-12-04T10:43:58.048992+0000","last_unstale":"2023-12-04T10:43:58.703967+0000","last_undegraded":"2023-12-04T10:43:58.703967+0000","last_fullsized":"2023-12-04T10:43:58.703967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:53:06.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048566+0000","last_change":"2023-12-04T10:43:52.980960+0000","last_active":"2023-12-04T10:43:58.048566+0000","last_peered":"2023-12-04T10:43:58.048566+0000","last_clean":"2023-12-04T10:43:58.048566+0000","last_became_active":"2023-12-04T10:43:52.980414+0000","last_became_peered":"2023-12-04T10:43:52.980414+0000","last_unstale":"2023-12-04T10:43:58.048566+0000","last_undegraded":"2023-12-04T10:43:58.048566+0000","last_fullsized":"2023-12-04T10:43:58.048566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:26.269589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.044326+0000","last_change":"2023-12-04T10:43:52.991417+0000","last_active":"2023-12-04T10:43:58.044326+0000","last_peered":"2023-12-04T10:43:58.044326+0000","last_clean":"2023-12-04T10:43:58.044326+0000","last_became_active":"2023-12-04T10:43:52.991128+0000","last_became_peered":"2023-12-04T10:43:52.991128+0000","last_unstale":"2023-12-04T10:43:58.044326+0000","last_undegraded":"2023-12-04T10:43:58.044326+0000","last_fullsized":"2023-12-04T10:43:58.044326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:48.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034634+0000","last_change":"2023-12-04T10:43:52.979726+0000","last_active":"2023-12-04T10:43:58.034634+0000","last_peered":"2023-12-04T10:43:58.034634+0000","last_clean":"2023-12-04T10:43:58.034634+0000","last_became_active":"2023-12-04T10:43:52.979418+0000","last_became_peered":"2023-12-04T10:43:52.979418+0000","last_unstale":"2023-12-04T10:43:58.034634+0000","last_undegraded":"2023-12-04T10:43:58.034634+0000","last_fullsized":"2023-12-04T10:43:58.034634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:35:03.536961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037625+0000","last_change":"2023-12-04T10:43:52.983306+0000","last_active":"2023-12-04T10:43:58.037625+0000","last_peered":"2023-12-04T10:43:58.037625+0000","last_clean":"2023-12-04T10:43:58.037625+0000","last_became_active":"2023-12-04T10:43:52.982993+0000","last_became_peered":"2023-12-04T10:43:52.982993+0000","last_unstale":"2023-12-04T10:43:58.037625+0000","last_undegraded":"2023-12-04T10:43:58.037625+0000","last_fullsized":"2023-12-04T10:43:58.037625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:26.269589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021434+0000","last_change":"2023-12-04T10:43:52.977063+0000","last_active":"2023-12-04T10:43:58.021434+0000","last_peered":"2023-12-04T10:43:58.021434+0000","last_clean":"2023-12-04T10:43:58.021434+0000","last_became_active":"2023-12-04T10:43:52.975971+0000","last_became_peered":"2023-12-04T10:43:52.975971+0000","last_unstale":"2023-12-04T10:43:58.021434+0000","last_undegraded":"2023-12-04T10:43:58.021434+0000","last_fullsized":"2023-12-04T10:43:58.021434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.029916+0000","last_change":"2023-12-04T10:43:52.982380+0000","last_active":"2023-12-04T10:43:58.029916+0000","last_peered":"2023-12-04T10:43:58.029916+0000","last_clean":"2023-12-04T10:43:58.029916+0000","last_became_active":"2023-12-04T10:43:52.981200+0000","last_became_peered":"2023-12-04T10:43:52.981200+0000","last_unstale":"2023-12-04T10:43:58.029916+0000","last_undegraded":"2023-12-04T10:43:58.029916+0000","last_fullsized":"2023-12-04T10:43:58.029916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:35:52.376732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.050824+0000","last_change":"2023-12-04T10:43:52.987443+0000","last_active":"2023-12-04T10:43:58.050824+0000","last_peered":"2023-12-04T10:43:58.050824+0000","last_clean":"2023-12-04T10:43:58.050824+0000","last_became_active":"2023-12-04T10:43:52.987177+0000","last_became_peered":"2023-12-04T10:43:52.987177+0000","last_unstale":"2023-12-04T10:43:58.050824+0000","last_undegraded":"2023-12-04T10:43:58.050824+0000","last_fullsized":"2023-12-04T10:43:58.050824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.023146+0000","last_change":"2023-12-04T10:43:52.986477+0000","last_active":"2023-12-04T10:43:58.023146+0000","last_peered":"2023-12-04T10:43:58.023146+0000","last_clean":"2023-12-04T10:43:58.023146+0000","last_became_active":"2023-12-04T10:43:52.986072+0000","last_became_peered":"2023-12-04T10:43:52.986072+0000","last_unstale":"2023-12-04T10:43:58.023146+0000","last_undegraded":"2023-12-04T10:43:58.023146+0000","last_fullsized":"2023-12-04T10:43:58.023146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033092+0000","last_change":"2023-12-04T10:43:52.993638+0000","last_active":"2023-12-04T10:43:58.033092+0000","last_peered":"2023-12-04T10:43:58.033092+0000","last_clean":"2023-12-04T10:43:58.033092+0000","last_became_active":"2023-12-04T10:43:52.993364+0000","last_became_peered":"2023-12-04T10:43:52.993364+0000","last_unstale":"2023-12-04T10:43:58.033092+0000","last_undegraded":"2023-12-04T10:43:58.033092+0000","last_fullsized":"2023-12-04T10:43:58.033092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022326+0000","last_change":"2023-12-04T10:43:52.986640+0000","last_active":"2023-12-04T10:43:58.022326+0000","last_peered":"2023-12-04T10:43:58.022326+0000","last_clean":"2023-12-04T10:43:58.022326+0000","last_became_active":"2023-12-04T10:43:52.983310+0000","last_became_peered":"2023-12-04T10:43:52.983310+0000","last_unstale":"2023-12-04T10:43:58.022326+0000","last_undegraded":"2023-12-04T10:43:58.022326+0000","last_fullsized":"2023-12-04T10:43:58.022326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034400+0000","last_change":"2023-12-04T10:43:52.982396+0000","last_active":"2023-12-04T10:43:58.034400+0000","last_peered":"2023-12-04T10:43:58.034400+0000","last_clean":"2023-12-04T10:43:58.034400+0000","last_became_active":"2023-12-04T10:43:52.980007+0000","last_became_peered":"2023-12-04T10:43:52.980007+0000","last_unstale":"2023-12-04T10:43:58.034400+0000","last_undegraded":"2023-12-04T10:43:58.034400+0000","last_fullsized":"2023-12-04T10:43:58.034400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037514+0000","last_change":"2023-12-04T10:43:52.979531+0000","last_active":"2023-12-04T10:43:58.037514+0000","last_peered":"2023-12-04T10:43:58.037514+0000","last_clean":"2023-12-04T10:43:58.037514+0000","last_became_active":"2023-12-04T10:43:52.979210+0000","last_became_peered":"2023-12-04T10:43:52.979210+0000","last_unstale":"2023-12-04T10:43:58.037514+0000","last_undegraded":"2023-12-04T10:43:58.037514+0000","last_fullsized":"2023-12-04T10:43:58.037514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:14:33.669944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048898+0000","last_change":"2023-12-04T10:43:52.986872+0000","last_active":"2023-12-04T10:43:58.048898+0000","last_peered":"2023-12-04T10:43:58.048898+0000","last_clean":"2023-12-04T10:43:58.048898+0000","last_became_active":"2023-12-04T10:43:52.981778+0000","last_became_peered":"2023-12-04T10:43:52.981778+0000","last_unstale":"2023-12-04T10:43:58.048898+0000","last_undegraded":"2023-12-04T10:43:58.048898+0000","last_fullsized":"2023-12-04T10:43:58.048898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219648+0000","last_change":"2023-12-04T10:43:52.985981+0000","last_active":"2023-12-04T10:43:58.219648+0000","last_peered":"2023-12-04T10:43:58.219648+0000","last_clean":"2023-12-04T10:43:58.219648+0000","last_became_active":"2023-12-04T10:43:52.982061+0000","last_became_peered":"2023-12-04T10:43:52.982061+0000","last_unstale":"2023-12-04T10:43:58.219648+0000","last_undegraded":"2023-12-04T10:43:58.219648+0000","last_fullsized":"2023-12-04T10:43:58.219648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:40.024910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.046541+0000","last_change":"2023-12-04T10:43:52.973616+0000","last_active":"2023-12-04T10:43:58.046541+0000","last_peered":"2023-12-04T10:43:58.046541+0000","last_clean":"2023-12-04T10:43:58.046541+0000","last_became_active":"2023-12-04T10:43:52.973295+0000","last_became_peered":"2023-12-04T10:43:52.973295+0000","last_unstale":"2023-12-04T10:43:58.046541+0000","last_undegraded":"2023-12-04T10:43:58.046541+0000","last_fullsized":"2023-12-04T10:43:58.046541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:57:45.678858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041620+0000","last_change":"2023-12-04T10:43:52.988142+0000","last_active":"2023-12-04T10:43:58.041620+0000","last_peered":"2023-12-04T10:43:58.041620+0000","last_clean":"2023-12-04T10:43:58.041620+0000","last_became_active":"2023-12-04T10:43:52.979726+0000","last_became_peered":"2023-12-04T10:43:52.979726+0000","last_unstale":"2023-12-04T10:43:58.041620+0000","last_undegraded":"2023-12-04T10:43:58.041620+0000","last_fullsized":"2023-12-04T10:43:58.041620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:54.689876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.032829+0000","last_change":"2023-12-04T10:43:52.979067+0000","last_active":"2023-12-04T10:43:58.032829+0000","last_peered":"2023-12-04T10:43:58.032829+0000","last_clean":"2023-12-04T10:43:58.032829+0000","last_became_active":"2023-12-04T10:43:52.978720+0000","last_became_peered":"2023-12-04T10:43:52.978720+0000","last_unstale":"2023-12-04T10:43:58.032829+0000","last_undegraded":"2023-12-04T10:43:58.032829+0000","last_fullsized":"2023-12-04T10:43:58.032829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030859+0000","last_change":"2023-12-04T10:43:52.976129+0000","last_active":"2023-12-04T10:43:58.030859+0000","last_peered":"2023-12-04T10:43:58.030859+0000","last_clean":"2023-12-04T10:43:58.030859+0000","last_became_active":"2023-12-04T10:43:52.975844+0000","last_became_peered":"2023-12-04T10:43:52.975844+0000","last_unstale":"2023-12-04T10:43:58.030859+0000","last_undegraded":"2023-12-04T10:43:58.030859+0000","last_fullsized":"2023-12-04T10:43:58.030859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:37:49.291916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033802+0000","last_change":"2023-12-04T10:43:52.984631+0000","last_active":"2023-12-04T10:43:58.033802+0000","last_peered":"2023-12-04T10:43:58.033802+0000","last_clean":"2023-12-04T10:43:58.033802+0000","last_became_active":"2023-12-04T10:43:52.984276+0000","last_became_peered":"2023-12-04T10:43:52.984276+0000","last_unstale":"2023-12-04T10:43:58.033802+0000","last_undegraded":"2023-12-04T10:43:58.033802+0000","last_fullsized":"2023-12-04T10:43:58.033802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:53:19.937888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020905+0000","last_change":"2023-12-04T10:43:52.978860+0000","last_active":"2023-12-04T10:43:58.020905+0000","last_peered":"2023-12-04T10:43:58.020905+0000","last_clean":"2023-12-04T10:43:58.020905+0000","last_became_active":"2023-12-04T10:43:52.978564+0000","last_became_peered":"2023-12-04T10:43:52.978564+0000","last_unstale":"2023-12-04T10:43:58.020905+0000","last_undegraded":"2023-12-04T10:43:58.020905+0000","last_fullsized":"2023-12-04T10:43:58.020905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.038398+0000","last_change":"2023-12-04T10:43:52.973000+0000","last_active":"2023-12-04T10:43:58.038398+0000","last_peered":"2023-12-04T10:43:58.038398+0000","last_clean":"2023-12-04T10:43:58.038398+0000","last_became_active":"2023-12-04T10:43:52.972621+0000","last_became_peered":"2023-12-04T10:43:52.972621+0000","last_unstale":"2023-12-04T10:43:58.038398+0000","last_undegraded":"2023-12-04T10:43:58.038398+0000","last_fullsized":"2023-12-04T10:43:58.038398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:57:45.678858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049439+0000","last_change":"2023-12-04T10:43:52.982066+0000","last_active":"2023-12-04T10:43:58.049439+0000","last_peered":"2023-12-04T10:43:58.049439+0000","last_clean":"2023-12-04T10:43:58.049439+0000","last_became_active":"2023-12-04T10:43:52.981727+0000","last_became_peered":"2023-12-04T10:43:52.981727+0000","last_unstale":"2023-12-04T10:43:58.049439+0000","last_undegraded":"2023-12-04T10:43:58.049439+0000","last_fullsized":"2023-12-04T10:43:58.049439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.050796+0000","last_change":"2023-12-04T10:43:52.983361+0000","last_active":"2023-12-04T10:43:58.050796+0000","last_peered":"2023-12-04T10:43:58.050796+0000","last_clean":"2023-12-04T10:43:58.050796+0000","last_became_active":"2023-12-04T10:43:52.983081+0000","last_became_peered":"2023-12-04T10:43:52.983081+0000","last_unstale":"2023-12-04T10:43:58.050796+0000","last_undegraded":"2023-12-04T10:43:58.050796+0000","last_fullsized":"2023-12-04T10:43:58.050796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.221587+0000","last_change":"2023-12-04T10:43:52.994001+0000","last_active":"2023-12-04T10:43:58.221587+0000","last_peered":"2023-12-04T10:43:58.221587+0000","last_clean":"2023-12-04T10:43:58.221587+0000","last_became_active":"2023-12-04T10:43:52.993633+0000","last_became_peered":"2023-12-04T10:43:52.993633+0000","last_unstale":"2023-12-04T10:43:58.221587+0000","last_undegraded":"2023-12-04T10:43:58.221587+0000","last_fullsized":"2023-12-04T10:43:58.221587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:50:20.802003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020739+0000","last_change":"2023-12-04T10:43:52.988344+0000","last_active":"2023-12-04T10:43:58.020739+0000","last_peered":"2023-12-04T10:43:58.020739+0000","last_clean":"2023-12-04T10:43:58.020739+0000","last_became_active":"2023-12-04T10:43:52.988051+0000","last_became_peered":"2023-12-04T10:43:52.988051+0000","last_unstale":"2023-12-04T10:43:58.020739+0000","last_undegraded":"2023-12-04T10:43:58.020739+0000","last_fullsized":"2023-12-04T10:43:58.020739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.213667+0000","last_change":"2023-12-04T10:43:52.977848+0000","last_active":"2023-12-04T10:43:58.213667+0000","last_peered":"2023-12-04T10:43:58.213667+0000","last_clean":"2023-12-04T10:43:58.213667+0000","last_became_active":"2023-12-04T10:43:52.977443+0000","last_became_peered":"2023-12-04T10:43:52.977443+0000","last_unstale":"2023-12-04T10:43:58.213667+0000","last_undegraded":"2023-12-04T10:43:58.213667+0000","last_fullsized":"2023-12-04T10:43:58.213667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034180+0000","last_change":"2023-12-04T10:43:52.978013+0000","last_active":"2023-12-04T10:43:58.034180+0000","last_peered":"2023-12-04T10:43:58.034180+0000","last_clean":"2023-12-04T10:43:58.034180+0000","last_became_active":"2023-12-04T10:43:52.976233+0000","last_became_peered":"2023-12-04T10:43:52.976233+0000","last_unstale":"2023-12-04T10:43:58.034180+0000","last_undegraded":"2023-12-04T10:43:58.034180+0000","last_fullsized":"2023-12-04T10:43:58.034180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216255+0000","last_change":"2023-12-04T10:43:52.987505+0000","last_active":"2023-12-04T10:43:58.216255+0000","last_peered":"2023-12-04T10:43:58.216255+0000","last_clean":"2023-12-04T10:43:58.216255+0000","last_became_active":"2023-12-04T10:43:52.982436+0000","last_became_peered":"2023-12-04T10:43:52.982436+0000","last_unstale":"2023-12-04T10:43:58.216255+0000","last_undegraded":"2023-12-04T10:43:58.216255+0000","last_fullsized":"2023-12-04T10:43:58.216255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040439+0000","last_change":"2023-12-04T10:43:52.988667+0000","last_active":"2023-12-04T10:43:58.040439+0000","last_peered":"2023-12-04T10:43:58.040439+0000","last_clean":"2023-12-04T10:43:58.040439+0000","last_became_active":"2023-12-04T10:43:52.988296+0000","last_became_peered":"2023-12-04T10:43:52.988296+0000","last_unstale":"2023-12-04T10:43:58.040439+0000","last_undegraded":"2023-12-04T10:43:58.040439+0000","last_fullsized":"2023-12-04T10:43:58.040439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037780+0000","last_change":"2023-12-04T10:43:52.983801+0000","last_active":"2023-12-04T10:43:58.037780+0000","last_peered":"2023-12-04T10:43:58.037780+0000","last_clean":"2023-12-04T10:43:58.037780+0000","last_became_active":"2023-12-04T10:43:52.981238+0000","last_became_peered":"2023-12-04T10:43:52.981238+0000","last_unstale":"2023-12-04T10:43:58.037780+0000","last_undegraded":"2023-12-04T10:43:58.037780+0000","last_fullsized":"2023-12-04T10:43:58.037780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030806+0000","last_change":"2023-12-04T10:43:52.978663+0000","last_active":"2023-12-04T10:43:58.030806+0000","last_peered":"2023-12-04T10:43:58.030806+0000","last_clean":"2023-12-04T10:43:58.030806+0000","last_became_active":"2023-12-04T10:43:52.978251+0000","last_became_peered":"2023-12-04T10:43:52.978251+0000","last_unstale":"2023-12-04T10:43:58.030806+0000","last_undegraded":"2023-12-04T10:43:58.030806+0000","last_fullsized":"2023-12-04T10:43:58.030806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:17:51.617229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.220292+0000","last_change":"2023-12-04T10:43:52.985634+0000","last_active":"2023-12-04T10:43:58.220292+0000","last_peered":"2023-12-04T10:43:58.220292+0000","last_clean":"2023-12-04T10:43:58.220292+0000","last_became_active":"2023-12-04T10:43:52.981676+0000","last_became_peered":"2023-12-04T10:43:52.981676+0000","last_unstale":"2023-12-04T10:43:58.220292+0000","last_undegraded":"2023-12-04T10:43:58.220292+0000","last_fullsized":"2023-12-04T10:43:58.220292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:32:44.930072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509449,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":702921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3180000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2609999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.722}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5840000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.841}]}]},{"osd":5,"up_from":15,"seq":64424509448,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":112061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.109}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.486}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.536}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.97}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.901}]}]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3029999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.583}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6439999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5509999999999999}]}]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":702977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5609999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8029999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6259999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":112097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.323}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.208}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5529999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":111971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5649999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.169}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.681}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.619}]}]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.296}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2629999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T10:44:24.053 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T10:44:24.053 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-04T10:44:24.053 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-04T10:44:24.053 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-04T10:44:24.053 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-04T10:44:24.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.317+0000 7f295d1b6640 1 Processor -- start 2023-12-04T10:44:24.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.317+0000 7f295d1b6640 1 -- start start 2023-12-04T10:44:24.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.319+0000 7f295d1b6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29580701b0 0x7f29580705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.319+0000 7f295d1b6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f29580ca290 0x7f29580ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.319+0000 7f295d1b6640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2958070b00 con 0x7f2958144a00 2023-12-04T10:44:24.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.319+0000 7f295d1b6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29580cabe0 con 0x7f29580701b0 2023-12-04T10:44:24.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.319+0000 7f295d1b6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29580cae80 con 0x7f29580ca290 2023-12-04T10:44:24.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.319+0000 7f2956d9d640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2958144a00 0x7f29580b1e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43720/0 (socket says 172.21.15.63:43720) 2023-12-04T10:44:24.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.319+0000 7f2956d9d640 1 -- 172.21.15.63:0/3284141563 learned_addr learned my addr 172.21.15.63:0/3284141563 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:24.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.319+0000 7f295659c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f29580701b0 0x7f29580705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.320+0000 7f295759e640 1 --2- 172.21.15.63:0/3284141563 >> v2:172.21.15.66:3300/0 conn(0x7f29580ca290 0x7f29580ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.320+0000 7f295659c640 1 -- 172.21.15.63:0/3284141563 >> v2:172.21.15.66:3300/0 conn(0x7f29580ca290 msgr2=0x7f29580ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.320+0000 7f295659c640 1 --2- 172.21.15.63:0/3284141563 >> v2:172.21.15.66:3300/0 conn(0x7f29580ca290 0x7f29580ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.320+0000 7f295659c640 1 -- 172.21.15.63:0/3284141563 >> v1:172.21.15.63:6789/0 conn(0x7f2958144a00 legacy=0x7f29580b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.320+0000 7f295659c640 1 -- 172.21.15.63:0/3284141563 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f295806c460 con 0x7f29580701b0 2023-12-04T10:44:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.320+0000 7f2955d9b640 1 -- 172.21.15.63:0/3284141563 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539122392 0 0) 0x7f2958070b00 con 0x7f2958144a00 2023-12-04T10:44:24.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.320+0000 7f295759e640 1 --2- 172.21.15.63:0/3284141563 >> v2:172.21.15.66:3300/0 conn(0x7f29580ca290 0x7f29580ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.321+0000 7f295659c640 1 --2- 172.21.15.63:0/3284141563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29580705c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2958071990 tx=0x7f294c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03667b8c6d0686b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.321+0000 7f2955d9b640 1 -- 172.21.15.63:0/3284141563 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c031830 con 0x7f29580701b0 2023-12-04T10:44:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.321+0000 7f2955d9b640 1 -- 172.21.15.63:0/3284141563 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c031990 con 0x7f29580701b0 2023-12-04T10:44:24.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.321+0000 7f2955d9b640 1 -- 172.21.15.63:0/3284141563 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c031d20 con 0x7f29580701b0 2023-12-04T10:44:24.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.322+0000 7f295d1b6640 1 -- 172.21.15.63:0/3284141563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 msgr2=0x7f29580705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.322+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3284141563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29580705c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2958071990 tx=0x7f294c02b8d0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.322+0000 7f295d1b6640 1 -- 172.21.15.63:0/3284141563 shutdown_connections 2023-12-04T10:44:24.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.322+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3284141563 >> v2:172.21.15.66:3300/0 conn(0x7f29580ca290 0x7f29580ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.322+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3284141563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29580705c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.322+0000 7f295d1b6640 1 -- 172.21.15.63:0/3284141563 >> 172.21.15.63:0/3284141563 conn(0x7f29580cee80 msgr2=0x7f29580cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:24.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.322+0000 7f295d1b6640 1 -- 172.21.15.63:0/3284141563 shutdown_connections 2023-12-04T10:44:24.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.322+0000 7f295d1b6640 1 -- 172.21.15.63:0/3284141563 wait complete. 2023-12-04T10:44:24.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.324+0000 7f295d1b6640 1 Processor -- start 2023-12-04T10:44:24.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.324+0000 7f295d1b6640 1 -- start start 2023-12-04T10:44:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f295d1b6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29581334a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f295d1b6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29580ca290 0x7f2958133c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f295d1b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2958144a00 0x7f2958135d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f295d1b6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29581339e0 con 0x7f29580701b0 2023-12-04T10:44:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f295d1b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2958134740 con 0x7f2958144a00 2023-12-04T10:44:24.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f295d1b6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2958134a20 con 0x7f29580ca290 2023-12-04T10:44:24.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f2956d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29581334a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f2956d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29581334a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34274/0 (socket says 172.21.15.63:34274) 2023-12-04T10:44:24.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.325+0000 7f2956d9d640 1 -- 172.21.15.63:0/3292213714 learned_addr learned my addr 172.21.15.63:0/3292213714 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:24.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f295759e640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2958144a00 0x7f2958135d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f295659c640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29580ca290 0x7f2958133c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f2956d9d640 1 -- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29580ca290 msgr2=0x7f2958133c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f2956d9d640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29580ca290 0x7f2958133c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f2956d9d640 1 -- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2958144a00 msgr2=0x7f2958135d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f2956d9d640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2958144a00 0x7f2958135d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f2956d9d640 1 -- 172.21.15.63:0/3292213714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f294c009400 con 0x7f29580701b0 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f295759e640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2958144a00 0x7f2958135d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f295659c640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29580ca290 0x7f2958133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f2956d9d640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29581334a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f294800c430 tx=0x7f294800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f293f7fe640 1 -- 172.21.15.63:0/3292213714 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29480074e0 con 0x7f29580701b0 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f293f7fe640 1 -- 172.21.15.63:0/3292213714 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2948007660 con 0x7f29580701b0 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f293f7fe640 1 -- 172.21.15.63:0/3292213714 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2948004a20 con 0x7f29580701b0 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.326+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2958134d00 con 0x7f29580701b0 2023-12-04T10:44:24.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.327+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29581352c0 con 0x7f29580701b0 2023-12-04T10:44:24.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.328+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29581354b0 con 0x7f29580701b0 2023-12-04T10:44:24.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.329+0000 7f293f7fe640 1 -- 172.21.15.63:0/3292213714 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2948004b80 con 0x7f29580701b0 2023-12-04T10:44:24.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.330+0000 7f293f7fe640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f294406ae40 0x7f294406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.330+0000 7f293f7fe640 1 -- 172.21.15.63:0/3292213714 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f29480897d0 con 0x7f29580701b0 2023-12-04T10:44:24.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.330+0000 7f295659c640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f294406ae40 0x7f294406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.331+0000 7f295659c640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f294406ae40 0x7f294406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f294c036000 tx=0x7f294c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:24.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.334+0000 7f293f7fe640 1 -- 172.21.15.63:0/3292213714 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f29480544f0 con 0x7f29580701b0 2023-12-04T10:44:24.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.577+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f2958068710 con 0x7f29580701b0 2023-12-04T10:44:24.588 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.586+0000 7f293f7fe640 1 -- 172.21.15.63:0/3292213714 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171032 (secure 0 0 0) 0x7f2948057b10 con 0x7f29580701b0 2023-12-04T10:44:24.589 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f294406ae40 msgr2=0x7f294406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f294406ae40 0x7f294406d300 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f294c036000 tx=0x7f294c008030 comp rx=0 tx=0).stop 2023-12-04T10:44:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 msgr2=0x7f29581334a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29581334a0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f294800c430 tx=0x7f294800c8f0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 shutdown_connections 2023-12-04T10:44:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f294406ae40 0x7f294406d300 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f29580ca290 0x7f2958133c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2958144a00 0x7f2958135d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 --2- 172.21.15.63:0/3292213714 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f29580701b0 0x7f29581334a0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 >> 172.21.15.63:0/3292213714 conn(0x7f29580cee80 msgr2=0x7f29580cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 shutdown_connections 2023-12-04T10:44:24.594 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.591+0000 7f295d1b6640 1 -- 172.21.15.63:0/3292213714 wait complete. 2023-12-04T10:44:24.614 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":5,"active_gid":4107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6832","nonce":2779630096},{"type":"v1","addr":"172.21.15.63:6833","nonce":2779630096}]},"active_addr":"172.21.15.63:6833/2779630096","active_change":"2023-12-04T10:43:37.942842+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4101,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":4121492289}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":4130985027}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":3347173604}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.63:0","nonce":1118965377}]}]} 2023-12-04T10:44:24.617 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-04T10:44:24.617 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-04T10:44:24.617 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:24.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.839+0000 7fe9dbfff640 1 Processor -- start 2023-12-04T10:44:24.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.839+0000 7fe9dbfff640 1 -- start start 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.840+0000 7fe9dbfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9dc151ca0 0x7fe9dc06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc15b470 0x7fe9dc0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9dbfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe9dc06e0b0 0x7fe9dc0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9dbfff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0cc7f0 con 0x7fe9dc151ca0 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9dbfff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9dc0cca40 con 0x7fe9dc06e0b0 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9dbfff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0ccd20 con 0x7fe9dc15b470 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9daffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9dc151ca0 0x7fe9dc06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9daffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe9dc151ca0 0x7fe9dc06db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34290/0 (socket says 172.21.15.63:34290) 2023-12-04T10:44:24.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9daffd640 1 -- 172.21.15.63:0/2582914273 learned_addr learned my addr 172.21.15.63:0/2582914273 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:24.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9db7fe640 1 --2- 172.21.15.63:0/2582914273 >> v2:172.21.15.66:3300/0 conn(0x7fe9dc06e0b0 0x7fe9dc0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9d3fff640 1 --2- 172.21.15.63:0/2582914273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc15b470 0x7fe9dc0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9daffd640 1 -- 172.21.15.63:0/2582914273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc15b470 msgr2=0x7fe9dc0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:24.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9daffd640 1 --2- 172.21.15.63:0/2582914273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc15b470 0x7fe9dc0cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9daffd640 1 -- 172.21.15.63:0/2582914273 >> v2:172.21.15.66:3300/0 conn(0x7fe9dc06e0b0 msgr2=0x7fe9dc0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:24.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9daffd640 1 --2- 172.21.15.63:0/2582914273 >> v2:172.21.15.66:3300/0 conn(0x7fe9dc06e0b0 0x7fe9dc0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9daffd640 1 -- 172.21.15.63:0/2582914273 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9dc0cd000 con 0x7fe9dc151ca0 2023-12-04T10:44:24.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9d3fff640 1 --2- 172.21.15.63:0/2582914273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc15b470 0x7fe9dc0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:24.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.841+0000 7fe9db7fe640 1 --2- 172.21.15.63:0/2582914273 >> v2:172.21.15.66:3300/0 conn(0x7fe9dc06e0b0 0x7fe9dc0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:24.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.843+0000 7fe9daffd640 1 --2- 172.21.15.63:0/2582914273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc151ca0 0x7fe9dc06db70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0cdb10 tx=0x7fe9cc02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a440f0f5b615fd23 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:24.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.843+0000 7fe9da7fc640 1 -- 172.21.15.63:0/2582914273 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0317d0 con 0x7fe9dc151ca0 2023-12-04T10:44:24.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.843+0000 7fe9da7fc640 1 -- 172.21.15.63:0/2582914273 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc031930 con 0x7fe9dc151ca0 2023-12-04T10:44:24.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.843+0000 7fe9da7fc640 1 -- 172.21.15.63:0/2582914273 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc031cc0 con 0x7fe9dc151ca0 2023-12-04T10:44:24.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.843+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2582914273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc151ca0 msgr2=0x7fe9dc06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.843+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2582914273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc151ca0 0x7fe9dc06db70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc0cdb10 tx=0x7fe9cc02b870 comp rx=0 tx=0).stop 2023-12-04T10:44:24.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.844+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2582914273 shutdown_connections 2023-12-04T10:44:24.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.844+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2582914273 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc15b470 0x7fe9dc0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.844+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2582914273 >> v2:172.21.15.66:3300/0 conn(0x7fe9dc06e0b0 0x7fe9dc0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.844+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2582914273 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc151ca0 0x7fe9dc06db70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.844+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2582914273 >> 172.21.15.63:0/2582914273 conn(0x7fe9dc0b07f0 msgr2=0x7fe9dc0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:24.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.844+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2582914273 shutdown_connections 2023-12-04T10:44:24.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.844+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2582914273 wait complete. 2023-12-04T10:44:24.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.845+0000 7fe9dbfff640 1 Processor -- start 2023-12-04T10:44:24.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.846+0000 7fe9dbfff640 1 -- start start 2023-12-04T10:44:24.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc06e0b0 0x7fe9dc0c87b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9dc151ca0 0x7fe9dc159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9dbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc15a3b0 0x7fe9dc1f60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9dbfff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc15a860 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9dbfff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c6500 con 0x7fe9dc151ca0 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9dbfff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9dc0c3500 con 0x7fe9dc06e0b0 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc15a3b0 0x7fe9dc1f60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9db7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc15a3b0 0x7fe9dc1f60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34296/0 (socket says 172.21.15.63:34296) 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9db7fe640 1 -- 172.21.15.63:0/2545839816 learned_addr learned my addr 172.21.15.63:0/2545839816 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9d3fff640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9dc151ca0 0x7fe9dc159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9daffd640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc06e0b0 0x7fe9dc0c87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9db7fe640 1 -- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc06e0b0 msgr2=0x7fe9dc0c87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9db7fe640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc06e0b0 0x7fe9dc0c87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9db7fe640 1 -- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9dc151ca0 msgr2=0x7fe9dc159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:24.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9db7fe640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9dc151ca0 0x7fe9dc159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:24.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9db7fe640 1 -- 172.21.15.63:0/2545839816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc0094d0 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.847+0000 7fe9d3fff640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9dc151ca0 0x7fe9dc159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:24.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.848+0000 7fe9db7fe640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc15a3b0 0x7fe9dc1f60f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400ceb0 tx=0x7fe9d400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:24.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.848+0000 7fe9d37fe640 1 -- 172.21.15.63:0/2545839816 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400d840 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.848+0000 7fe9d37fe640 1 -- 172.21.15.63:0/2545839816 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d400d9a0 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.848+0000 7fe9d37fe640 1 -- 172.21.15.63:0/2545839816 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d400dd50 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.848+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9dc1f6e00 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.848+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9dc0c6190 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.850+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9dc0c5cf0 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.851+0000 7fe9d37fe640 1 -- 172.21.15.63:0/2545839816 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe9d401e3b0 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.851+0000 7fe9d37fe640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe9bc06ae40 0x7fe9bc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:24.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.852+0000 7fe9d37fe640 1 -- 172.21.15.63:0/2545839816 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe9d408a380 con 0x7fe9dc15a3b0 2023-12-04T10:44:24.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.852+0000 7fe9daffd640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe9bc06ae40 0x7fe9bc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:24.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.853+0000 7fe9daffd640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe9bc06ae40 0x7fe9bc06d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc036000 tx=0x7fe9cc03d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:24.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:24.856+0000 7fe9d37fe640 1 -- 172.21.15.63:0/2545839816 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe9d4055140 con 0x7fe9dc15a3b0 2023-12-04T10:44:25.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.059+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9dc04e840 con 0x7fe9dc15a3b0 2023-12-04T10:44:25.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.062+0000 7fe9d37fe640 1 -- 172.21.15.63:0/2545839816 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fe9d4058760 con 0x7fe9dc15a3b0 2023-12-04T10:44:25.064 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:25.065 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:25.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.065+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe9bc06ae40 msgr2=0x7fe9bc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.065+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe9bc06ae40 0x7fe9bc06d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc036000 tx=0x7fe9cc03d040 comp rx=0 tx=0).stop 2023-12-04T10:44:25.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.065+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc15a3b0 msgr2=0x7fe9dc1f60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.065+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc15a3b0 0x7fe9dc1f60f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe9d400ceb0 tx=0x7fe9d400a710 comp rx=0 tx=0).stop 2023-12-04T10:44:25.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.066+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 shutdown_connections 2023-12-04T10:44:25.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.066+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe9bc06ae40 0x7fe9bc06d300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.066+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe9dc15a3b0 0x7fe9dc1f60f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.066+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe9dc151ca0 0x7fe9dc159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.066+0000 7fe9dbfff640 1 --2- 172.21.15.63:0/2545839816 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe9dc06e0b0 0x7fe9dc0c87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.066+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 >> 172.21.15.63:0/2545839816 conn(0x7fe9dc0b07f0 msgr2=0x7fe9dc0b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.066+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 shutdown_connections 2023-12-04T10:44:25.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.066+0000 7fe9dbfff640 1 -- 172.21.15.63:0/2545839816 wait complete. 2023-12-04T10:44:25.088 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-04T10:44:25.088 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:25.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.303+0000 7fbe5fffb640 1 Processor -- start 2023-12-04T10:44:25.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.303+0000 7fbe5fffb640 1 -- start start 2023-12-04T10:44:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.305+0000 7fbe5fffb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580724e0 0x7fbe580ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.305+0000 7fbe5fffb640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe580ce210 0x7fbe5806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.305+0000 7fbe5fffb640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe580ca930 con 0x7fbe58143b60 2023-12-04T10:44:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.305+0000 7fbe5fffb640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe580cb5b0 con 0x7fbe580ce210 2023-12-04T10:44:25.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.305+0000 7fbe5fffb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580cac10 con 0x7fbe580724e0 2023-12-04T10:44:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.306+0000 7fbe5e598640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe580ce210 0x7fbe5806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.306+0000 7fbe5e598640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fbe580ce210 0x7fbe5806c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34310/0 (socket says 172.21.15.63:34310) 2023-12-04T10:44:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.306+0000 7fbe5e598640 1 -- 172.21.15.63:0/844453660 learned_addr learned my addr 172.21.15.63:0/844453660 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.306+0000 7fbe5d596640 1 --2- 172.21.15.63:0/844453660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580724e0 0x7fbe580ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.306+0000 7fbe5e598640 1 -- 172.21.15.63:0/844453660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580724e0 msgr2=0x7fbe580ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.306+0000 7fbe5e598640 1 --2- 172.21.15.63:0/844453660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580724e0 0x7fbe580ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.306+0000 7fbe5e598640 1 -- 172.21.15.63:0/844453660 >> v1:172.21.15.66:6789/0 conn(0x7fbe58143b60 legacy=0x7fbe580cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.306+0000 7fbe5e598640 1 -- 172.21.15.63:0/844453660 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe580caef0 con 0x7fbe580ce210 2023-12-04T10:44:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.308+0000 7fbe5e598640 1 --2- 172.21.15.63:0/844453660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe580ce210 0x7fbe5806c560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009e50 tx=0x7fbe5002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d51d89c3b81c700 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.308+0000 7fbe5cd95640 1 -- 172.21.15.63:0/844453660 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5002ca70 con 0x7fbe580ce210 2023-12-04T10:44:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.308+0000 7fbe5cd95640 1 -- 172.21.15.63:0/844453660 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5002cbd0 con 0x7fbe580ce210 2023-12-04T10:44:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.308+0000 7fbe5cd95640 1 -- 172.21.15.63:0/844453660 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe500343f0 con 0x7fbe580ce210 2023-12-04T10:44:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.308+0000 7fbe5fffb640 1 -- 172.21.15.63:0/844453660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe580ce210 msgr2=0x7fbe5806c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.308+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/844453660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe580ce210 0x7fbe5806c560 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009e50 tx=0x7fbe5002bed0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.309+0000 7fbe5fffb640 1 -- 172.21.15.63:0/844453660 shutdown_connections 2023-12-04T10:44:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.309+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/844453660 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe580ce210 0x7fbe5806c560 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.309+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/844453660 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580724e0 0x7fbe580ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.309+0000 7fbe5fffb640 1 -- 172.21.15.63:0/844453660 >> 172.21.15.63:0/844453660 conn(0x7fbe580cee80 msgr2=0x7fbe580cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.309+0000 7fbe5fffb640 1 -- 172.21.15.63:0/844453660 shutdown_connections 2023-12-04T10:44:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.309+0000 7fbe5fffb640 1 -- 172.21.15.63:0/844453660 wait complete. 2023-12-04T10:44:25.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.311+0000 7fbe5fffb640 1 Processor -- start 2023-12-04T10:44:25.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.311+0000 7fbe5fffb640 1 -- start start 2023-12-04T10:44:25.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5fffb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580ce210 0x7fbe580ad6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5fffb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe58143b60 0x7fbe58138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5fffb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe5815cb70 0x7fbe580aab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5fffb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe58138f90 con 0x7fbe58143b60 2023-12-04T10:44:25.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5fffb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580add40 con 0x7fbe5815cb70 2023-12-04T10:44:25.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5fffb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe580ae020 con 0x7fbe580ce210 2023-12-04T10:44:25.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5d596640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe58143b60 0x7fbe58138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5d596640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe58143b60 0x7fbe58138a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34322/0 (socket says 172.21.15.63:34322) 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.312+0000 7fbe5d596640 1 -- 172.21.15.63:0/1189357605 learned_addr learned my addr 172.21.15.63:0/1189357605 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe5d596640 1 -- 172.21.15.63:0/1189357605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580ce210 msgr2=0x7fbe580ad6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe5d596640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580ce210 0x7fbe580ad6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe5d596640 1 -- 172.21.15.63:0/1189357605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe5815cb70 msgr2=0x7fbe580aab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe5d596640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe5815cb70 0x7fbe580aab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe5d596640 1 -- 172.21.15.63:0/1189357605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe50009b30 con 0x7fbe58143b60 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe5d596640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe58143b60 0x7fbe58138a50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800d5f0 tx=0x7fbe4800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe4e7fc640 1 -- 172.21.15.63:0/1189357605 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe480125f0 con 0x7fbe58143b60 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe4e7fc640 1 -- 172.21.15.63:0/1189357605 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe48012750 con 0x7fbe58143b60 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe4e7fc640 1 -- 172.21.15.63:0/1189357605 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe48012b00 con 0x7fbe58143b60 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe580ae300 con 0x7fbe58143b60 2023-12-04T10:44:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.313+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe5815d020 con 0x7fbe58143b60 2023-12-04T10:44:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.315+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe580ae540 con 0x7fbe58143b60 2023-12-04T10:44:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.315+0000 7fbe4e7fc640 1 -- 172.21.15.63:0/1189357605 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbe48012c60 con 0x7fbe58143b60 2023-12-04T10:44:25.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.316+0000 7fbe4e7fc640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbe3c06ae90 0x7fbe3c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.316+0000 7fbe4e7fc640 1 -- 172.21.15.63:0/1189357605 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbe48089c20 con 0x7fbe58143b60 2023-12-04T10:44:25.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.317+0000 7fbe5dd97640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbe3c06ae90 0x7fbe3c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.317+0000 7fbe5dd97640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbe3c06ae90 0x7fbe3c06d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe54003cc0 tx=0x7fbe540079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.321+0000 7fbe4e7fc640 1 -- 172.21.15.63:0/1189357605 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbe48054b50 con 0x7fbe58143b60 2023-12-04T10:44:25.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.515+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe5815d1b0 con 0x7fbe58143b60 2023-12-04T10:44:25.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.518+0000 7fbe4e7fc640 1 -- 172.21.15.63:0/1189357605 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fbe48058170 con 0x7fbe58143b60 2023-12-04T10:44:25.520 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:25.520 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.520+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbe3c06ae90 msgr2=0x7fbe3c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.520+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbe3c06ae90 0x7fbe3c06d350 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe54003cc0 tx=0x7fbe540079b0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.520+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe58143b60 msgr2=0x7fbe58138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.520+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe58143b60 0x7fbe58138a50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fbe4800d5f0 tx=0x7fbe4800dab0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.521+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 shutdown_connections 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.521+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbe3c06ae90 0x7fbe3c06d350 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.521+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbe5815cb70 0x7fbe580aab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.521+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbe58143b60 0x7fbe58138a50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.521+0000 7fbe5fffb640 1 --2- 172.21.15.63:0/1189357605 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbe580ce210 0x7fbe580ad6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.521+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 >> 172.21.15.63:0/1189357605 conn(0x7fbe580cee80 msgr2=0x7fbe58142e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.521+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 shutdown_connections 2023-12-04T10:44:25.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.521+0000 7fbe5fffb640 1 -- 172.21.15.63:0/1189357605 wait complete. 2023-12-04T10:44:25.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-04T10:44:25.541 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-04T10:44:25.541 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-04T10:44:25.542 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-04T10:44:25.542 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-04T10:44:25.542 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-04T10:44:25.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-04T10:44:25.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-04T10:44:25.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.839+0000 7fbda1199640 1 Processor -- start 2023-12-04T10:44:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.839+0000 7fbda1199640 1 -- start start 2023-12-04T10:44:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.841+0000 7fbda1199640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c15d710 0x7fbd9c0ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.841+0000 7fbda1199640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbd9c0d3cd0 0x7fbd9c0b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.841+0000 7fbda1199640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c0cef40 con 0x7fbd9c0d16b0 2023-12-04T10:44:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.841+0000 7fbda1199640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd9c0b25c0 con 0x7fbd9c0d3cd0 2023-12-04T10:44:25.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.841+0000 7fbda1199640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0b28a0 con 0x7fbd9c15d710 2023-12-04T10:44:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.842+0000 7fbd9b7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c15d710 0x7fbd9c0ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.842+0000 7fbd9b7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c15d710 0x7fbd9c0ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48596/0 (socket says 172.21.15.63:48596) 2023-12-04T10:44:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.842+0000 7fbd9b7fe640 1 -- 172.21.15.63:0/2148705141 learned_addr learned my addr 172.21.15.63:0/2148705141 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.842+0000 7fbda0998640 1 --2- 172.21.15.63:0/2148705141 >> v2:172.21.15.66:3300/0 conn(0x7fbd9c0d3cd0 0x7fbd9c0b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.843+0000 7fbd9b7fe640 1 -- 172.21.15.63:0/2148705141 >> v2:172.21.15.66:3300/0 conn(0x7fbd9c0d3cd0 msgr2=0x7fbd9c0b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.843+0000 7fbd9b7fe640 1 --2- 172.21.15.63:0/2148705141 >> v2:172.21.15.66:3300/0 conn(0x7fbd9c0d3cd0 0x7fbd9c0b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.843+0000 7fbd9b7fe640 1 -- 172.21.15.63:0/2148705141 >> v1:172.21.15.66:6789/0 conn(0x7fbd9c0d16b0 legacy=0x7fbd9c0d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.843+0000 7fbd9b7fe640 1 -- 172.21.15.63:0/2148705141 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0b2b80 con 0x7fbd9c15d710 2023-12-04T10:44:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.845+0000 7fbd9b7fe640 1 --2- 172.21.15.63:0/2148705141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c15d710 0x7fbd9c0ce6f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009870 tx=0x7fbd9002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f85175b7f6cd0009 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.846+0000 7fbd9affd640 1 -- 172.21.15.63:0/2148705141 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90031890 con 0x7fbd9c15d710 2023-12-04T10:44:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.846+0000 7fbd9affd640 1 -- 172.21.15.63:0/2148705141 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd900319f0 con 0x7fbd9c15d710 2023-12-04T10:44:25.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.846+0000 7fbd9affd640 1 -- 172.21.15.63:0/2148705141 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd90031dc0 con 0x7fbd9c15d710 2023-12-04T10:44:25.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.847+0000 7fbda1199640 1 -- 172.21.15.63:0/2148705141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c15d710 msgr2=0x7fbd9c0ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.847+0000 7fbda1199640 1 --2- 172.21.15.63:0/2148705141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c15d710 0x7fbd9c0ce6f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009870 tx=0x7fbd9002b930 comp rx=0 tx=0).stop 2023-12-04T10:44:25.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.848+0000 7fbda1199640 1 -- 172.21.15.63:0/2148705141 shutdown_connections 2023-12-04T10:44:25.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.848+0000 7fbda1199640 1 --2- 172.21.15.63:0/2148705141 >> v2:172.21.15.66:3300/0 conn(0x7fbd9c0d3cd0 0x7fbd9c0b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.848+0000 7fbda1199640 1 --2- 172.21.15.63:0/2148705141 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c15d710 0x7fbd9c0ce6f0 secure :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fbd90009870 tx=0x7fbd9002b930 comp rx=0 tx=0).stop 2023-12-04T10:44:25.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.848+0000 7fbda1199640 1 -- 172.21.15.63:0/2148705141 >> 172.21.15.63:0/2148705141 conn(0x7fbd9c0d30d0 msgr2=0x7fbd9c0d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.849+0000 7fbda1199640 1 -- 172.21.15.63:0/2148705141 shutdown_connections 2023-12-04T10:44:25.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.849+0000 7fbda1199640 1 -- 172.21.15.63:0/2148705141 wait complete. 2023-12-04T10:44:25.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.852+0000 7fbda1199640 1 Processor -- start 2023-12-04T10:44:25.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.852+0000 7fbda1199640 1 -- start start 2023-12-04T10:44:25.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.854+0000 7fbda1199640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9c0d16b0 0x7fbd9c14e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.854+0000 7fae23c87640 1 Processor -- start 2023-12-04T10:44:25.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.854+0000 7fbda1199640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c0d3cd0 0x7fbd9c0c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.855+0000 7fbda1199640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd9c0c7610 0x7fbd9c0b7e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.856+0000 7fbd9b7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c0d3cd0 0x7fbd9c0c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.856+0000 7fbda1199640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0c85b0 con 0x7fbd9c0d16b0 2023-12-04T10:44:25.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.856+0000 7fbda1199640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0c7aa0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.856+0000 7fbda1199640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0c7d10 con 0x7fbd9c0d3cd0 2023-12-04T10:44:25.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.856+0000 7fbda0998640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd9c0c7610 0x7fbd9c0b7e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.856+0000 7fbda0998640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd9c0c7610 0x7fbd9c0b7e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54632/0 (socket says 172.21.15.63:54632) 2023-12-04T10:44:25.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.854+0000 7fae23c87640 1 -- start start 2023-12-04T10:44:25.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fae23c87640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fae1c13f940 0x7fae1c15dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fae23c87640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0cd6b0 con 0x7fae1c0ce750 2023-12-04T10:44:25.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fae23c87640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae1c0cd990 con 0x7fae1c0cbc40 2023-12-04T10:44:25.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fae23c87640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae1c0cdc70 con 0x7fae1c13f940 2023-12-04T10:44:25.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fae21222640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fae1c0ce750 0x7fae1c0ccea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43726/0 (socket says 172.21.15.63:43726) 2023-12-04T10:44:25.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.858+0000 7fae21222640 1 -- 172.21.15.63:0/607386938 learned_addr learned my addr 172.21.15.63:0/607386938 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:25.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.856+0000 7fbda0998640 1 -- 172.21.15.63:0/119766795 learned_addr learned my addr 172.21.15.63:0/119766795 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.858+0000 7fae21a23640 1 --2- 172.21.15.63:0/607386938 >> v2:172.21.15.66:3300/0 conn(0x7fae1c13f940 0x7fae1c15dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fbd9bfff640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9c0d16b0 0x7fbd9c14e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fbda0998640 1 -- 172.21.15.63:0/119766795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c0d3cd0 msgr2=0x7fbd9c0c96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fbda0998640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fbd9c0d3cd0 0x7fbd9c0c96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fbda0998640 1 -- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9c0d16b0 msgr2=0x7fbd9c14e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.858+0000 7fae20a21640 1 -- 172.21.15.63:0/607386938 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2741248984 0 0) 0x7fae1c0cd990 con 0x7fae1c0cbc40 2023-12-04T10:44:25.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.858+0000 7fae20a21640 1 -- 172.21.15.63:0/607386938 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae08003520 con 0x7fae1c0cbc40 2023-12-04T10:44:25.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fae20a21640 1 -- 172.21.15.63:0/607386938 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2277991087 0 0) 0x7fae1c0cd6b0 con 0x7fae1c0ce750 2023-12-04T10:44:25.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fae20a21640 1 -- 172.21.15.63:0/607386938 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae1c0cd990 con 0x7fae1c0ce750 2023-12-04T10:44:25.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fbda0998640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fbd9c0d16b0 0x7fbd9c14e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.857+0000 7fbda0998640 1 -- 172.21.15.63:0/119766795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900094d0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.858+0000 7fbda0998640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd9c0c7610 0x7fbd9c0b7e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00d5a0 tx=0x7fbd8c00da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0125f0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c0c7ff0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c0b5dc0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fae20a21640 1 -- 172.21.15.63:0/607386938 <== mon.1 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2197916415 0 0) 0x7fae08003520 con 0x7fae1c0cbc40 2023-12-04T10:44:25.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.860+0000 7f5e77894640 1 Processor -- start 2023-12-04T10:44:25.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.860+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8c012750 con 0x7fbd9c0c7610 2023-12-04T10:44:25.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.860+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0125f0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fae21a23640 1 -- 172.21.15.63:0/607386938 >> v1:172.21.15.66:6789/0 conn(0x7fae1c0cbc40 legacy=0x7fae1c070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fae21a23640 1 -- 172.21.15.63:0/607386938 >> v1:172.21.15.63:6789/0 conn(0x7fae1c0ce750 legacy=0x7fae1c0ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.859+0000 7fae21a23640 1 -- 172.21.15.63:0/607386938 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1c0cdf50 con 0x7fae1c13f940 2023-12-04T10:44:25.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.862+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbd7c000fc0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.862+0000 7fae21a23640 1 --2- 172.21.15.63:0/607386938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae1c13f940 0x7fae1c15dae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae10007190 tx=0x7fae1002ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fb988821c7c9f6b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.860+0000 7f5e77894640 1 -- start start 2023-12-04T10:44:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.862+0000 7f5e77894640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5e7013f940 0x7f5e7015dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.862+0000 7f5e77894640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5e700ce750 0x7f5e700ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.862+0000 7f5e77894640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e700cd3e0 con 0x7f5e700cbc40 2023-12-04T10:44:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.862+0000 7f5e77894640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e700cd6b0 con 0x7f5e700ce750 2023-12-04T10:44:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.862+0000 7f5e77894640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e700cd990 con 0x7f5e7013f940 2023-12-04T10:44:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.863+0000 7fae20a21640 1 -- 172.21.15.63:0/607386938 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae140019f0 con 0x7fae1c13f940 2023-12-04T10:44:25.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.863+0000 7fae20a21640 1 -- 172.21.15.63:0/607386938 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae10008bf0 con 0x7fae1c13f940 2023-12-04T10:44:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.863+0000 7fae20a21640 1 -- 172.21.15.63:0/607386938 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae140019f0 con 0x7fae1c13f940 2023-12-04T10:44:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.863+0000 7f5e75e31640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5e700cbc40 0x7f5e70070220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:52594/0 (socket says 172.21.15.63:52594) 2023-12-04T10:44:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.863+0000 7f5e75e31640 1 -- 172.21.15.63:0/1155424368 learned_addr learned my addr 172.21.15.63:0/1155424368 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.863+0000 7f5e75630640 1 --2- 172.21.15.63:0/1155424368 >> v2:172.21.15.66:3300/0 conn(0x7f5e7013f940 0x7f5e7015dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.864+0000 7f5e74e2f640 1 --2- 172.21.15.63:0/1155424368 >> v2:172.21.15.63:3300/0 conn(0x7f5e700ce750 0x7f5e700ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.864+0000 7fae23c87640 1 -- 172.21.15.63:0/607386938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae1c13f940 msgr2=0x7fae1c15dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.864+0000 7fae23c87640 1 --2- 172.21.15.63:0/607386938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae1c13f940 0x7fae1c15dae0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fae10007190 tx=0x7fae1002ca70 comp rx=0 tx=0).stop 2023-12-04T10:44:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7fae23c87640 1 -- 172.21.15.63:0/607386938 shutdown_connections 2023-12-04T10:44:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7fae23c87640 1 --2- 172.21.15.63:0/607386938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae1c13f940 0x7fae1c15dae0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7fae23c87640 1 -- 172.21.15.63:0/607386938 >> 172.21.15.63:0/607386938 conn(0x7fae1c0b0b30 msgr2=0x7fae1c0b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.864+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbd8c0128c0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7fbd98ff9640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd8806aed0 0x7fbd8806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.866+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbd8c089870 con 0x7fbd9c0c7610 2023-12-04T10:44:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.866+0000 7fbd98ff9640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6800/4130360804,v1:172.21.15.63:6801/4130360804] conn(0x7fbd88074490 0x7fbd880768d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.866+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 --> [v2:172.21.15.63:6800/4130360804,v1:172.21.15.63:6801/4130360804] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbd88076fa0 con 0x7fbd88074490 2023-12-04T10:44:25.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.867+0000 7fbd9b7fe640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6800/4130360804,v1:172.21.15.63:6801/4130360804] conn(0x7fbd88074490 0x7fbd880768d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7fae23c87640 1 -- 172.21.15.63:0/607386938 shutdown_connections 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7f5e74e2f640 1 -- 172.21.15.63:0/1155424368 >> v2:172.21.15.66:3300/0 conn(0x7f5e7013f940 msgr2=0x7f5e7015dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7f5e74e2f640 1 --2- 172.21.15.63:0/1155424368 >> v2:172.21.15.66:3300/0 conn(0x7f5e7013f940 0x7f5e7015dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7f5e74e2f640 1 -- 172.21.15.63:0/1155424368 >> v1:172.21.15.66:6789/0 conn(0x7f5e700cbc40 legacy=0x7f5e70070220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7f5e74e2f640 1 -- 172.21.15.63:0/1155424368 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e700cdc70 con 0x7f5e700ce750 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.867+0000 7f5e74e2f640 1 --2- 172.21.15.63:0/1155424368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700ce750 0x7f5e700ccea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e7006dfb0 tx=0x7f5e5c02e3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6423976d28c83b78 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.867+0000 7f5e6ffff640 1 -- 172.21.15.63:0/1155424368 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c035600 con 0x7f5e700ce750 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.868+0000 7f5e6ffff640 1 -- 172.21.15.63:0/1155424368 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5c031050 con 0x7f5e700ce750 2023-12-04T10:44:25.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.868+0000 7f5e6ffff640 1 -- 172.21.15.63:0/1155424368 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5c035600 con 0x7f5e700ce750 2023-12-04T10:44:25.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.865+0000 7fae23c87640 1 -- 172.21.15.63:0/607386938 wait complete. 2023-12-04T10:44:25.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.868+0000 7fae23c87640 1 Processor -- start 2023-12-04T10:44:25.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.868+0000 7fbd9b7fe640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6800/4130360804,v1:172.21.15.63:6801/4130360804] conn(0x7fbd88074490 0x7fbd880768d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.868+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbd8c0545a0 con 0x7fbd9c0c7610 2023-12-04T10:44:25.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.869+0000 7f5e77894640 1 -- 172.21.15.63:0/1155424368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700ce750 msgr2=0x7f5e700ccea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.869+0000 7f5e77894640 1 --2- 172.21.15.63:0/1155424368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700ce750 0x7f5e700ccea0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e7006dfb0 tx=0x7f5e5c02e3a0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.869+0000 7f5e77894640 1 -- 172.21.15.63:0/1155424368 shutdown_connections 2023-12-04T10:44:25.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.869+0000 7f5e77894640 1 --2- 172.21.15.63:0/1155424368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700ce750 0x7f5e700ccea0 secure :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f5e7006dfb0 tx=0x7f5e5c02e3a0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.869+0000 7f5e77894640 1 --2- 172.21.15.63:0/1155424368 >> v2:172.21.15.66:3300/0 conn(0x7f5e7013f940 0x7f5e7015dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.869+0000 7f5e77894640 1 -- 172.21.15.63:0/1155424368 >> 172.21.15.63:0/1155424368 conn(0x7f5e700b0b30 msgr2=0x7f5e700b0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.869+0000 7fae23c87640 1 -- start start 2023-12-04T10:44:25.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.870+0000 7fbd9bfff640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd8806aed0 0x7fbd8806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.870+0000 7f5e77894640 1 -- 172.21.15.63:0/1155424368 shutdown_connections 2023-12-04T10:44:25.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.870+0000 7f5e77894640 1 -- 172.21.15.63:0/1155424368 wait complete. 2023-12-04T10:44:25.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.870+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 <== osd.0 v2:172.21.15.63:6800/4130360804 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbd88076fa0 con 0x7fbd88074490 2023-12-04T10:44:25.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.872+0000 7fae23c87640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae1c0cbc40 0x7fae1c1ff900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.872+0000 7fad09d93640 1 Processor -- start 2023-12-04T10:44:25.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.872+0000 7fae23c87640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae1c0ce750 0x7fae1c071100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.872+0000 7f42c7c02640 1 Processor -- start 2023-12-04T10:44:25.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.872+0000 7f42c7c02640 1 -- start start 2023-12-04T10:44:25.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.873+0000 7fae21a23640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae1c0cbc40 0x7fae1c1ff900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.873+0000 7fae21a23640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae1c0cbc40 0x7fae1c1ff900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48612/0 (socket says 172.21.15.63:48612) 2023-12-04T10:44:25.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.873+0000 7fae21a23640 1 -- 172.21.15.63:0/2639127161 learned_addr learned my addr 172.21.15.63:0/2639127161 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.872+0000 7fbd9bfff640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd8806aed0 0x7fbd8806d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd94007fd0 tx=0x7fbd94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.872+0000 7fad09d93640 1 -- start start 2023-12-04T10:44:25.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.874+0000 7fae23c87640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae1c13f940 0x7fae1c071640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.874+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1e6790 con 0x7fae1c0ce750 2023-12-04T10:44:25.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.874+0000 7fae21222640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae1c0ce750 0x7fae1c071100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.875+0000 7f5e77894640 1 Processor -- start 2023-12-04T10:44:25.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.875+0000 7f5e77894640 1 -- start start 2023-12-04T10:44:25.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.875+0000 7fad09d93640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fad0415d490 0x7fad040708e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.875+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1e6a70 con 0x7fae1c13f940 2023-12-04T10:44:25.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.875+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1c1e6d50 con 0x7fae1c0cbc40 2023-12-04T10:44:25.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.875+0000 7fae22224640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae1c13f940 0x7fae1c071640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7fad08d91640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fad04156db0 0x7fad0415cd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:52618/0 (socket says 172.21.15.63:52618) 2023-12-04T10:44:25.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7fad08d91640 1 -- 172.21.15.63:0/2560290907 learned_addr learned my addr 172.21.15.63:0/2560290907 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:25.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7fad09d93640 1 -- 172.21.15.63:0/2560290907 --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad0415db90 con 0x7fad040b2510 2023-12-04T10:44:25.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7fad03fff640 1 --2- 172.21.15.63:0/2560290907 >> v2:172.21.15.66:3300/0 conn(0x7fad0415d490 0x7fad040708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.874+0000 7f42c7c02640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.874+0000 7f42c7c02640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c0070800 con 0x7f42c006e2a0 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.874+0000 7f42c7c02640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42c0071640 con 0x7f42c0070390 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.874+0000 7f42c7c02640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c015a930 con 0x7f42c006d470 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7f42c599e640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f42c006e2a0 0x7f42c0156b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43728/0 (socket says 172.21.15.63:43728) 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7f42c599e640 1 -- 172.21.15.63:0/4080422559 learned_addr learned my addr 172.21.15.63:0/4080422559 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7f42c619f640 1 --2- 172.21.15.63:0/4080422559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7fad09d93640 1 -- 172.21.15.63:0/2560290907 --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad040b2d50 con 0x7fad04156db0 2023-12-04T10:44:25.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.876+0000 7fad09d93640 1 -- 172.21.15.63:0/2560290907 --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad04157190 con 0x7fad0415d490 2023-12-04T10:44:25.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7f5e77894640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e700cbc40 0x7f5e700b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3890494374 0 0) 0x7fad0415db90 con 0x7fad040b2510 2023-12-04T10:44:25.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7facf4003520 con 0x7fad040b2510 2023-12-04T10:44:25.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7f42c499c640 1 -- 172.21.15.63:0/4080422559 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3132251092 0 0) 0x7f42c0071640 con 0x7f42c0070390 2023-12-04T10:44:25.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7f42c619f640 1 -- 172.21.15.63:0/4080422559 >> v1:172.21.15.66:6789/0 conn(0x7f42c0070390 legacy=0x7f42c0071d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7f42c619f640 1 -- 172.21.15.63:0/4080422559 >> v1:172.21.15.63:6789/0 conn(0x7f42c006e2a0 legacy=0x7f42c0156b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7f42c619f640 1 -- 172.21.15.63:0/4080422559 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c01600b0 con 0x7f42c006d470 2023-12-04T10:44:25.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7f5e77894640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e7013f940 0x7f5e700b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7f5e77894640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700b40e0 0x7f5e701419c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7fae21a23640 1 -- 172.21.15.63:0/2639127161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae1c13f940 msgr2=0x7fae1c071640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7fae21a23640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fae1c13f940 0x7fae1c071640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7fae21a23640 1 -- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae1c0ce750 msgr2=0x7fae1c071100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7fae21a23640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fae1c0ce750 0x7fae1c071100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.877+0000 7fae21a23640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae1000add0 con 0x7fae1c0cbc40 2023-12-04T10:44:25.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7fae21a23640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae1c0cbc40 0x7fae1c1ff900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae10000c00 tx=0x7fae100046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7f5e77894640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e70142f90 con 0x7f5e700b40e0 2023-12-04T10:44:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7f5e75e31640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700b40e0 0x7f5e701419c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7f5e75e31640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700b40e0 0x7f5e701419c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34364/0 (socket says 172.21.15.63:34364) 2023-12-04T10:44:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7f5e75e31640 1 -- 172.21.15.63:0/737493128 learned_addr learned my addr 172.21.15.63:0/737493128 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7f5e75630640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e700cbc40 0x7f5e700b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e70159d60 con 0x7f5e7013f940 2023-12-04T10:44:25.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e700b4570 con 0x7f5e700cbc40 2023-12-04T10:44:25.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.878+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1296786895 0 0) 0x7fad040b2d50 con 0x7fad04156db0 2023-12-04T10:44:25.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad0415db90 con 0x7fad04156db0 2023-12-04T10:44:25.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7f5e74e2f640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e7013f940 0x7f5e700b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7f5e75e31640 1 -- 172.21.15.63:0/737493128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e700cbc40 msgr2=0x7f5e700b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7f5e75e31640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5e700cbc40 0x7f5e700b3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7f5e75e31640 1 -- 172.21.15.63:0/737493128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e7013f940 msgr2=0x7f5e700b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7f5e75e31640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5e7013f940 0x7f5e700b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae1003e070 con 0x7fae1c0cbc40 2023-12-04T10:44:25.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7f5e75e31640 1 -- 172.21.15.63:0/737493128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5c00b6a0 con 0x7f5e700b40e0 2023-12-04T10:44:25.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae100043f0 con 0x7fae1c0cbc40 2023-12-04T10:44:25.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae10005bb0 con 0x7fae1c0cbc40 2023-12-04T10:44:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 <== mon.1 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 966512492 0 0) 0x7fad0415db90 con 0x7fad04156db0 2023-12-04T10:44:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 >> v2:172.21.15.66:3300/0 conn(0x7fad0415d490 msgr2=0x7fad040708e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7fad037fe640 1 --2- 172.21.15.63:0/2560290907 >> v2:172.21.15.66:3300/0 conn(0x7fad0415d490 0x7fad040708e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 >> v1:172.21.15.63:6789/0 conn(0x7fad040b2510 legacy=0x7fad0406ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040b2a70 con 0x7fad04156db0 2023-12-04T10:44:25.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae1c1e7030 con 0x7fae1c0cbc40 2023-12-04T10:44:25.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae1c1ffe40 con 0x7fae1c0cbc40 2023-12-04T10:44:25.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 <== mon.1 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7facf8001670 con 0x7fad04156db0 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 >> v1:172.21.15.66:6789/0 conn(0x7fad04156db0 legacy=0x7fad0415cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7facf4003760 0x7facf4003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4004dc0 0x7facf4004080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf4005290 0x7facf4005710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad04157190 con 0x7facf4004dc0 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facf4005ff0 con 0x7facf4005290 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facf40061b0 con 0x7facf4003760 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.881+0000 7fad03fff640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4004dc0 0x7facf4004080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.881+0000 7fad08d91640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7facf4003760 0x7facf4003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7f42c619f640 1 --2- 172.21.15.63:0/4080422559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c015a3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0097d0 tx=0x7f42bc02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74706aec2f37ad8c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.879+0000 7f42c499c640 1 -- 172.21.15.63:0/4080422559 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc030800 con 0x7f42c006d470 2023-12-04T10:44:25.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7f42c499c640 1 -- 172.21.15.63:0/4080422559 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc030960 con 0x7f42c006d470 2023-12-04T10:44:25.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7f42c499c640 1 -- 172.21.15.63:0/4080422559 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc030cf0 con 0x7f42c006d470 2023-12-04T10:44:25.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7f42c7c02640 1 -- 172.21.15.63:0/4080422559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 msgr2=0x7f42c015a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.880+0000 7f42c7c02640 1 --2- 172.21.15.63:0/4080422559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c015a3f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0097d0 tx=0x7f42bc02b940 comp rx=0 tx=0).stop 2023-12-04T10:44:25.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.881+0000 7f42c7c02640 1 -- 172.21.15.63:0/4080422559 shutdown_connections 2023-12-04T10:44:25.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.881+0000 7fad09592640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf4005290 0x7facf4005710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.881+0000 7f42c7c02640 1 --2- 172.21.15.63:0/4080422559 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c015a3f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.881+0000 7f42c7c02640 1 -- 172.21.15.63:0/4080422559 >> 172.21.15.63:0/4080422559 conn(0x7f42c00cee80 msgr2=0x7f42c00cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.881+0000 7f42c7c02640 1 -- 172.21.15.63:0/4080422559 shutdown_connections 2023-12-04T10:44:25.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.881+0000 7f42c7c02640 1 -- 172.21.15.63:0/4080422559 wait complete. 2023-12-04T10:44:25.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.882+0000 7fad03fff640 1 -- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7facf4003760 msgr2=0x7facf4003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.882+0000 7fad03fff640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7facf4003760 0x7facf4003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.882+0000 7fad03fff640 1 -- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf4005290 msgr2=0x7facf4005710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.882+0000 7fad03fff640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf4005290 0x7facf4005710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.882+0000 7fad03fff640 1 -- 172.21.15.63:0/2560290907 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad040b2a70 con 0x7facf4004dc0 2023-12-04T10:44:25.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.882+0000 7fad09592640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7facf4005290 0x7facf4005710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:25.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.882+0000 7fad09592640 1 -- 172.21.15.63:0/2560290907 reap_dead start 2023-12-04T10:44:25.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.882+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fae1c1e6be0 con 0x7fae1c0cbc40 2023-12-04T10:44:25.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.883+0000 7f5e75e31640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700b40e0 0x7f5e701419c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c6c0 tx=0x7f5e6800cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.883+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e680076f0 con 0x7f5e700b40e0 2023-12-04T10:44:25.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.883+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e68007850 con 0x7f5e700b40e0 2023-12-04T10:44:25.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.884+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e68007c20 con 0x7f5e700b40e0 2023-12-04T10:44:25.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.884+0000 7fad03fff640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4004dc0 0x7facf4004080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad040cec00 tx=0x7facf40047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=790fabf603885b88 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.884+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e70140040 con 0x7f5e700b40e0 2023-12-04T10:44:25.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.884+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e70159fb0 con 0x7f5e700b40e0 2023-12-04T10:44:25.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.884+0000 7f42c7c02640 1 Processor -- start 2023-12-04T10:44:25.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.885+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf002c660 con 0x7facf4004dc0 2023-12-04T10:44:25.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.885+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf002c7c0 con 0x7facf4004dc0 2023-12-04T10:44:25.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.885+0000 7fad037fe640 1 -- 172.21.15.63:0/2560290907 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf002cb70 con 0x7facf4004dc0 2023-12-04T10:44:25.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.886+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e700ce230 con 0x7f5e700b40e0 2023-12-04T10:44:25.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.885+0000 7f42c7c02640 1 -- start start 2023-12-04T10:44:25.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.886+0000 7f42c7c02640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c014eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.886+0000 7f42c7c02640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42c006e2a0 0x7f42c014f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.886+0000 7f42c7c02640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42c0070390 0x7f42c00cc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.886+0000 7f42c7c02640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c014f940 con 0x7f42c006e2a0 2023-12-04T10:44:25.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.886+0000 7f42c7c02640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00ce2f0 con 0x7f42c0070390 2023-12-04T10:44:25.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.886+0000 7f42c7c02640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42c00b2870 con 0x7f42c006d470 2023-12-04T10:44:25.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fae10042070 con 0x7fae1c0cbc40 2023-12-04T10:44:25.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7fad09d93640 1 -- 172.21.15.63:0/2560290907 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4004dc0 msgr2=0x7facf4004080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7f42c619f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42c0070390 0x7f42c00cc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7f4a89bc9640 1 Processor -- start 2023-12-04T10:44:25.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7f42c619f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42c0070390 0x7f42c00cc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54698/0 (socket says 172.21.15.63:54698) 2023-12-04T10:44:25.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7f42c619f640 1 -- 172.21.15.63:0/2256999184 learned_addr learned my addr 172.21.15.63:0/2256999184 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7f42c519d640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42c006e2a0 0x7f42c014f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7fad09d93640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4004dc0 0x7facf4004080 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fad040cec00 tx=0x7facf40047e0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7fad09d93640 1 -- 172.21.15.63:0/2560290907 shutdown_connections 2023-12-04T10:44:25.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7fad09d93640 1 --2- 172.21.15.63:0/2560290907 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7facf4004dc0 0x7facf4004080 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.887+0000 7fad09d93640 1 -- 172.21.15.63:0/2560290907 >> 172.21.15.63:0/2560290907 conn(0x7fad040b0860 msgr2=0x7fad040b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.888+0000 7f42c599e640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c014eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.888+0000 7fad09d93640 1 -- 172.21.15.63:0/2560290907 shutdown_connections 2023-12-04T10:44:25.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.888+0000 7fad09d93640 1 -- 172.21.15.63:0/2560290907 wait complete. 2023-12-04T10:44:25.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.888+0000 7fb860864640 1 Processor -- start 2023-12-04T10:44:25.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.888+0000 7fae0e7fc640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fae0006ae90 0x7fae0006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.888+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fae100ab450 con 0x7fae1c0cbc40 2023-12-04T10:44:25.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.889+0000 7fae0e7fc640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6820/1675466293,v1:172.21.15.63:6822/1675466293] conn(0x7fae000744d0 0x7fae00076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.889+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.63:6820/1675466293,v1:172.21.15.63:6822/1675466293] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fae00076fe0 con 0x7fae000744d0 2023-12-04T10:44:25.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.889+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae100ab7c0 con 0x7fae1c0cbc40 2023-12-04T10:44:25.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.888+0000 7f4a89bc9640 1 -- start start 2023-12-04T10:44:25.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.889+0000 7fae22224640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6820/1675466293,v1:172.21.15.63:6822/1675466293] conn(0x7fae000744d0 0x7fae00076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.890+0000 7f4a89bc9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0061b0 0x7f4a7c006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.890+0000 7f4a89bc9640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c0e36a0 con 0x7f4a7c006b70 2023-12-04T10:44:25.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.890+0000 7f4a89bc9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a7c006fc0 con 0x7f4a7c0e32c0 2023-12-04T10:44:25.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.890+0000 7f4a89bc9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c058780 con 0x7f4a7c0061b0 2023-12-04T10:44:25.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.890+0000 7fae22224640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6820/1675466293,v1:172.21.15.63:6822/1675466293] conn(0x7fae000744d0 0x7fae00076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.890+0000 7fae21222640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fae0006ae90 0x7fae0006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.890+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e6800d040 con 0x7f5e700b40e0 2023-12-04T10:44:25.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7fae21222640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fae0006ae90 0x7fae0006d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae1c203650 tx=0x7fae18007d30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7fad09d93640 1 Processor -- start 2023-12-04T10:44:25.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7f42c519d640 1 -- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 msgr2=0x7f42c014eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7f42c519d640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c014eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7f42c519d640 1 -- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42c0070390 msgr2=0x7f42c00cc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7f42c519d640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f42c0070390 0x7f42c00cc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7f42c519d640 1 -- 172.21.15.63:0/2256999184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc009400 con 0x7f42c006e2a0 2023-12-04T10:44:25.906 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7f42c599e640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f42c006d470 0x7f42c014eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:25.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7f4a837fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f4a7c0e32c0 0x7f4a7c0572b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:52634/0 (socket says 172.21.15.63:52634) 2023-12-04T10:44:25.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7f4a837fe640 1 -- 172.21.15.63:0/399692688 learned_addr learned my addr 172.21.15.63:0/399692688 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:25.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7f4a82ffd640 1 --2- 172.21.15.63:0/399692688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0061b0 0x7f4a7c006630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7f4a82ffd640 1 -- 172.21.15.63:0/399692688 >> v1:172.21.15.66:6789/0 conn(0x7f4a7c0e32c0 legacy=0x7f4a7c0572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7f4a82ffd640 1 -- 172.21.15.63:0/399692688 >> v1:172.21.15.63:6789/0 conn(0x7f4a7c006b70 legacy=0x7f4a7c03c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.889+0000 7fb860864640 1 -- start start 2023-12-04T10:44:25.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7fb860864640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb85c0ce8e0 0x7fb85c0d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.891+0000 7fb860864640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c0b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7fb860864640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb85c0b2710 con 0x7fb85c15d5d0 2023-12-04T10:44:25.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7fb860864640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb85c0d2290 con 0x7fb85c0ce8e0 2023-12-04T10:44:25.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7fb860864640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c0d4150 con 0x7fb85c0d1de0 2023-12-04T10:44:25.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7f4a82ffd640 1 -- 172.21.15.63:0/399692688 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a7c057b00 con 0x7f4a7c0061b0 2023-12-04T10:44:25.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7fad09d93640 1 -- start start 2023-12-04T10:44:25.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 <== osd.1 v2:172.21.15.63:6820/1675466293 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fae00076fe0 con 0x7fae000744d0 2023-12-04T10:44:25.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7f5e6dffb640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5e5406af10 0x7f5e5406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.892+0000 7f42c519d640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42c006e2a0 0x7f42c014f400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c750 tx=0x7f42b800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.893+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8003ba0 con 0x7f42c006e2a0 2023-12-04T10:44:25.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.893+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5e68089740 con 0x7f5e700b40e0 2023-12-04T10:44:25.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.893+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b8003d00 con 0x7f42c006e2a0 2023-12-04T10:44:25.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.893+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b8003ba0 con 0x7f42c006e2a0 2023-12-04T10:44:25.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.893+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42c00cda50 con 0x7f42c006e2a0 2023-12-04T10:44:25.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fb85ad9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c0b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fb85ad9d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c0b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48648/0 (socket says 172.21.15.63:48648) 2023-12-04T10:44:25.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fb85ad9d640 1 -- 172.21.15.63:0/1052683935 learned_addr learned my addr 172.21.15.63:0/1052683935 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fb859d9b640 1 --2- 172.21.15.63:0/1052683935 >> v2:172.21.15.66:3300/0 conn(0x7fb85c0ce8e0 0x7fb85c0d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7f4a82ffd640 1 --2- 172.21.15.63:0/399692688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0061b0 0x7f4a7c006630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a700097d0 tx=0x7f4a7002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16dc4e6bd7d04852 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42c00ce010 con 0x7f42c006e2a0 2023-12-04T10:44:25.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fad09d93640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad040aead0 0x7fad040cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7f5e75630640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5e5406af10 0x7f5e5406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7f5e6dffb640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6816/3751405759,v1:172.21.15.63:6817/3751405759] conn(0x7f5e54074550 0x7f5e54076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fad09d93640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad040aeeb0 0x7fad041eed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fad09d93640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad041ef250 0x7fad0414a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fad09d93640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041ef6d0 con 0x7fad040aead0 2023-12-04T10:44:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fad09d93640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad040cbe50 con 0x7fad040aeeb0 2023-12-04T10:44:25.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fad09d93640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad041ef8b0 con 0x7fad041ef250 2023-12-04T10:44:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7fad08d91640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad040aead0 0x7fad040cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7fad08d91640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad040aead0 0x7fad040cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34380/0 (socket says 172.21.15.63:34380) 2023-12-04T10:44:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7fad08d91640 1 -- 172.21.15.63:0/923273856 learned_addr learned my addr 172.21.15.63:0/923273856 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7f4a827fc640 1 -- 172.21.15.63:0/399692688 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70031780 con 0x7f4a7c0061b0 2023-12-04T10:44:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7f4a827fc640 1 -- 172.21.15.63:0/399692688 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a700318e0 con 0x7f4a7c0061b0 2023-12-04T10:44:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7f4a827fc640 1 -- 172.21.15.63:0/399692688 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a70031c70 con 0x7f4a7c0061b0 2023-12-04T10:44:25.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7fb85ad9d640 1 -- 172.21.15.63:0/1052683935 >> v2:172.21.15.66:3300/0 conn(0x7fb85c0ce8e0 msgr2=0x7fb85c0d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7fb85ad9d640 1 --2- 172.21.15.63:0/1052683935 >> v2:172.21.15.66:3300/0 conn(0x7fb85c0ce8e0 0x7fb85c0d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7fb85ad9d640 1 -- 172.21.15.63:0/1052683935 >> v1:172.21.15.66:6789/0 conn(0x7fb85c15d5d0 legacy=0x7fb85c0d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.895+0000 7fb85ad9d640 1 -- 172.21.15.63:0/1052683935 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb85c0ced70 con 0x7fb85c0d1de0 2023-12-04T10:44:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.896+0000 7fad08d91640 1 -- 172.21.15.63:0/923273856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad041ef250 msgr2=0x7fad0414a390 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-04T10:44:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.896+0000 7fad08d91640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fad041ef250 0x7fad0414a390 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.896+0000 7fad08d91640 1 -- 172.21.15.63:0/923273856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad040aeeb0 msgr2=0x7fad041eed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.894+0000 7fad03fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad040aeeb0 0x7fad041eed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.896+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 --> [v2:172.21.15.63:6816/3751405759,v1:172.21.15.63:6817/3751405759] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e54077060 con 0x7f5e54074550 2023-12-04T10:44:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.896+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e6808bd60 con 0x7f5e700b40e0 2023-12-04T10:44:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.896+0000 7fad08d91640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad040aeeb0 0x7fad041eed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.896+0000 7f5e74e2f640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6816/3751405759,v1:172.21.15.63:6817/3751405759] conn(0x7f5e54074550 0x7f5e54076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.896+0000 7fad08d91640 1 -- 172.21.15.63:0/923273856 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad041efb90 con 0x7fad040aead0 2023-12-04T10:44:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.897+0000 7fad03fff640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad040aeeb0 0x7fad041eed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.897+0000 7fad08d91640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad040aead0 0x7fad040cc2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7facf8007290 tx=0x7facf8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7f4a89bc9640 1 -- 172.21.15.63:0/399692688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0061b0 msgr2=0x7f4a7c006630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7f4a89bc9640 1 --2- 172.21.15.63:0/399692688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0061b0 0x7f4a7c006630 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4a700097d0 tx=0x7f4a7002b820 comp rx=0 tx=0).stop 2023-12-04T10:44:25.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7f5e74e2f640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6816/3751405759,v1:172.21.15.63:6817/3751405759] conn(0x7f5e54074550 0x7f5e54076990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800f940 con 0x7fad040aead0 2023-12-04T10:44:25.919 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7f5e75630640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5e5406af10 0x7f5e5406d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400aea0 tx=0x7f5e6400a5f0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facf800faa0 con 0x7fad040aead0 2023-12-04T10:44:25.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf800fe50 con 0x7fad040aead0 2023-12-04T10:44:25.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad040cb800 con 0x7fad040aead0 2023-12-04T10:44:25.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.897+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f42b8005070 con 0x7f42c006e2a0 2023-12-04T10:44:25.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42c00712d0 con 0x7f42c006e2a0 2023-12-04T10:44:25.920 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7fb85ad9d640 1 --2- 172.21.15.63:0/1052683935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c0b3160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb854009e50 tx=0x7fb85402bdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64c16654174704e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.898+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0414e770 con 0x7fad040aead0 2023-12-04T10:44:25.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.899+0000 7fb85959a640 1 -- 172.21.15.63:0/1052683935 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85402c8e0 con 0x7fb85c0d1de0 2023-12-04T10:44:25.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.900+0000 7f42b27fc640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f42a406aea0 0x7f42a406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.900+0000 7fb85959a640 1 -- 172.21.15.63:0/1052683935 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb85402ca40 con 0x7fb85c0d1de0 2023-12-04T10:44:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.900+0000 7fb85959a640 1 -- 172.21.15.63:0/1052683935 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb85402c8e0 con 0x7fb85c0d1de0 2023-12-04T10:44:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.900+0000 7f4a89bc9640 1 -- 172.21.15.63:0/399692688 shutdown_connections 2023-12-04T10:44:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.900+0000 7f4a89bc9640 1 --2- 172.21.15.63:0/399692688 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0061b0 0x7f4a7c006630 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.900+0000 7f4a89bc9640 1 -- 172.21.15.63:0/399692688 >> 172.21.15.63:0/399692688 conn(0x7f4a7c058eb0 msgr2=0x7f4a7c0592c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.900+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f42b8089160 con 0x7f42c006e2a0 2023-12-04T10:44:25.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.901+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad04152290 con 0x7fad040aead0 2023-12-04T10:44:25.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.901+0000 7f4a89bc9640 1 -- 172.21.15.63:0/399692688 shutdown_connections 2023-12-04T10:44:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.901+0000 7f42b27fc640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:6816/741643498,v1:172.21.15.66:6817/741643498] conn(0x7f42a4074460 0x7f42a40768a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.901+0000 7f42c599e640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f42a406aea0 0x7f42a406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.901+0000 7f4a89bc9640 1 -- 172.21.15.63:0/399692688 wait complete. 2023-12-04T10:44:25.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7f2e2322d640 1 Processor -- start 2023-12-04T10:44:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 --> [v2:172.21.15.66:6816/741643498,v1:172.21.15.66:6817/741643498] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42a4076f70 con 0x7f42a4074460 2023-12-04T10:44:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42b808b820 con 0x7f42c006e2a0 2023-12-04T10:44:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7fb860864640 1 -- 172.21.15.63:0/1052683935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 msgr2=0x7fb85c0b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7f2e2322d640 1 -- start start 2023-12-04T10:44:25.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7fb860864640 1 --2- 172.21.15.63:0/1052683935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c0b3160 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb854009e50 tx=0x7fb85402bdc0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 --> [v2:172.21.15.63:6800/4130360804,v1:172.21.15.63:6801/4130360804] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbd7c002cb0 con 0x7fbd88074490 2023-12-04T10:44:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.901+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 <== osd.2 v2:172.21.15.63:6816/3751405759 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5e54077060 con 0x7f5e54074550 2023-12-04T10:44:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7fb860864640 1 -- 172.21.15.63:0/1052683935 shutdown_connections 2023-12-04T10:44:25.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7f42c599e640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f42a406aea0 0x7f42a406d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42b40072e0 tx=0x7f42b4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7fb860864640 1 --2- 172.21.15.63:0/1052683935 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c0b3160 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.902+0000 7fb860864640 1 --2- 172.21.15.63:0/1052683935 >> v2:172.21.15.66:3300/0 conn(0x7fb85c0ce8e0 0x7fb85c0d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.903+0000 7fb860864640 1 -- 172.21.15.63:0/1052683935 >> 172.21.15.63:0/1052683935 conn(0x7fb85c09c600 msgr2=0x7fb85c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.903+0000 7f42c619f640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:6816/741643498,v1:172.21.15.66:6817/741643498] conn(0x7f42a4074460 0x7f42a40768a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.903+0000 7fb860864640 1 -- 172.21.15.63:0/1052683935 shutdown_connections 2023-12-04T10:44:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.903+0000 7fb860864640 1 -- 172.21.15.63:0/1052683935 wait complete. 2023-12-04T10:44:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.903+0000 7f4a89bc9640 1 Processor -- start 2023-12-04T10:44:25.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7facf801d460 con 0x7fad040aead0 2023-12-04T10:44:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7f2e2322d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e1c0b2630 0x7f2e1c06ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7f42c619f640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:6816/741643498,v1:172.21.15.66:6817/741643498] conn(0x7f42a4074460 0x7f42a40768a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7fbd98ff9640 1 -- 172.21.15.63:0/119766795 <== osd.0 v2:172.21.15.63:6800/4130360804 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbd7c002cb0 con 0x7fbd88074490 2023-12-04T10:44:25.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7f2e2322d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e1c06b3a0 0x7f2e1c0b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7f2e2322d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e1c0cc760 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7f2e2322d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e1c06cb40 con 0x7f2e1c06b3a0 2023-12-04T10:44:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7f2e2322d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c06b920 con 0x7f2e1c0b2630 2023-12-04T10:44:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.904+0000 7f4a89bc9640 1 -- start start 2023-12-04T10:44:25.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7f2e1bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e1c06b3a0 0x7f2e1c0b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7f2e20fc9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e1c0b2630 0x7f2e1c06ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7f2e1bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e1c06b3a0 0x7f2e1c0b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54726/0 (socket says 172.21.15.63:54726) 2023-12-04T10:44:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7f2e1bfff640 1 -- 172.21.15.63:0/2579907439 learned_addr learned my addr 172.21.15.63:0/2579907439 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6800/4130360804,v1:172.21.15.63:6801/4130360804] conn(0x7fbd88074490 msgr2=0x7fbd880768d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7fbda1199640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6800/4130360804,v1:172.21.15.63:6801/4130360804] conn(0x7fbd88074490 0x7fbd880768d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd8806aed0 msgr2=0x7fbd8806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7fbda1199640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fbd8806aed0 0x7fbd8806d390 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd94007fd0 tx=0x7fbd94009040 comp rx=0 tx=0).stop 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd9c0c7610 msgr2=0x7fbd9c0b7e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7fbda1199640 1 --2- 172.21.15.63:0/119766795 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbd9c0c7610 0x7fbd9c0b7e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c00d5a0 tx=0x7fbd8c00da60 comp rx=0 tx=0).stop 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7fbda0998640 1 -- 172.21.15.63:0/119766795 reap_dead start 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 shutdown_connections 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 >> 172.21.15.63:0/119766795 conn(0x7fbd9c0d30d0 msgr2=0x7fbd9c06af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.905+0000 7fad017fa640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7face806ae40 0x7face806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7f4a89bc9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a7c0061b0 0x7f4a7c051990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7f2e1bfff640 1 -- 172.21.15.63:0/2579907439 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e1c0b2630 msgr2=0x7f2e1c06ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7f2e1bfff640 1 --2- 172.21.15.63:0/2579907439 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e1c0b2630 0x7f2e1c06ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7f2e1bfff640 1 -- 172.21.15.63:0/2579907439 >> v1:172.21.15.66:6789/0 conn(0x7f2e1c0b2f50 legacy=0x7f2e1c06d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7f2e1bfff640 1 -- 172.21.15.63:0/2579907439 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e1c06bc00 con 0x7f2e1c06b3a0 2023-12-04T10:44:25.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7f4a89bc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c006b70 0x7f4a7c17a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 shutdown_connections 2023-12-04T10:44:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fbda1199640 1 -- 172.21.15.63:0/119766795 wait complete. 2023-12-04T10:44:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7facf808a560 con 0x7fad040aead0 2023-12-04T10:44:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fad03fff640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7face806ae40 0x7face806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fad017fa640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6803/2748907041,v1:172.21.15.63:6805/2748907041] conn(0x7face8074480 0x7face80768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 --> [v2:172.21.15.63:6803/2748907041,v1:172.21.15.63:6805/2748907041] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7face8076f90 con 0x7face8074480 2023-12-04T10:44:25.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf808a910 con 0x7fad040aead0 2023-12-04T10:44:25.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.906+0000 7f4a89bc9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0e32c0 0x7f4a7c039a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7f4a837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a7c0061b0 0x7f4a7c051990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7fad09592640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6803/2748907041,v1:172.21.15.63:6805/2748907041] conn(0x7face8074480 0x7face80768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7f4a837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a7c0061b0 0x7f4a7c051990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34382/0 (socket says 172.21.15.63:34382) 2023-12-04T10:44:25.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7f4a837fe640 1 -- 172.21.15.63:0/3686723440 learned_addr learned my addr 172.21.15.63:0/3686723440 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c051ed0 con 0x7f4a7c0061b0 2023-12-04T10:44:25.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c04d790 con 0x7f4a7c006b70 2023-12-04T10:44:25.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a7c17a6f0 con 0x7f4a7c0e32c0 2023-12-04T10:44:25.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7f4a82ffd640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c006b70 0x7f4a7c17a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.907+0000 7f4a83fff640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0e32c0 0x7f4a7c039a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7fb860864640 1 Processor -- start 2023-12-04T10:44:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7fad03fff640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7face806ae40 0x7face806d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7facf0036000 tx=0x7facf0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7fad09592640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6803/2748907041,v1:172.21.15.63:6805/2748907041] conn(0x7face8074480 0x7face80768c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7f4a837fe640 1 -- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0e32c0 msgr2=0x7f4a7c039a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7f4a837fe640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4a7c0e32c0 0x7f4a7c039a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7f4a837fe640 1 -- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c006b70 msgr2=0x7f4a7c17a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7f4a837fe640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4a7c006b70 0x7f4a7c17a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7f4a837fe640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a70009400 con 0x7f4a7c0061b0 2023-12-04T10:44:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7f2e1bfff640 1 --2- 172.21.15.63:0/2579907439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e1c06b3a0 0x7f2e1c0b2a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009870 tx=0x7f2e0802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aec02cacda6c3173 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 <== osd.4 v2:172.21.15.66:6816/741643498 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f42a4076f70 con 0x7f42a4074460 2023-12-04T10:44:25.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.908+0000 7fb860864640 1 -- start start 2023-12-04T10:44:25.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.909+0000 7f2e1b7fe640 1 -- 172.21.15.63:0/2579907439 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08030840 con 0x7f2e1c06b3a0 2023-12-04T10:44:25.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.909+0000 7f2e1b7fe640 1 -- 172.21.15.63:0/2579907439 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e080309a0 con 0x7f2e1c06b3a0 2023-12-04T10:44:25.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.909+0000 7f4a837fe640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a7c0061b0 0x7f4a7c051990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a840641d0 tx=0x7f4a840678f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.909+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8406ba70 con 0x7f4a7c0061b0 2023-12-04T10:44:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.909+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a8406bbd0 con 0x7f4a7c0061b0 2023-12-04T10:44:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.909+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a840721c0 con 0x7f4a7c0061b0 2023-12-04T10:44:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.909+0000 7f2e1b7fe640 1 -- 172.21.15.63:0/2579907439 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e08030d30 con 0x7f2e1c06b3a0 2023-12-04T10:44:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7fb860864640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c1f6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7fb860864640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb85c15d5d0 0x7fb85c160380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7fb860864640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85c1608c0 0x7fb85c159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.909+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a7c17d1d0 con 0x7f4a7c0061b0 2023-12-04T10:44:25.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a7c17d790 con 0x7f4a7c0061b0 2023-12-04T10:44:25.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7fb860864640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c15fef0 con 0x7fb85c15d5d0 2023-12-04T10:44:25.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7fb860864640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c15f2e0 con 0x7fb85c1608c0 2023-12-04T10:44:25.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7fb860864640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb85c15f5c0 con 0x7fb85c0d1de0 2023-12-04T10:44:25.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 <== osd.3 v2:172.21.15.63:6803/2748907041 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7face8076f90 con 0x7face8074480 2023-12-04T10:44:25.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7f2e2322d640 1 -- 172.21.15.63:0/2579907439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e1c06b3a0 msgr2=0x7f2e1c0b2a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7f2e2322d640 1 --2- 172.21.15.63:0/2579907439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e1c06b3a0 0x7f2e1c0b2a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2e08009870 tx=0x7f2e0802b980 comp rx=0 tx=0).stop 2023-12-04T10:44:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.910+0000 7fb85a59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c1f6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7fb85a59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c1f6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48684/0 (socket says 172.21.15.63:48684) 2023-12-04T10:44:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7fb85a59c640 1 -- 172.21.15.63:0/3485668388 learned_addr learned my addr 172.21.15.63:0/3485668388 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7fb85ad9d640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85c1608c0 0x7fb85c159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7f2e2322d640 1 -- 172.21.15.63:0/2579907439 shutdown_connections 2023-12-04T10:44:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7f2e2322d640 1 --2- 172.21.15.63:0/2579907439 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e1c06b3a0 0x7f2e1c0b2a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7f2e2322d640 1 --2- 172.21.15.63:0/2579907439 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e1c0b2630 0x7f2e1c06ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7f2e2322d640 1 -- 172.21.15.63:0/2579907439 >> 172.21.15.63:0/2579907439 conn(0x7f2e1c0cf720 msgr2=0x7f2e1c0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7f2e2322d640 1 -- 172.21.15.63:0/2579907439 shutdown_connections 2023-12-04T10:44:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.911+0000 7f2e2322d640 1 -- 172.21.15.63:0/2579907439 wait complete. 2023-12-04T10:44:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.912+0000 7fb859d9b640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb85c15d5d0 0x7fb85c160380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.912+0000 7fb85a59c640 1 -- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85c1608c0 msgr2=0x7fb85c159f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.913+0000 7fb85a59c640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb85c1608c0 0x7fb85c159f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.913+0000 7fb85a59c640 1 -- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb85c15d5d0 msgr2=0x7fb85c160380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.913+0000 7fb85a59c640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb85c15d5d0 0x7fb85c160380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.913+0000 7fb85a59c640 1 -- 172.21.15.63:0/3485668388 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb854009b30 con 0x7fb85c0d1de0 2023-12-04T10:44:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.913+0000 7fb859d9b640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb85c15d5d0 0x7fb85c160380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.915+0000 7f2e2322d640 1 Processor -- start 2023-12-04T10:44:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.913+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4a7c0583a0 con 0x7f4a7c0061b0 2023-12-04T10:44:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.914+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a84072320 con 0x7f4a7c0061b0 2023-12-04T10:44:25.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.916+0000 7fb85a59c640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c1f6ab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c780 tx=0x7fb84c00cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.916+0000 7f2e2322d640 1 -- start start 2023-12-04T10:44:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.916+0000 7f4a6ffff640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4a6806ae90 0x7f4a6806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.916+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4a841033f0 con 0x7f4a7c0061b0 2023-12-04T10:44:25.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.916+0000 7f4a6ffff640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:6802/616399461,v1:172.21.15.66:6804/616399461] conn(0x7f4a68074450 0x7f4a68076890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.916+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.66:6802/616399461,v1:172.21.15.66:6804/616399461] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4a68076f60 con 0x7f4a68074450 2023-12-04T10:44:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7f4a82ffd640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4a6806ae90 0x7f4a6806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4a840ce190 con 0x7f4a7c0061b0 2023-12-04T10:44:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7f2e2322d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e1c06b3a0 0x7f2e1c13e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7f2e2322d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e1c0b2630 0x7f2e1c0b0490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7f2e2322d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e1c0b2f50 0x7f2e1c0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f2e2322d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c155310 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f4a83fff640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:6802/616399461,v1:172.21.15.66:6804/616399461] conn(0x7f4a68074450 0x7f4a68076890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.916+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c005270 con 0x7fb85c0d1de0 2023-12-04T10:44:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb84c0053f0 con 0x7fb85c0d1de0 2023-12-04T10:44:25.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00a880 con 0x7fb85c0d1de0 2023-12-04T10:44:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb85c15f8a0 con 0x7fb85c0d1de0 2023-12-04T10:44:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f4a82ffd640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4a6806ae90 0x7f4a6806d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a70036000 tx=0x7f4a7003d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.917+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb85c0c9190 con 0x7fb85c0d1de0 2023-12-04T10:44:25.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f2e2322d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c155030 con 0x7f2e1c0b2630 2023-12-04T10:44:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f2e2322d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e1c1557f0 con 0x7f2e1c06b3a0 2023-12-04T10:44:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f2e217ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e1c0b2f50 0x7f2e1c0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f2e217ca640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e1c0b2f50 0x7f2e1c0b09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34400/0 (socket says 172.21.15.63:34400) 2023-12-04T10:44:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f2e217ca640 1 -- 172.21.15.63:0/312085429 learned_addr learned my addr 172.21.15.63:0/312085429 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.918+0000 7f2e1bfff640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e1c0b2630 0x7f2e1c0b0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.919+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb85c0d3010 con 0x7fb85c0d1de0 2023-12-04T10:44:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.919+0000 7f2e217ca640 1 -- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e1c06b3a0 msgr2=0x7f2e1c13e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.919+0000 7f2e217ca640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e1c06b3a0 0x7f2e1c13e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.919+0000 7f2e217ca640 1 -- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e1c0b2630 msgr2=0x7f2e1c0b0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.919+0000 7f2e217ca640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e1c0b2630 0x7f2e1c0b0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.919+0000 7f2e217ca640 1 -- 172.21.15.63:0/312085429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e080094d0 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.919+0000 7f4a83fff640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:6802/616399461,v1:172.21.15.66:6804/616399461] conn(0x7f4a68074450 0x7f4a68076890 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.920+0000 7f2e217ca640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e1c0b2f50 0x7f2e1c0b09d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c730 tx=0x7f2e1400cb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.920+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 --> [v2:172.21.15.63:6820/1675466293,v1:172.21.15.63:6822/1675466293] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fae1c0b0950 con 0x7fae000744d0 2023-12-04T10:44:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.921+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14006d50 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.921+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e14003970 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.921+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e14003d00 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.922+0000 7fae0e7fc640 1 -- 172.21.15.63:0/2639127161 <== osd.1 v2:172.21.15.63:6820/1675466293 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fae1c0b0950 con 0x7fae000744d0 2023-12-04T10:44:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.921+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e1c155ad0 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.921+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e1c14b790 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.923+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2dfc000fc0 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.923+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 <== osd.5 v2:172.21.15.66:6802/616399461 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f4a68076f60 con 0x7f4a68074450 2023-12-04T10:44:25.953 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.924+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6820/1675466293,v1:172.21.15.63:6822/1675466293] conn(0x7fae000744d0 msgr2=0x7fae00076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.924+0000 7fae23c87640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6820/1675466293,v1:172.21.15.63:6822/1675466293] conn(0x7fae000744d0 0x7fae00076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.923+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb84c00a9e0 con 0x7fb85c0d1de0 2023-12-04T10:44:25.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.924+0000 7fb852ffd640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb84406ae40 0x7fb84406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.924+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb84c088fb0 con 0x7fb85c0d1de0 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fae0006ae90 msgr2=0x7fae0006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fae23c87640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fae0006ae90 0x7fae0006d350 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fae1c203650 tx=0x7fae18007d30 comp rx=0 tx=0).stop 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae1c0cbc40 msgr2=0x7fae1c1ff900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fae23c87640 1 --2- 172.21.15.63:0/2639127161 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fae1c0cbc40 0x7fae1c1ff900 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fae10000c00 tx=0x7fae100046c0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fae22224640 1 -- 172.21.15.63:0/2639127161 reap_dead start 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 shutdown_connections 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 >> 172.21.15.63:0/2639127161 conn(0x7fae1c0b0b30 msgr2=0x7fae1c0ca150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fb852ffd640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:6819/176556265,v1:172.21.15.66:6821/176556265] conn(0x7fb844074400 0x7fb844076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 --> [v2:172.21.15.66:6819/176556265,v1:172.21.15.66:6821/176556265] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb844076f10 con 0x7fb844074400 2023-12-04T10:44:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb84c08b610 con 0x7fb85c0d1de0 2023-12-04T10:44:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7fb859d9b640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb84406ae40 0x7fb84406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.925+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e140050d0 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.926+0000 7fb85ad9d640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:6819/176556265,v1:172.21.15.66:6821/176556265] conn(0x7fb844074400 0x7fb844076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.926+0000 7fb859d9b640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb84406ae40 0x7fb84406d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb85c1fa790 tx=0x7fb848008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.926+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 shutdown_connections 2023-12-04T10:44:25.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.926+0000 7fae23c87640 1 -- 172.21.15.63:0/2639127161 wait complete. 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.927+0000 7f2e197fa640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2e0006af10 0x7f2e0006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.927+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2e14089390 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.928+0000 7f2e20fc9640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2e0006af10 0x7f2e0006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.929+0000 7f2e197fa640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:6800/3339722149,v1:172.21.15.66:6801/3339722149] conn(0x7f2e00074550 0x7f2e00076990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.929+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 --> [v2:172.21.15.66:6800/3339722149,v1:172.21.15.66:6801/3339722149] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2e00077060 con 0x7f2e00074550 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.929+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2e1408b9b0 con 0x7f2e1c0b2f50 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.930+0000 7f2e20fc9640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2e0006af10 0x7f2e0006d3d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e10006a90 tx=0x7f2e10006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.930+0000 7f2e1bfff640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:6800/3339722149,v1:172.21.15.66:6801/3339722149] conn(0x7f2e00074550 0x7f2e00076990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:25.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.930+0000 7fb85ad9d640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:6819/176556265,v1:172.21.15.66:6821/176556265] conn(0x7fb844074400 0x7fb844076840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.931+0000 7f2e1bfff640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:6800/3339722149,v1:172.21.15.66:6801/3339722149] conn(0x7f2e00074550 0x7f2e00076990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:25.959 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2023-12-04T10:44:25.960 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-04T10:44:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.933+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 <== osd.6 v2:172.21.15.66:6819/176556265 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fb844076f10 con 0x7fb844074400 2023-12-04T10:44:25.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.934+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 <== osd.7 v2:172.21.15.66:6800/3339722149 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2e00077060 con 0x7f2e00074550 2023-12-04T10:44:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.938+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 --> [v2:172.21.15.63:6803/2748907041,v1:172.21.15.63:6805/2748907041] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad0406c570 con 0x7face8074480 2023-12-04T10:44:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.940+0000 7fad017fa640 1 -- 172.21.15.63:0/923273856 <== osd.3 v2:172.21.15.63:6803/2748907041 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7face8076f90 con 0x7face8074480 2023-12-04T10:44:25.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.940+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 --> [v2:172.21.15.63:6816/3751405759,v1:172.21.15.63:6817/3751405759] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e700cebb0 con 0x7f5e54074550 2023-12-04T10:44:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.940+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6803/2748907041,v1:172.21.15.63:6805/2748907041] conn(0x7face8074480 msgr2=0x7face80768c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.940+0000 7fad09d93640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6803/2748907041,v1:172.21.15.63:6805/2748907041] conn(0x7face8074480 0x7face80768c0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7f5e6dffb640 1 -- 172.21.15.63:0/737493128 <== osd.2 v2:172.21.15.63:6816/3751405759 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e5c004320 con 0x7f5e54074550 2023-12-04T10:44:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7face806ae40 msgr2=0x7face806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7fad09d93640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7face806ae40 0x7face806d300 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7facf0036000 tx=0x7facf0030000 comp rx=0 tx=0).stop 2023-12-04T10:44:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad040aead0 msgr2=0x7fad040cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7fad09d93640 1 --2- 172.21.15.63:0/923273856 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fad040aead0 0x7fad040cc2e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7facf8007290 tx=0x7facf8007750 comp rx=0 tx=0).stop 2023-12-04T10:44:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6816/3751405759,v1:172.21.15.63:6817/3751405759] conn(0x7f5e54074550 msgr2=0x7f5e54076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7f5e77894640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6816/3751405759,v1:172.21.15.63:6817/3751405759] conn(0x7f5e54074550 0x7f5e54076990 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7fad09592640 1 -- 172.21.15.63:0/923273856 reap_dead start 2023-12-04T10:44:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 shutdown_connections 2023-12-04T10:44:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 >> 172.21.15.63:0/923273856 conn(0x7fad040b0860 msgr2=0x7fad04070e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5e5406af10 msgr2=0x7f5e5406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7f5e77894640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5e5406af10 0x7f5e5406d3d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5e6400aea0 tx=0x7f5e6400a5f0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700b40e0 msgr2=0x7f5e701419c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.941+0000 7f5e77894640 1 --2- 172.21.15.63:0/737493128 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5e700b40e0 0x7f5e701419c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800c6c0 tx=0x7f5e6800cb80 comp rx=0 tx=0).stop 2023-12-04T10:44:25.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7f5e75e31640 1 -- 172.21.15.63:0/737493128 reap_dead start 2023-12-04T10:44:25.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 shutdown_connections 2023-12-04T10:44:25.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 shutdown_connections 2023-12-04T10:44:25.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 >> 172.21.15.63:0/737493128 conn(0x7f5e700b0b30 msgr2=0x7f5e700700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7fad09d93640 1 -- 172.21.15.63:0/923273856 wait complete. 2023-12-04T10:44:25.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 shutdown_connections 2023-12-04T10:44:25.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.942+0000 7f5e77894640 1 -- 172.21.15.63:0/737493128 wait complete. 2023-12-04T10:44:25.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.948+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 --> [v2:172.21.15.66:6816/741643498,v1:172.21.15.66:6817/741643498] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f42c0070ff0 con 0x7f42a4074460 2023-12-04T10:44:25.966 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.949+0000 7f42b27fc640 1 -- 172.21.15.63:0/2256999184 <== osd.4 v2:172.21.15.66:6816/741643498 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f42bc03f040 con 0x7f42a4074460 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.950+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:6816/741643498,v1:172.21.15.66:6817/741643498] conn(0x7f42a4074460 msgr2=0x7f42a40768a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.950+0000 7f42c7c02640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.66:6816/741643498,v1:172.21.15.66:6817/741643498] conn(0x7f42a4074460 0x7f42a40768a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.950+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f42a406aea0 msgr2=0x7f42a406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.950+0000 7f42c7c02640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f42a406aea0 0x7f42a406d360 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f42b40072e0 tx=0x7f42b4009040 comp rx=0 tx=0).stop 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.950+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42c006e2a0 msgr2=0x7f42c014f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.950+0000 7f42c7c02640 1 --2- 172.21.15.63:0/2256999184 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f42c006e2a0 0x7f42c014f400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f42b800c750 tx=0x7f42b800cc10 comp rx=0 tx=0).stop 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.950+0000 7f42c619f640 1 -- 172.21.15.63:0/2256999184 reap_dead start 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.951+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 shutdown_connections 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.951+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 >> 172.21.15.63:0/2256999184 conn(0x7f42c00cee80 msgr2=0x7f42c00cf260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.951+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 shutdown_connections 2023-12-04T10:44:25.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.951+0000 7f42c7c02640 1 -- 172.21.15.63:0/2256999184 wait complete. 2023-12-04T10:44:25.968 INFO:teuthology.orchestra.run.smithi063.stdout:60129542156 2023-12-04T10:44:25.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-04T10:44:25.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.955+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 --> [v2:172.21.15.66:6802/616399461,v1:172.21.15.66:6804/616399461] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4a7c0580c0 con 0x7f4a68074450 2023-12-04T10:44:25.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.956+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 --> [v2:172.21.15.66:6819/176556265,v1:172.21.15.66:6821/176556265] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb85c0b2c40 con 0x7fb844074400 2023-12-04T10:44:25.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.957+0000 7fb852ffd640 1 -- 172.21.15.63:0/3485668388 <== osd.6 v2:172.21.15.66:6819/176556265 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb854009510 con 0x7fb844074400 2023-12-04T10:44:25.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.957+0000 7f4a6ffff640 1 -- 172.21.15.63:0/3686723440 <== osd.5 v2:172.21.15.66:6802/616399461 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f4a7800b8f0 con 0x7f4a68074450 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:6819/176556265,v1:172.21.15.66:6821/176556265] conn(0x7fb844074400 msgr2=0x7fb844076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:6819/176556265,v1:172.21.15.66:6821/176556265] conn(0x7fb844074400 0x7fb844076840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb84406ae40 msgr2=0x7fb84406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb84406ae40 0x7fb84406d300 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb85c1fa790 tx=0x7fb848008040 comp rx=0 tx=0).stop 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 msgr2=0x7fb85c1f6ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 --2- 172.21.15.63:0/3485668388 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb85c0d1de0 0x7fb85c1f6ab0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00c780 tx=0x7fb84c00cc40 comp rx=0 tx=0).stop 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb85ad9d640 1 -- 172.21.15.63:0/3485668388 reap_dead start 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 shutdown_connections 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:6802/616399461,v1:172.21.15.66:6804/616399461] conn(0x7f4a68074450 msgr2=0x7f4a68076890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7f4a89bc9640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.66:6802/616399461,v1:172.21.15.66:6804/616399461] conn(0x7f4a68074450 0x7f4a68076890 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 >> 172.21.15.63:0/3485668388 conn(0x7fb85c09c600 msgr2=0x7fb85c15c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 shutdown_connections 2023-12-04T10:44:25.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.958+0000 7fb860864640 1 -- 172.21.15.63:0/3485668388 wait complete. 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.959+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4a6806ae90 msgr2=0x7f4a6806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.959+0000 7f4a89bc9640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4a6806ae90 0x7f4a6806d350 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f4a70036000 tx=0x7f4a7003d040 comp rx=0 tx=0).stop 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.959+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a7c0061b0 msgr2=0x7f4a7c051990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.959+0000 7f4a89bc9640 1 --2- 172.21.15.63:0/3686723440 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4a7c0061b0 0x7f4a7c051990 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4a840641d0 tx=0x7f4a840678f0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.959+0000 7f4a83fff640 1 -- 172.21.15.63:0/3686723440 reap_dead start 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.959+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 shutdown_connections 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.959+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 >> 172.21.15.63:0/3686723440 conn(0x7f4a7c058eb0 msgr2=0x7f4a7c03c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.959+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 shutdown_connections 2023-12-04T10:44:25.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.960+0000 7f4a89bc9640 1 -- 172.21.15.63:0/3686723440 wait complete. 2023-12-04T10:44:25.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.961+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 --> [v2:172.21.15.66:6800/3339722149,v1:172.21.15.66:6801/3339722149] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2dfc002cb0 con 0x7f2e00074550 2023-12-04T10:44:25.974 INFO:teuthology.orchestra.run.smithi063.stdout:60129542154 2023-12-04T10:44:25.975 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-04T10:44:25.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.962+0000 7f2e197fa640 1 -- 172.21.15.63:0/312085429 <== osd.7 v2:172.21.15.66:6800/3339722149 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2dfc002cb0 con 0x7f2e00074550 2023-12-04T10:44:25.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:6800/3339722149,v1:172.21.15.66:6801/3339722149] conn(0x7f2e00074550 msgr2=0x7f2e00076990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.66:6800/3339722149,v1:172.21.15.66:6801/3339722149] conn(0x7f2e00074550 0x7f2e00076990 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:25.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2e0006af10 msgr2=0x7f2e0006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2e0006af10 0x7f2e0006d3d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2e10006a90 tx=0x7f2e10006a20 comp rx=0 tx=0).stop 2023-12-04T10:44:25.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e1c0b2f50 msgr2=0x7f2e1c0b09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:25.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 --2- 172.21.15.63:0/312085429 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e1c0b2f50 0x7f2e1c0b09d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2e1400c730 tx=0x7f2e1400cb30 comp rx=0 tx=0).stop 2023-12-04T10:44:25.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e217ca640 1 -- 172.21.15.63:0/312085429 reap_dead start 2023-12-04T10:44:25.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 shutdown_connections 2023-12-04T10:44:25.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 >> 172.21.15.63:0/312085429 conn(0x7f2e1c0cf720 msgr2=0x7f2e1c0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:25.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 shutdown_connections 2023-12-04T10:44:25.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:25.963+0000 7f2e2322d640 1 -- 172.21.15.63:0/312085429 wait complete. 2023-12-04T10:44:25.978 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2023-12-04T10:44:25.978 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-04T10:44:25.979 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2023-12-04T10:44:25.980 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-04T10:44:25.986 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2023-12-04T10:44:25.987 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2023-12-04T10:44:25.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-04T10:44:25.988 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2023-12-04T10:44:25.988 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-04T10:44:25.990 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-04T10:44:26.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.217+0000 7f9278333640 1 Processor -- start 2023-12-04T10:44:26.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.218+0000 7f9278333640 1 -- start start 2023-12-04T10:44:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.220+0000 7f095d28c640 1 Processor -- start 2023-12-04T10:44:26.222 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.220+0000 7f095d28c640 1 -- start start 2023-12-04T10:44:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.220+0000 7f9278333640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92700ce9d0 0x7f927006c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.220+0000 7f9278333640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9270153b90 0x7f927006c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.220+0000 7f9278333640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f927006d090 con 0x7f92701537b0 2023-12-04T10:44:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.220+0000 7f9278333640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9270159d80 con 0x7f92700ce9d0 2023-12-04T10:44:26.223 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.220+0000 7f9278333640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f927006d370 con 0x7f9270153b90 2023-12-04T10:44:26.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.222+0000 7f095d28c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 0x7f09580cd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.224 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.222+0000 7f095d28c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0958159210 0x7f09580c9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.222+0000 7f095d28c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09580c9e50 con 0x7f095806e1c0 2023-12-04T10:44:26.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.222+0000 7f095d28c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09580cd3a0 con 0x7f0958159210 2023-12-04T10:44:26.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.222+0000 7f095d28c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09581596a0 con 0x7f09580cbd40 2023-12-04T10:44:26.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.223+0000 7f92760cf640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f92701537b0 0x7f92700ce2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43770/0 (socket says 172.21.15.63:43770) 2023-12-04T10:44:26.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.223+0000 7f92760cf640 1 -- 172.21.15.63:0/86585521 learned_addr learned my addr 172.21.15.63:0/86585521 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:26.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.223+0000 7f92758ce640 1 --2- 172.21.15.63:0/86585521 >> v2:172.21.15.63:3300/0 conn(0x7f92700ce9d0 0x7f927006c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.223+0000 7f92768d0640 1 --2- 172.21.15.63:0/86585521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9270153b90 0x7f927006c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.224+0000 7f095ca8b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0958159210 0x7f09580c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.224+0000 7f0957fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f095806e1c0 0x7f09580cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:52666/0 (socket says 172.21.15.63:52666) 2023-12-04T10:44:26.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.224+0000 7f0957fff640 1 -- 172.21.15.63:0/255511391 learned_addr learned my addr 172.21.15.63:0/255511391 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:26.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.224+0000 7f92758ce640 1 -- 172.21.15.63:0/86585521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9270153b90 msgr2=0x7f927006c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.224+0000 7f92758ce640 1 --2- 172.21.15.63:0/86585521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9270153b90 0x7f927006c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.224+0000 7f92758ce640 1 -- 172.21.15.63:0/86585521 >> v1:172.21.15.63:6789/0 conn(0x7f92701537b0 legacy=0x7f92700ce2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.224+0000 7f92758ce640 1 -- 172.21.15.63:0/86585521 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f927006d650 con 0x7f92700ce9d0 2023-12-04T10:44:26.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.225+0000 7f094f7fe640 1 --2- 172.21.15.63:0/255511391 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 0x7f09580cd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.226+0000 7f09577fe640 1 -- 172.21.15.63:0/255511391 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1511048327 0 0) 0x7f09580c9e50 con 0x7f095806e1c0 2023-12-04T10:44:26.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.226+0000 7f09577fe640 1 -- 172.21.15.63:0/255511391 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0944003520 con 0x7f095806e1c0 2023-12-04T10:44:26.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.226+0000 7f095ca8b640 1 -- 172.21.15.63:0/255511391 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 msgr2=0x7f09580cd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.226+0000 7f095ca8b640 1 --2- 172.21.15.63:0/255511391 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 0x7f09580cd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.226+0000 7f095ca8b640 1 -- 172.21.15.63:0/255511391 >> v1:172.21.15.66:6789/0 conn(0x7f095806e1c0 legacy=0x7f09580cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.226+0000 7f095ca8b640 1 -- 172.21.15.63:0/255511391 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09580cca00 con 0x7f0958159210 2023-12-04T10:44:26.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.227+0000 7f92758ce640 1 --2- 172.21.15.63:0/86585521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92700ce9d0 0x7f927006c460 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f926000bcb0 tx=0x7f926002e2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c16694dd65d775c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.227+0000 7f92750cd640 1 -- 172.21.15.63:0/86585521 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f926002ee80 con 0x7f92700ce9d0 2023-12-04T10:44:26.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.228+0000 7f92750cd640 1 -- 172.21.15.63:0/86585521 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9260032070 con 0x7f92700ce9d0 2023-12-04T10:44:26.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.228+0000 7f92750cd640 1 -- 172.21.15.63:0/86585521 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9260038600 con 0x7f92700ce9d0 2023-12-04T10:44:26.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7f9278333640 1 -- 172.21.15.63:0/86585521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92700ce9d0 msgr2=0x7f927006c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7f9278333640 1 --2- 172.21.15.63:0/86585521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92700ce9d0 0x7f927006c460 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f926000bcb0 tx=0x7f926002e2e0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7f095ca8b640 1 --2- 172.21.15.63:0/255511391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0958159210 0x7f09580c9270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09500097a0 tx=0x7f095002b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f2ca7f85cdd18f6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7f9278333640 1 -- 172.21.15.63:0/86585521 shutdown_connections 2023-12-04T10:44:26.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7f9278333640 1 --2- 172.21.15.63:0/86585521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9270153b90 0x7f927006c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7f9278333640 1 --2- 172.21.15.63:0/86585521 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92700ce9d0 0x7f927006c460 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7f9278333640 1 -- 172.21.15.63:0/86585521 >> 172.21.15.63:0/86585521 conn(0x7f92700b0ac0 msgr2=0x7f92700b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7fef92061640 1 Processor -- start 2023-12-04T10:44:26.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.229+0000 7f9278333640 1 -- 172.21.15.63:0/86585521 shutdown_connections 2023-12-04T10:44:26.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.230+0000 7f09577fe640 1 -- 172.21.15.63:0/255511391 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095002d040 con 0x7f0958159210 2023-12-04T10:44:26.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.230+0000 7fef92061640 1 -- start start 2023-12-04T10:44:26.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.230+0000 7f09577fe640 1 -- 172.21.15.63:0/255511391 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0950031810 con 0x7f0958159210 2023-12-04T10:44:26.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.230+0000 7f09577fe640 1 -- 172.21.15.63:0/255511391 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950031ba0 con 0x7f0958159210 2023-12-04T10:44:26.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.230+0000 7f9278333640 1 -- 172.21.15.63:0/86585521 wait complete. 2023-12-04T10:44:26.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7f095d28c640 1 -- 172.21.15.63:0/255511391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0958159210 msgr2=0x7f09580c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7f095d28c640 1 --2- 172.21.15.63:0/255511391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0958159210 0x7f09580c9270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f09500097a0 tx=0x7f095002b8b0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7f095d28c640 1 -- 172.21.15.63:0/255511391 shutdown_connections 2023-12-04T10:44:26.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7f095d28c640 1 --2- 172.21.15.63:0/255511391 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0958159210 0x7f09580c9270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7fef92061640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7f095d28c640 1 --2- 172.21.15.63:0/255511391 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 0x7f09580cd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7f095d28c640 1 -- 172.21.15.63:0/255511391 >> 172.21.15.63:0/255511391 conn(0x7f09580b07f0 msgr2=0x7f09580b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7f9278333640 1 Processor -- start 2023-12-04T10:44:26.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.232+0000 7fef92061640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef8c070be0 0x7fef8c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.233+0000 7f9278333640 1 -- start start 2023-12-04T10:44:26.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.233+0000 7fef92061640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fef8c0cf7d0 0x7fef8c165410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.233+0000 7fef92061640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c0cfc60 con 0x7fef8c0cf7d0 2023-12-04T10:44:26.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.233+0000 7fef92061640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef8c06d410 con 0x7fef8c070be0 2023-12-04T10:44:26.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.233+0000 7fef92061640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c070270 con 0x7fef8c14a9b0 2023-12-04T10:44:26.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.233+0000 7fef8affd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef8c070be0 0x7fef8c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.233+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c06ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48718/0 (socket says 172.21.15.63:48718) 2023-12-04T10:44:26.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7fef8b7fe640 1 -- 172.21.15.63:0/23874521 learned_addr learned my addr 172.21.15.63:0/23874521 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7f095d28c640 1 -- 172.21.15.63:0/255511391 shutdown_connections 2023-12-04T10:44:26.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7fef8bfff640 1 --2- 172.21.15.63:0/23874521 >> v2:172.21.15.63:3300/0 conn(0x7fef8c0cf7d0 0x7fef8c165410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7f095d28c640 1 -- 172.21.15.63:0/255511391 wait complete. 2023-12-04T10:44:26.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7fef8b7fe640 1 -- 172.21.15.63:0/23874521 >> v2:172.21.15.66:3300/0 conn(0x7fef8c070be0 msgr2=0x7fef8c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7fef8b7fe640 1 --2- 172.21.15.63:0/23874521 >> v2:172.21.15.66:3300/0 conn(0x7fef8c070be0 0x7fef8c0cf290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7fef8b7fe640 1 -- 172.21.15.63:0/23874521 >> v2:172.21.15.63:3300/0 conn(0x7fef8c0cf7d0 msgr2=0x7fef8c165410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7fef8b7fe640 1 --2- 172.21.15.63:0/23874521 >> v2:172.21.15.63:3300/0 conn(0x7fef8c0cf7d0 0x7fef8c165410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.235+0000 7f9278333640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92700ce9d0 0x7f927013f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.234+0000 7fef8b7fe640 1 -- 172.21.15.63:0/23874521 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c070550 con 0x7fef8c14a9b0 2023-12-04T10:44:26.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.235+0000 7fef8bfff640 1 --2- 172.21.15.63:0/23874521 >> v2:172.21.15.63:3300/0 conn(0x7fef8c0cf7d0 0x7fef8c165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.235+0000 7f9278333640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92701537b0 0x7f92701e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.236+0000 7f9278333640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9270153b90 0x7f92700b2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.236+0000 7f9278333640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92701462b0 con 0x7f92701537b0 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.236+0000 7f92760cf640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92700ce9d0 0x7f927013f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.236+0000 7f92760cf640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92700ce9d0 0x7f927013f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48724/0 (socket says 172.21.15.63:48724) 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.236+0000 7f92760cf640 1 -- 172.21.15.63:0/2107581636 learned_addr learned my addr 172.21.15.63:0/2107581636 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927013fec0 con 0x7f9270153b90 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.236+0000 7fef8b7fe640 1 --2- 172.21.15.63:0/23874521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c06ce20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef8c06e6e0 tx=0x7fef7c02bee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=299009f1b8ba223d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7f095d28c640 1 Processor -- start 2023-12-04T10:44:26.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9270140760 con 0x7f92700ce9d0 2023-12-04T10:44:26.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7f095d28c640 1 -- start start 2023-12-04T10:44:26.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7fef8a7fc640 1 -- 172.21.15.63:0/23874521 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c02ca80 con 0x7fef8c14a9b0 2023-12-04T10:44:26.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7fef8a7fc640 1 -- 172.21.15.63:0/23874521 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c02cbe0 con 0x7fef8c14a9b0 2023-12-04T10:44:26.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7fef8a7fc640 1 -- 172.21.15.63:0/23874521 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c0343f0 con 0x7fef8c14a9b0 2023-12-04T10:44:26.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7f92758ce640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92701537b0 0x7f92701e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.237+0000 7f92768d0640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9270153b90 0x7f92700b2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.238+0000 7fef92061640 1 -- 172.21.15.63:0/23874521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 msgr2=0x7fef8c06ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.238+0000 7fef92061640 1 --2- 172.21.15.63:0/23874521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c06ce20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fef8c06e6e0 tx=0x7fef7c02bee0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.238+0000 7f92768d0640 1 -- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92700ce9d0 msgr2=0x7f927013f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.238+0000 7f92768d0640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92700ce9d0 0x7f927013f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f92768d0640 1 -- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92701537b0 msgr2=0x7f92701e75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f92768d0640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92701537b0 0x7f92701e75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f92768d0640 1 -- 172.21.15.63:0/2107581636 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926000b6b0 con 0x7f9270153b90 2023-12-04T10:44:26.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f92758ce640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92701537b0 0x7f92701e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f095d28c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095806e1c0 0x7f095816b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f095d28c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 0x7f095814c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f095d28c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0958159210 0x7f095814cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f095d28c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09581648c0 con 0x7f0958159210 2023-12-04T10:44:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f095d28c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09580b0580 con 0x7f095806e1c0 2023-12-04T10:44:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f095d28c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09580c4990 con 0x7f09580cbd40 2023-12-04T10:44:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7f095ca8b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0958159210 0x7f095814cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.239+0000 7f92760cf640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92700ce9d0 0x7f927013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:44:26.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7f095ca8b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0958159210 0x7f095814cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34448/0 (socket says 172.21.15.63:34448) 2023-12-04T10:44:26.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7f095ca8b640 1 -- 172.21.15.63:0/2502786522 learned_addr learned my addr 172.21.15.63:0/2502786522 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7fef92061640 1 -- 172.21.15.63:0/23874521 shutdown_connections 2023-12-04T10:44:26.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7fef92061640 1 --2- 172.21.15.63:0/23874521 >> v2:172.21.15.63:3300/0 conn(0x7fef8c0cf7d0 0x7fef8c165410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7fef92061640 1 --2- 172.21.15.63:0/23874521 >> v2:172.21.15.66:3300/0 conn(0x7fef8c070be0 0x7fef8c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7fef92061640 1 --2- 172.21.15.63:0/23874521 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c06ce20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7fef92061640 1 -- 172.21.15.63:0/23874521 >> 172.21.15.63:0/23874521 conn(0x7fef8c06a8a0 msgr2=0x7fef8c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7f094f7fe640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 0x7f095814c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7fef92061640 1 -- 172.21.15.63:0/23874521 shutdown_connections 2023-12-04T10:44:26.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.240+0000 7f92768d0640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9270153b90 0x7f92700b2e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9268007cc0 tx=0x7f926800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7fef92061640 1 -- 172.21.15.63:0/23874521 wait complete. 2023-12-04T10:44:26.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7f9266ffd640 1 -- 172.21.15.63:0/2107581636 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268018070 con 0x7f9270153b90 2023-12-04T10:44:26.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7f095ca8b640 1 -- 172.21.15.63:0/2502786522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 msgr2=0x7f095814c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7f095ca8b640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 0x7f095814c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7f095ca8b640 1 -- 172.21.15.63:0/2502786522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095806e1c0 msgr2=0x7f095816b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7f095ca8b640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095806e1c0 0x7f095816b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7f095ca8b640 1 -- 172.21.15.63:0/2502786522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0950009400 con 0x7f0958159210 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.242+0000 7f095ca8b640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0958159210 0x7f095814cbb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09500097a0 tx=0x7f09500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.242+0000 7f09557fa640 1 -- 172.21.15.63:0/2502786522 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950006e10 con 0x7f0958159210 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.242+0000 7f09557fa640 1 -- 172.21.15.63:0/2502786522 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095003ace0 con 0x7f0958159210 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.242+0000 7f09557fa640 1 -- 172.21.15.63:0/2502786522 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0950044640 con 0x7f0958159210 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92701433b0 con 0x7f9270153b90 2023-12-04T10:44:26.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.241+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92700cd9a0 con 0x7f9270153b90 2023-12-04T10:44:26.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.243+0000 7f9266ffd640 1 -- 172.21.15.63:0/2107581636 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f926800edd0 con 0x7f9270153b90 2023-12-04T10:44:26.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.243+0000 7f9266ffd640 1 -- 172.21.15.63:0/2107581636 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9268018070 con 0x7f9270153b90 2023-12-04T10:44:26.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.244+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9258005250 con 0x7f9270153b90 2023-12-04T10:44:26.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.244+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09580c4c70 con 0x7f0958159210 2023-12-04T10:44:26.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.245+0000 7fef92061640 1 Processor -- start 2023-12-04T10:44:26.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.245+0000 7fef92061640 1 -- start start 2023-12-04T10:44:26.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.247+0000 7fef92061640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef8c070be0 0x7fef8c145cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.248+0000 7fef92061640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cf7d0 0x7fef8c0adff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.248+0000 7fef92061640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c0af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.248+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef8c070be0 0x7fef8c145cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.248+0000 7fef8b7fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef8c070be0 0x7fef8c145cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54806/0 (socket says 172.21.15.63:54806) 2023-12-04T10:44:26.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.248+0000 7fef92061640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0ccdb0 con 0x7fef8c0cf7d0 2023-12-04T10:44:26.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.248+0000 7fef8b7fe640 1 -- 172.21.15.63:0/1189668534 learned_addr learned my addr 172.21.15.63:0/1189668534 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.248+0000 7fef92061640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0cc1a0 con 0x7fef8c070be0 2023-12-04T10:44:26.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.249+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8c0cc480 con 0x7fef8c14a9b0 2023-12-04T10:44:26.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.249+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0958164ad0 con 0x7f0958159210 2023-12-04T10:44:26.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.251+0000 7fef8bfff640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c0af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.250+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f095804e840 con 0x7f0958159210 2023-12-04T10:44:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.252+0000 7fef8b7fe640 1 -- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 msgr2=0x7fef8c0af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.252+0000 7fef8b7fe640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c0af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.252+0000 7fef8b7fe640 1 -- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cf7d0 msgr2=0x7fef8c0adff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-04T10:44:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.252+0000 7fef8b7fe640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cf7d0 0x7fef8c0adff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.252+0000 7fef8b7fe640 1 -- 172.21.15.63:0/1189668534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c009b30 con 0x7fef8c070be0 2023-12-04T10:44:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.252+0000 7fef8bfff640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:44:26.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.252+0000 7fef8b7fe640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef8c070be0 0x7fef8c145cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef7c000f80 tx=0x7fef7c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.251+0000 7f9266ffd640 1 -- 172.21.15.63:0/2107581636 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9268003990 con 0x7f9270153b90 2023-12-04T10:44:26.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.254+0000 7f9266ffd640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f925406aea0 0x7f925406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.254+0000 7f9266ffd640 1 -- 172.21.15.63:0/2107581636 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f926808a150 con 0x7f9270153b90 2023-12-04T10:44:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.254+0000 7f92760cf640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f925406aea0 0x7f925406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.256+0000 7f92760cf640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f925406aea0 0x7f925406d360 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f926c004900 tx=0x7f926c00a280 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.256+0000 7f09557fa640 1 -- 172.21.15.63:0/2502786522 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f09500433a0 con 0x7f0958159210 2023-12-04T10:44:26.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.257+0000 7f09557fa640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f093806ae90 0x7f093806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.257+0000 7f09557fa640 1 -- 172.21.15.63:0/2502786522 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f09500ab3b0 con 0x7f0958159210 2023-12-04T10:44:26.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.258+0000 7f0957fff640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f093806ae90 0x7f093806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.259+0000 7f0957fff640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f093806ae90 0x7f093806d350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0948001560 tx=0x7f0948007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.261+0000 7fef73fff640 1 -- 172.21.15.63:0/1189668534 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c03e450 con 0x7fef8c070be0 2023-12-04T10:44:26.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.262+0000 7fef73fff640 1 -- 172.21.15.63:0/1189668534 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c03e5b0 con 0x7fef8c070be0 2023-12-04T10:44:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.262+0000 7fef73fff640 1 -- 172.21.15.63:0/1189668534 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c03e960 con 0x7fef8c070be0 2023-12-04T10:44:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.262+0000 7f9266ffd640 1 -- 172.21.15.63:0/2107581636 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9268054ef0 con 0x7f9270153b90 2023-12-04T10:44:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.262+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef8c0cc760 con 0x7fef8c070be0 2023-12-04T10:44:26.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.262+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef8c0cda80 con 0x7fef8c070be0 2023-12-04T10:44:26.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.263+0000 7f09557fa640 1 -- 172.21.15.63:0/2502786522 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f09500b0060 con 0x7f0958159210 2023-12-04T10:44:26.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.265+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8c068710 con 0x7fef8c070be0 2023-12-04T10:44:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.267+0000 7fef73fff640 1 -- 172.21.15.63:0/1189668534 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef7c02cd50 con 0x7fef8c070be0 2023-12-04T10:44:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.268+0000 7fef73fff640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef7806af10 0x7fef7806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.268+0000 7fef73fff640 1 -- 172.21.15.63:0/1189668534 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fef7c0ac3e0 con 0x7fef8c070be0 2023-12-04T10:44:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.270+0000 7fef8affd640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef7806af10 0x7fef7806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.271+0000 7fef8affd640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef7806af10 0x7fef7806d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef8c1fa270 tx=0x7fef80008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.283+0000 7fef73fff640 1 -- 172.21.15.63:0/1189668534 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef7c077180 con 0x7fef8c070be0 2023-12-04T10:44:26.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.299+0000 7f1358072640 1 Processor -- start 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.299+0000 7f1358072640 1 -- start start 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.300+0000 7f1358072640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f13500cfee0 0x7f13500d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.300+0000 7f1358072640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500d02c0 0x7f13500c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.300+0000 7f1358072640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500ce810 con 0x7f13500b4770 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.300+0000 7f1358072640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13500cf240 con 0x7f13500cfee0 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.300+0000 7f1358072640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13500d3d10 con 0x7f13500d02c0 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.301+0000 7f1355e0e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f13500cfee0 0x7f13500d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.301+0000 7f1355e0e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f13500cfee0 0x7f13500d0ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34452/0 (socket says 172.21.15.63:34452) 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.301+0000 7f1355e0e640 1 -- 172.21.15.63:0/3998037824 learned_addr learned my addr 172.21.15.63:0/3998037824 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.301+0000 7f135660f640 1 --2- 172.21.15.63:0/3998037824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500d02c0 0x7f13500c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.302+0000 7f1355e0e640 1 -- 172.21.15.63:0/3998037824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500d02c0 msgr2=0x7f13500c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.302+0000 7f1355e0e640 1 --2- 172.21.15.63:0/3998037824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500d02c0 0x7f13500c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.302+0000 7f1355e0e640 1 -- 172.21.15.63:0/3998037824 >> v1:172.21.15.63:6789/0 conn(0x7f13500b4770 legacy=0x7f13500d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.303+0000 7f1355e0e640 1 -- 172.21.15.63:0/3998037824 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13500d3ff0 con 0x7f13500cfee0 2023-12-04T10:44:26.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.305+0000 7f1355e0e640 1 --2- 172.21.15.63:0/3998037824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500cfee0 0x7f13500d0ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1340009e80 tx=0x7f134002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a9b428924079a1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.305+0000 7f1354e0c640 1 -- 172.21.15.63:0/3998037824 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134002ca70 con 0x7f13500cfee0 2023-12-04T10:44:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.306+0000 7f1354e0c640 1 -- 172.21.15.63:0/3998037824 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134002cbd0 con 0x7f13500cfee0 2023-12-04T10:44:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.306+0000 7f1354e0c640 1 -- 172.21.15.63:0/3998037824 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134002ca70 con 0x7f13500cfee0 2023-12-04T10:44:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.308+0000 7f1358072640 1 -- 172.21.15.63:0/3998037824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500cfee0 msgr2=0x7f13500d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.308+0000 7f1358072640 1 --2- 172.21.15.63:0/3998037824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500cfee0 0x7f13500d0ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1340009e80 tx=0x7f134002bed0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.308+0000 7f1358072640 1 -- 172.21.15.63:0/3998037824 shutdown_connections 2023-12-04T10:44:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.308+0000 7f1358072640 1 --2- 172.21.15.63:0/3998037824 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500d02c0 0x7f13500c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.308+0000 7f1358072640 1 --2- 172.21.15.63:0/3998037824 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500cfee0 0x7f13500d0ea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.308+0000 7f1358072640 1 -- 172.21.15.63:0/3998037824 >> 172.21.15.63:0/3998037824 conn(0x7f135009c610 msgr2=0x7f13500d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.309+0000 7f1358072640 1 -- 172.21.15.63:0/3998037824 shutdown_connections 2023-12-04T10:44:26.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.309+0000 7f1358072640 1 -- 172.21.15.63:0/3998037824 wait complete. 2023-12-04T10:44:26.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.313+0000 7f1358072640 1 Processor -- start 2023-12-04T10:44:26.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.313+0000 7f1358072640 1 -- start start 2023-12-04T10:44:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.315+0000 7f1358072640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13500b4770 0x7f13501e7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.316+0000 7f1358072640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500cfee0 0x7f135015c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.316+0000 7f1358072640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500d02c0 0x7f13501e6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.316+0000 7f1355e0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13500b4770 0x7f13501e7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.316+0000 7f1355e0e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13500b4770 0x7f13501e7e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54822/0 (socket says 172.21.15.63:54822) 2023-12-04T10:44:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.317+0000 7f1355e0e640 1 -- 172.21.15.63:0/3213292563 learned_addr learned my addr 172.21.15.63:0/3213292563 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.317+0000 7f135660f640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500d02c0 0x7f13501e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.318+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501e7a10 con 0x7f13500d02c0 2023-12-04T10:44:26.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.318+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501e6d90 con 0x7f13500b4770 2023-12-04T10:44:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.318+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13501e7070 con 0x7f13500cfee0 2023-12-04T10:44:26.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.319+0000 7f135560d640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500cfee0 0x7f135015c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.320+0000 7f1355e0e640 1 -- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500cfee0 msgr2=0x7f135015c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.320+0000 7f1355e0e640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500cfee0 0x7f135015c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.320+0000 7f1355e0e640 1 -- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500d02c0 msgr2=0x7f13501e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.320+0000 7f1355e0e640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500d02c0 0x7f13501e6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.320+0000 7fcfef5b6640 1 Processor -- start 2023-12-04T10:44:26.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.320+0000 7fcfef5b6640 1 -- start start 2023-12-04T10:44:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.321+0000 7f1355e0e640 1 -- 172.21.15.63:0/3213292563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1340009b30 con 0x7f13500b4770 2023-12-04T10:44:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.322+0000 7fcfef5b6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcfe80cfee0 0x7fcfe80d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.322+0000 7f135560d640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500cfee0 0x7f135015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.322+0000 7fcfef5b6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 0x7fcfe80c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.322+0000 7fcfef5b6640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfe80ce810 con 0x7fcfe80b4770 2023-12-04T10:44:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.322+0000 7fcfef5b6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfe80cf240 con 0x7fcfe80cfee0 2023-12-04T10:44:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.322+0000 7fcfef5b6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80d3d10 con 0x7fcfe80d02c0 2023-12-04T10:44:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.323+0000 7fcfecb51640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcfe80b4770 0x7fcfe80d13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43802/0 (socket says 172.21.15.63:43802) 2023-12-04T10:44:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.323+0000 7fcfecb51640 1 -- 172.21.15.63:0/1767628040 learned_addr learned my addr 172.21.15.63:0/1767628040 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:26.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.323+0000 7fcfed352640 1 --2- 172.21.15.63:0/1767628040 >> v2:172.21.15.66:3300/0 conn(0x7fcfe80cfee0 0x7fcfe80d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.323+0000 7f1355e0e640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13500b4770 0x7f13501e7e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1340009e80 tx=0x7f1340004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.324+0000 7fcfedb53640 1 --2- 172.21.15.63:0/1767628040 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 0x7fcfe80c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.324+0000 7fcfed352640 1 -- 172.21.15.63:0/1767628040 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 msgr2=0x7fcfe80c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.324+0000 7fcfed352640 1 --2- 172.21.15.63:0/1767628040 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 0x7fcfe80c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.324+0000 7fcfed352640 1 -- 172.21.15.63:0/1767628040 >> v1:172.21.15.63:6789/0 conn(0x7fcfe80b4770 legacy=0x7fcfe80d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.324+0000 7fcfed352640 1 -- 172.21.15.63:0/1767628040 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfe80d3ff0 con 0x7fcfe80cfee0 2023-12-04T10:44:26.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.324+0000 7f134e7fc640 1 -- 172.21.15.63:0/3213292563 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134002ca70 con 0x7f13500b4770 2023-12-04T10:44:26.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.325+0000 7f134e7fc640 1 -- 172.21.15.63:0/3213292563 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340009510 con 0x7f13500b4770 2023-12-04T10:44:26.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.325+0000 7f134e7fc640 1 -- 172.21.15.63:0/3213292563 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134003e660 con 0x7f13500b4770 2023-12-04T10:44:26.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.325+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13501e7350 con 0x7f13500b4770 2023-12-04T10:44:26.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.325+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f135015ca10 con 0x7f13500b4770 2023-12-04T10:44:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.327+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13500675f0 con 0x7f13500b4770 2023-12-04T10:44:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.327+0000 7fcfed352640 1 --2- 172.21.15.63:0/1767628040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80d0ea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80097d0 tx=0x7fcfd802b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34a51a08340c9942 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.328+0000 7fcfdffff640 1 -- 172.21.15.63:0/1767628040 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8030710 con 0x7fcfe80cfee0 2023-12-04T10:44:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.328+0000 7fcfdffff640 1 -- 172.21.15.63:0/1767628040 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfd802e050 con 0x7fcfe80cfee0 2023-12-04T10:44:26.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.328+0000 7fcfdffff640 1 -- 172.21.15.63:0/1767628040 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfd8030710 con 0x7fcfe80cfee0 2023-12-04T10:44:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.329+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1767628040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80cfee0 msgr2=0x7fcfe80d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.329+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1767628040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80d0ea0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fcfd80097d0 tx=0x7fcfd802b710 comp rx=0 tx=0).stop 2023-12-04T10:44:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.329+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1767628040 shutdown_connections 2023-12-04T10:44:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.329+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1767628040 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 0x7fcfe80c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.329+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1767628040 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80d0ea0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.329+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1767628040 >> 172.21.15.63:0/1767628040 conn(0x7fcfe809c610 msgr2=0x7fcfe80d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.330+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1767628040 shutdown_connections 2023-12-04T10:44:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.330+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1767628040 wait complete. 2023-12-04T10:44:26.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.331+0000 7f134e7fc640 1 -- 172.21.15.63:0/3213292563 <== mon.1 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f134003e7c0 con 0x7f13500b4770 2023-12-04T10:44:26.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.333+0000 7f134e7fc640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f133c06ae40 0x7f133c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.333+0000 7f134e7fc640 1 -- 172.21.15.63:0/3213292563 <== mon.1 v2:172.21.15.66:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f13400ac990 con 0x7f13500b4770 2023-12-04T10:44:26.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.333+0000 7f135560d640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f133c06ae40 0x7f133c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.334+0000 7fcfef5b6640 1 Processor -- start 2023-12-04T10:44:26.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.334+0000 7fcfef5b6640 1 -- start start 2023-12-04T10:44:26.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.335+0000 7f135560d640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f133c06ae40 0x7f133c06d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13501f6fa0 tx=0x7f1344009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.336+0000 7fcfef5b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80b4770 0x7fcfe8153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.336+0000 7fcfef5b6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.336+0000 7fcfef5b6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 0x7fcfe81605c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.336+0000 7fcfef5b6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe815fe20 con 0x7fcfe80cfee0 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.336+0000 7fcfef5b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe8153f60 con 0x7fcfe80b4770 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.336+0000 7fcfef5b6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfe80ca710 con 0x7fcfe80d02c0 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.336+0000 7fcfed352640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80b4770 0x7fcfe8153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfecb51640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfecb51640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80b08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34480/0 (socket says 172.21.15.63:34480) 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfecb51640 1 -- 172.21.15.63:0/1962191664 learned_addr learned my addr 172.21.15.63:0/1962191664 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.339 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfedb53640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 0x7fcfe81605c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfecb51640 1 -- 172.21.15.63:0/1962191664 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 msgr2=0x7fcfe81605c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfecb51640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 0x7fcfe81605c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfecb51640 1 -- 172.21.15.63:0/1962191664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80b4770 msgr2=0x7fcfe8153a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfecb51640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80b4770 0x7fcfe8153a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.337+0000 7fcfecb51640 1 -- 172.21.15.63:0/1962191664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd8009400 con 0x7fcfe80cfee0 2023-12-04T10:44:26.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.338+0000 7fcfecb51640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80b08e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400caf0 tx=0x7fcfe4002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.338+0000 7fcfddffb640 1 -- 172.21.15.63:0/1962191664 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400a7c0 con 0x7fcfe80cfee0 2023-12-04T10:44:26.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.338+0000 7fcfddffb640 1 -- 172.21.15.63:0/1962191664 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfe400a920 con 0x7fcfe80cfee0 2023-12-04T10:44:26.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.338+0000 7fcfddffb640 1 -- 172.21.15.63:0/1962191664 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfe400ac90 con 0x7fcfe80cfee0 2023-12-04T10:44:26.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.339+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfe80ca9f0 con 0x7fcfe80cfee0 2023-12-04T10:44:26.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.339+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfe80cafb0 con 0x7fcfe80cfee0 2023-12-04T10:44:26.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.340+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfe80d1aa0 con 0x7fcfe80cfee0 2023-12-04T10:44:26.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.341+0000 7fcfddffb640 1 -- 172.21.15.63:0/1962191664 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcfe40070d0 con 0x7fcfe80cfee0 2023-12-04T10:44:26.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.343+0000 7fcfddffb640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcfcc06af10 0x7fcfcc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.343+0000 7fcfddffb640 1 -- 172.21.15.63:0/1962191664 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcfe4089330 con 0x7fcfe80cfee0 2023-12-04T10:44:26.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.344+0000 7fcfed352640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcfcc06af10 0x7fcfcc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.346+0000 7fcfed352640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcfcc06af10 0x7fcfcc06d3d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8034000 tx=0x7fcfd8008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.346+0000 7f134e7fc640 1 -- 172.21.15.63:0/3213292563 <== mon.1 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13400778e0 con 0x7f13500b4770 2023-12-04T10:44:26.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.349+0000 7fcfddffb640 1 -- 172.21.15.63:0/1962191664 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcfe4054180 con 0x7fcfe80cfee0 2023-12-04T10:44:26.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.384+0000 7f4668905640 1 Processor -- start 2023-12-04T10:44:26.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.384+0000 7f4668905640 1 -- start start 2023-12-04T10:44:26.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.386+0000 7f4668905640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f466415d270 0x7f46640d3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.387+0000 7f4668905640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d650 0x7f46640cf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.387+0000 7f4668905640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f46640d0410 0x7f46640cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.387+0000 7f4668905640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46640ce6f0 con 0x7f46640d0410 2023-12-04T10:44:26.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.387+0000 7f4668905640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46640b2a40 con 0x7f466415d270 2023-12-04T10:44:26.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.387+0000 7f4668905640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46640ce8d0 con 0x7f466415d650 2023-12-04T10:44:26.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.388+0000 7f466259c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f466415d270 0x7f46640d3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.388+0000 7f4661d9b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d650 0x7f46640cf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.388+0000 7f4661d9b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d650 0x7f46640cf720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48796/0 (socket says 172.21.15.63:48796) 2023-12-04T10:44:26.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.389+0000 7f4661d9b640 1 -- 172.21.15.63:0/3109999456 learned_addr learned my addr 172.21.15.63:0/3109999456 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.390+0000 7f4661d9b640 1 -- 172.21.15.63:0/3109999456 >> v2:172.21.15.66:3300/0 conn(0x7f466415d270 msgr2=0x7f46640d3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.390+0000 7f4661d9b640 1 --2- 172.21.15.63:0/3109999456 >> v2:172.21.15.66:3300/0 conn(0x7f466415d270 0x7f46640d3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.390+0000 7f4661d9b640 1 -- 172.21.15.63:0/3109999456 >> v2:172.21.15.63:3300/0 conn(0x7f46640d0410 msgr2=0x7f46640cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.390+0000 7f4661d9b640 1 --2- 172.21.15.63:0/3109999456 >> v2:172.21.15.63:3300/0 conn(0x7f46640d0410 0x7f46640cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.391+0000 7f4661d9b640 1 -- 172.21.15.63:0/3109999456 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46640cebb0 con 0x7f466415d650 2023-12-04T10:44:26.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.393+0000 7f4661d9b640 1 --2- 172.21.15.63:0/3109999456 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d650 0x7f46640cf720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f466408d4d0 tx=0x7f465802b7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=999cd1c526af1cb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.393+0000 7f466159a640 1 -- 172.21.15.63:0/3109999456 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658031750 con 0x7f466415d650 2023-12-04T10:44:26.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.393+0000 7f466159a640 1 -- 172.21.15.63:0/3109999456 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46580318b0 con 0x7f466415d650 2023-12-04T10:44:26.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.393+0000 7f466159a640 1 -- 172.21.15.63:0/3109999456 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658031c40 con 0x7f466415d650 2023-12-04T10:44:26.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.396+0000 7f4668905640 1 -- 172.21.15.63:0/3109999456 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d650 msgr2=0x7f46640cf720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.396+0000 7f4668905640 1 --2- 172.21.15.63:0/3109999456 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d650 0x7f46640cf720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f466408d4d0 tx=0x7f465802b7f0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.396+0000 7f4668905640 1 -- 172.21.15.63:0/3109999456 shutdown_connections 2023-12-04T10:44:26.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.396+0000 7f4668905640 1 --2- 172.21.15.63:0/3109999456 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d650 0x7f46640cf720 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.396+0000 7f4668905640 1 --2- 172.21.15.63:0/3109999456 >> v2:172.21.15.63:3300/0 conn(0x7f46640d0410 0x7f46640cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.396+0000 7f4668905640 1 --2- 172.21.15.63:0/3109999456 >> v2:172.21.15.66:3300/0 conn(0x7f466415d270 0x7f46640d3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.398 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.396+0000 7f4668905640 1 -- 172.21.15.63:0/3109999456 >> 172.21.15.63:0/3109999456 conn(0x7f466409c3e0 msgr2=0x7f46640d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.397+0000 7f4668905640 1 -- 172.21.15.63:0/3109999456 shutdown_connections 2023-12-04T10:44:26.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.399+0000 7f1ceddb6640 1 Processor -- start 2023-12-04T10:44:26.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.399+0000 7f1ceddb6640 1 -- start start 2023-12-04T10:44:26.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.397+0000 7f4668905640 1 -- 172.21.15.63:0/3109999456 wait complete. 2023-12-04T10:44:26.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.400+0000 7f4668905640 1 Processor -- start 2023-12-04T10:44:26.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.400+0000 7f4668905640 1 -- start start 2023-12-04T10:44:26.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.401+0000 7f2de350f640 1 Processor -- start 2023-12-04T10:44:26.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.402+0000 7f1ceddb6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1ce80cfee0 0x7f1ce80d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.402+0000 7f1ceddb6640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1ce80b4770 0x7f1ce80d13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.402+0000 7f4668905640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46640d0410 0x7f46640b8840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.401+0000 7f2de350f640 1 -- start start 2023-12-04T10:44:26.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f4668905640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d270 0x7f466415ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.402+0000 7f1ceddb6640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ce80ce810 con 0x7f1ce80d02c0 2023-12-04T10:44:26.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f466259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46640d0410 0x7f46640b8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f1ceddb6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80cf240 con 0x7f1ce80cfee0 2023-12-04T10:44:26.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f4668905640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f466415d650 0x7f466415fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f466259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46640d0410 0x7f46640b8840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34502/0 (socket says 172.21.15.63:34502) 2023-12-04T10:44:26.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f4668905640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466415ded0 con 0x7f46640d0410 2023-12-04T10:44:26.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f4668905640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f466415e1b0 con 0x7f466415d650 2023-12-04T10:44:26.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f4668905640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f466415e490 con 0x7f466415d270 2023-12-04T10:44:26.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f1ceddb6640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ce80d3d10 con 0x7f1ce80b4770 2023-12-04T10:44:26.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f1ce6ffd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1ce80b4770 0x7f1ce80d13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f4662d9d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f466415d650 0x7f466415fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f1ce7fff640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f1ce80d02c0 0x7f1ce81613c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:52668/0 (socket says 172.21.15.63:52668) 2023-12-04T10:44:26.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.403+0000 7f1ce7fff640 1 -- 172.21.15.63:0/597787934 learned_addr learned my addr 172.21.15.63:0/597787934 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:26.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f1ce77fe640 1 --2- 172.21.15.63:0/597787934 >> v2:172.21.15.63:3300/0 conn(0x7f1ce80cfee0 0x7f1ce80d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f2de350f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2ddc14a9b0 0x7f2ddc06ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f2de350f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2ddc0cf9a0 0x7f2ddc0b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f2de350f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ddc06d410 con 0x7f2ddc070be0 2023-12-04T10:44:26.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f2de350f640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc070270 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f2de350f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ddc070550 con 0x7f2ddc14a9b0 2023-12-04T10:44:26.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f466259c640 1 -- 172.21.15.63:0/2050496368 learned_addr learned my addr 172.21.15.63:0/2050496368 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.404+0000 7f4661d9b640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d270 0x7f466415ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f2de0aaa640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f2ddc070be0 0x7f2ddc0cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:52678/0 (socket says 172.21.15.63:52678) 2023-12-04T10:44:26.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f2de0aaa640 1 -- 172.21.15.63:0/3250453436 learned_addr learned my addr 172.21.15.63:0/3250453436 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:26.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f2de1aac640 1 --2- 172.21.15.63:0/3250453436 >> v2:172.21.15.63:3300/0 conn(0x7f2ddc0cf9a0 0x7f2ddc0b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f2de12ab640 1 --2- 172.21.15.63:0/3250453436 >> v2:172.21.15.66:3300/0 conn(0x7f2ddc14a9b0 0x7f2ddc06ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f1ce77fe640 1 -- 172.21.15.63:0/597787934 >> v2:172.21.15.66:3300/0 conn(0x7f1ce80b4770 msgr2=0x7f1ce80d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f1ce77fe640 1 --2- 172.21.15.63:0/597787934 >> v2:172.21.15.66:3300/0 conn(0x7f1ce80b4770 0x7f1ce80d13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f2de1aac640 1 -- 172.21.15.63:0/3250453436 >> v2:172.21.15.66:3300/0 conn(0x7f2ddc14a9b0 msgr2=0x7f2ddc06ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:26.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f4661d9b640 1 -- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f466415d650 msgr2=0x7f466415fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f4661d9b640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f466415d650 0x7f466415fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f4661d9b640 1 -- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46640d0410 msgr2=0x7f46640b8840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f4661d9b640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46640d0410 0x7f46640b8840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f4661d9b640 1 -- 172.21.15.63:0/2050496368 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46580094d0 con 0x7f466415d270 2023-12-04T10:44:26.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f4662d9d640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f466415d650 0x7f466415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:26.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f466259c640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46640d0410 0x7f46640b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:26.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.406+0000 7f2de1aac640 1 --2- 172.21.15.63:0/3250453436 >> v2:172.21.15.66:3300/0 conn(0x7f2ddc14a9b0 0x7f2ddc06ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.406+0000 7f2de1aac640 1 -- 172.21.15.63:0/3250453436 >> v1:172.21.15.66:6789/0 conn(0x7f2ddc070be0 legacy=0x7f2ddc0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.406+0000 7f2de1aac640 1 -- 172.21.15.63:0/3250453436 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ddc070830 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f1ce77fe640 1 -- 172.21.15.63:0/597787934 >> v1:172.21.15.66:6789/0 conn(0x7f1ce80d02c0 legacy=0x7f1ce81613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.405+0000 7f1ce77fe640 1 -- 172.21.15.63:0/597787934 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce80d3ff0 con 0x7f1ce80cfee0 2023-12-04T10:44:26.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.407+0000 7f4661d9b640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d270 0x7f466415ef70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4658033000 tx=0x7f46580046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f1ce77fe640 1 --2- 172.21.15.63:0/597787934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80d0ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80097d0 tx=0x7f1cd802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e12d3e40bdf2b941 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f4652ffd640 1 -- 172.21.15.63:0/2050496368 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658033c80 con 0x7f466415d270 2023-12-04T10:44:26.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f2de1aac640 1 --2- 172.21.15.63:0/3250453436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 0x7f2ddc0b28d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0b4270 tx=0x7f2dd402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d326e400efedd45e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f2dd3fff640 1 -- 172.21.15.63:0/3250453436 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd402cbe0 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f4668905640 1 -- 172.21.15.63:0/2050496368 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f466415e770 con 0x7f466415d270 2023-12-04T10:44:26.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f4668905640 1 -- 172.21.15.63:0/2050496368 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4664160390 con 0x7f466415d270 2023-12-04T10:44:26.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f4652ffd640 1 -- 172.21.15.63:0/2050496368 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4658033de0 con 0x7f466415d270 2023-12-04T10:44:26.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f4652ffd640 1 -- 172.21.15.63:0/2050496368 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4658033c80 con 0x7f466415d270 2023-12-04T10:44:26.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f2dd3fff640 1 -- 172.21.15.63:0/3250453436 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dd402cd40 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.408+0000 7f2dd3fff640 1 -- 172.21.15.63:0/3250453436 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd402cbe0 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.410+0000 7f2de350f640 1 -- 172.21.15.63:0/3250453436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 msgr2=0x7f2ddc0b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.417 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.410+0000 7f2de350f640 1 --2- 172.21.15.63:0/3250453436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 0x7f2ddc0b28d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc0b4270 tx=0x7f2dd402be30 comp rx=0 tx=0).stop 2023-12-04T10:44:26.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.410+0000 7f1ce67fc640 1 -- 172.21.15.63:0/597787934 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd802d040 con 0x7f1ce80cfee0 2023-12-04T10:44:26.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.410+0000 7f1ce67fc640 1 -- 172.21.15.63:0/597787934 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8031810 con 0x7f1ce80cfee0 2023-12-04T10:44:26.418 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.410+0000 7f1ce67fc640 1 -- 172.21.15.63:0/597787934 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8031ba0 con 0x7f1ce80cfee0 2023-12-04T10:44:26.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.411+0000 7f2de350f640 1 -- 172.21.15.63:0/3250453436 shutdown_connections 2023-12-04T10:44:26.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.411+0000 7f2de350f640 1 --2- 172.21.15.63:0/3250453436 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 0x7f2ddc0b28d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.411+0000 7f2de350f640 1 --2- 172.21.15.63:0/3250453436 >> v2:172.21.15.66:3300/0 conn(0x7f2ddc14a9b0 0x7f2ddc06ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.411+0000 7f2de350f640 1 -- 172.21.15.63:0/3250453436 >> 172.21.15.63:0/3250453436 conn(0x7f2ddc06a8a0 msgr2=0x7f2ddc06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.411+0000 7f2de350f640 1 -- 172.21.15.63:0/3250453436 shutdown_connections 2023-12-04T10:44:26.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.411+0000 7f2de350f640 1 -- 172.21.15.63:0/3250453436 wait complete. 2023-12-04T10:44:26.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.412+0000 7f4650ff9640 1 -- 172.21.15.63:0/2050496368 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c005250 con 0x7f466415d270 2023-12-04T10:44:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.411+0000 7f1ceddb6640 1 -- 172.21.15.63:0/597787934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 msgr2=0x7f1ce80d0ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.411+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/597787934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80d0ea0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1cd80097d0 tx=0x7f1cd802b8b0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.414+0000 7f1ceddb6640 1 -- 172.21.15.63:0/597787934 shutdown_connections 2023-12-04T10:44:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.414+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/597787934 >> v2:172.21.15.66:3300/0 conn(0x7f1ce80b4770 0x7f1ce80d13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.414+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/597787934 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80d0ea0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.414+0000 7f1ceddb6640 1 -- 172.21.15.63:0/597787934 >> 172.21.15.63:0/597787934 conn(0x7f1ce809c610 msgr2=0x7f1ce80d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.414+0000 7f1ceddb6640 1 -- 172.21.15.63:0/597787934 shutdown_connections 2023-12-04T10:44:26.421 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.415+0000 7f2de350f640 1 Processor -- start 2023-12-04T10:44:26.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.415+0000 7f2de350f640 1 -- start start 2023-12-04T10:44:26.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.414+0000 7f4652ffd640 1 -- 172.21.15.63:0/2050496368 <== mon.2 v2:172.21.15.66:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f465803a040 con 0x7f466415d270 2023-12-04T10:44:26.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.416+0000 7f4652ffd640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f464406aea0 0x7f464406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.417+0000 7f466259c640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f464406aea0 0x7f464406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.414+0000 7f1ceddb6640 1 -- 172.21.15.63:0/597787934 wait complete. 2023-12-04T10:44:26.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.417+0000 7f1ceddb6640 1 Processor -- start 2023-12-04T10:44:26.422 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.417+0000 7f1ceddb6640 1 -- start start 2023-12-04T10:44:26.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.417+0000 7f2de350f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc070be0 0x7f2ddc144050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f2de350f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 0x7f2ddc164b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f2de350f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc14a9b0 0x7f2ddc165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f466259c640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f464406aea0 0x7f464406d360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4654006fd0 tx=0x7f4654008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.423 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f4652ffd640 1 -- 172.21.15.63:0/2050496368 <== mon.2 v2:172.21.15.66:3301/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4658079ef0 con 0x7f466415d270 2023-12-04T10:44:26.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f2de350f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc0cc520 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f2de12ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc070be0 0x7f2ddc144050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f2de12ab640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc070be0 0x7f2ddc144050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54884/0 (socket says 172.21.15.63:54884) 2023-12-04T10:44:26.424 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f2de12ab640 1 -- 172.21.15.63:0/2695308631 learned_addr learned my addr 172.21.15.63:0/2695308631 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.418+0000 7f2de1aac640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc14a9b0 0x7f2ddc165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.419+0000 7f2de0aaa640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 0x7f2ddc164b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.419+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc144590 con 0x7f2ddc070be0 2023-12-04T10:44:26.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.419+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ddc1656c0 con 0x7f2ddc14a9b0 2023-12-04T10:44:26.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.419+0000 7f1ceddb6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ce80b4770 0x7f1ce8156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.425 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.420+0000 7f1ceddb6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.420+0000 7f2de0aaa640 1 -- 172.21.15.63:0/2695308631 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc14a9b0 msgr2=0x7f2ddc165040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.426 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.420+0000 7f1ceddb6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ce80d02c0 0x7f1ce80c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.420+0000 7f2de0aaa640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc14a9b0 0x7f2ddc165040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.420+0000 7f2de0aaa640 1 -- 172.21.15.63:0/2695308631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc070be0 msgr2=0x7f2ddc144050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ce6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ce77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ce80b4770 0x7f1ce8156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ce77fe640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ce80b4770 0x7f1ce8156810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54890/0 (socket says 172.21.15.63:54890) 2023-12-04T10:44:26.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ce6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34536/0 (socket says 172.21.15.63:34536) 2023-12-04T10:44:26.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80cc1a0 con 0x7f1ce80cfee0 2023-12-04T10:44:26.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ce77fe640 1 -- 172.21.15.63:0/1543542398 learned_addr learned my addr 172.21.15.63:0/1543542398 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:26.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80cc480 con 0x7f1ce80b4770 2023-12-04T10:44:26.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce80cc760 con 0x7f1ce80d02c0 2023-12-04T10:44:26.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f1ce7fff640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ce80d02c0 0x7f1ce80c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.420+0000 7f2de0aaa640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc070be0 0x7f2ddc144050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f1ce6ffd640 1 -- 172.21.15.63:0/1543542398 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ce80d02c0 msgr2=0x7f1ce80c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f1ce6ffd640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ce80d02c0 0x7f1ce80c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f1ce6ffd640 1 -- 172.21.15.63:0/1543542398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ce80b4770 msgr2=0x7f1ce8156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f1ce6ffd640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ce80b4770 0x7f1ce8156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f1ce6ffd640 1 -- 172.21.15.63:0/1543542398 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd8009400 con 0x7f1ce80cfee0 2023-12-04T10:44:26.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.420+0000 7f2de0aaa640 1 -- 172.21.15.63:0/2695308631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd4009a70 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.421+0000 7f2de0aaa640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 0x7f2ddc164b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc007fd0 tx=0x7f2dcc00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f2dd1ffb640 1 -- 172.21.15.63:0/2695308631 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc005ce0 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ddc1659a0 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ddc0cc730 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f2dd1ffb640 1 -- 172.21.15.63:0/2695308631 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dcc005e40 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.422+0000 7f2dd1ffb640 1 -- 172.21.15.63:0/2695308631 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dcc005ce0 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.423+0000 7f1ce6ffd640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80cb830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00e840 tx=0x7f1cdc00ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.425+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dbc005250 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.425+0000 7f1ccffff640 1 -- 172.21.15.63:0/1543542398 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00c730 con 0x7f1ce80cfee0 2023-12-04T10:44:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.425+0000 7f1ccffff640 1 -- 172.21.15.63:0/1543542398 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cdc00c890 con 0x7f1ce80cfee0 2023-12-04T10:44:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.425+0000 7f1ccffff640 1 -- 172.21.15.63:0/1543542398 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cdc00cc20 con 0x7f1ce80cfee0 2023-12-04T10:44:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.425+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ce80cca40 con 0x7f1ce80cfee0 2023-12-04T10:44:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.425+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ce80cbd70 con 0x7f1ce80cfee0 2023-12-04T10:44:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.428+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ce8068710 con 0x7f1ce80cfee0 2023-12-04T10:44:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.427+0000 7f2dd1ffb640 1 -- 172.21.15.63:0/2695308631 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2dcc007070 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.429+0000 7f2dd1ffb640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2dc006aea0 0x7f2dc006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.429+0000 7f2dd1ffb640 1 -- 172.21.15.63:0/2695308631 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2dcc088940 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.430+0000 7f2de12ab640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2dc006aea0 0x7f2dc006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.430+0000 7f1ccffff640 1 -- 172.21.15.63:0/1543542398 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1cdc013470 con 0x7f1ce80cfee0 2023-12-04T10:44:26.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.431+0000 7f4652ffd640 1 -- 172.21.15.63:0/2050496368 <== mon.2 v2:172.21.15.66:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f46580769c0 con 0x7f466415d270 2023-12-04T10:44:26.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.432+0000 7f2de12ab640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2dc006aea0 0x7f2dc006d360 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8007a60 tx=0x7f2dd8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.432+0000 7f1ccffff640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1cd406ae90 0x7f1cd406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:26.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.432+0000 7f1ccffff640 1 -- 172.21.15.63:0/1543542398 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1cdc0897e0 con 0x7f1ce80cfee0 2023-12-04T10:44:26.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.437+0000 7f1ce77fe640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1cd406ae90 0x7f1cd406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:26.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.439+0000 7f1ce77fe640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1cd406ae90 0x7f1cd406d350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1cd802b8f0 tx=0x7f1cd803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:26.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.441+0000 7f2dd1ffb640 1 -- 172.21.15.63:0/2695308631 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2dcc053840 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.449+0000 7f1ccffff640 1 -- 172.21.15.63:0/1543542398 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1cdc0546c0 con 0x7f1ce80cfee0 2023-12-04T10:44:26.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.660+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f09580c2530 con 0x7f0958159210 2023-12-04T10:44:26.663 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.661+0000 7f09557fa640 1 -- 172.21.15.63:0/2502786522 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0950076160 con 0x7f0958159210 2023-12-04T10:44:26.666 INFO:teuthology.orchestra.run.smithi063.stdout:60129542154 2023-12-04T10:44:26.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.665+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f093806ae90 msgr2=0x7f093806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.665+0000 7f095d28c640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f093806ae90 0x7f093806d350 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0948001560 tx=0x7f0948007c10 comp rx=0 tx=0).stop 2023-12-04T10:44:26.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.665+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0958159210 msgr2=0x7f095814cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.665+0000 7f095d28c640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0958159210 0x7f095814cbb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f09500097a0 tx=0x7f09500046c0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.665+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 shutdown_connections 2023-12-04T10:44:26.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.666+0000 7f095d28c640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f093806ae90 0x7f093806d350 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.666+0000 7f095d28c640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f09580cbd40 0x7f095814c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.666+0000 7f095d28c640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0958159210 0x7f095814cbb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.666+0000 7f095d28c640 1 --2- 172.21.15.63:0/2502786522 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f095806e1c0 0x7f095816b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.666+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 >> 172.21.15.63:0/2502786522 conn(0x7f09580b07f0 msgr2=0x7f09581583c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.666+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 shutdown_connections 2023-12-04T10:44:26.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.666+0000 7f095d28c640 1 -- 172.21.15.63:0/2502786522 wait complete. 2023-12-04T10:44:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.691+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f92580057d0 con 0x7f9270153b90 2023-12-04T10:44:26.694 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.693+0000 7f9266ffd640 1 -- 172.21.15.63:0/2107581636 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9268058510 con 0x7f9270153b90 2023-12-04T10:44:26.695 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2023-12-04T10:44:26.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.2 2023-12-04T10:44:26.696 DEBUG:teuthology.parallel:result is None 2023-12-04T10:44:26.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.696+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f925406aea0 msgr2=0x7f925406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.696+0000 7f9278333640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f925406aea0 0x7f925406d360 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f926c004900 tx=0x7f926c00a280 comp rx=0 tx=0).stop 2023-12-04T10:44:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.697+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9270153b90 msgr2=0x7f92700b2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.697+0000 7f9278333640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9270153b90 0x7f92700b2e30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9268007cc0 tx=0x7f926800e4b0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.697+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 shutdown_connections 2023-12-04T10:44:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.697+0000 7f9278333640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f925406aea0 0x7f925406d360 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.697+0000 7f9278333640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9270153b90 0x7f92700b2e30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.697+0000 7f9278333640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92701537b0 0x7f92701e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.697+0000 7f9278333640 1 --2- 172.21.15.63:0/2107581636 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92700ce9d0 0x7f927013f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.697+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 >> 172.21.15.63:0/2107581636 conn(0x7f92700b0ac0 msgr2=0x7f92701529f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.698+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 shutdown_connections 2023-12-04T10:44:26.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.698+0000 7f9278333640 1 -- 172.21.15.63:0/2107581636 wait complete. 2023-12-04T10:44:26.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.707+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fef8c0710c0 con 0x7fef8c070be0 2023-12-04T10:44:26.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.708+0000 7fef73fff640 1 -- 172.21.15.63:0/1189668534 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fef7c07a7a0 con 0x7fef8c070be0 2023-12-04T10:44:26.710 INFO:teuthology.orchestra.run.smithi063.stdout:60129542156 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.712+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef7806af10 msgr2=0x7fef7806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.712+0000 7fef92061640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef7806af10 0x7fef7806d3d0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fef8c1fa270 tx=0x7fef80008040 comp rx=0 tx=0).stop 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.712+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef8c070be0 msgr2=0x7fef8c145cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.712+0000 7fef92061640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef8c070be0 0x7fef8c145cd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fef7c000f80 tx=0x7fef7c004a40 comp rx=0 tx=0).stop 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.713+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 shutdown_connections 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.713+0000 7fef92061640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef7806af10 0x7fef7806d3d0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.713+0000 7fef92061640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef8c14a9b0 0x7fef8c0af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.713+0000 7fef92061640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef8c0cf7d0 0x7fef8c0adff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.713+0000 7fef92061640 1 --2- 172.21.15.63:0/1189668534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef8c070be0 0x7fef8c145cd0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.713+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 >> 172.21.15.63:0/1189668534 conn(0x7fef8c06a8a0 msgr2=0x7fef8c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.713+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 shutdown_connections 2023-12-04T10:44:26.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.713+0000 7fef92061640 1 -- 172.21.15.63:0/1189668534 wait complete. 2023-12-04T10:44:26.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.0 2023-12-04T10:44:26.724 DEBUG:teuthology.parallel:result is None 2023-12-04T10:44:26.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.1 2023-12-04T10:44:26.736 DEBUG:teuthology.parallel:result is None 2023-12-04T10:44:26.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.761+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f13501e7c80 con 0x7f13500b4770 2023-12-04T10:44:26.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.762+0000 7f134e7fc640 1 -- 172.21.15.63:0/3213292563 <== mon.1 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f134007af00 con 0x7f13500b4770 2023-12-04T10:44:26.765 INFO:teuthology.orchestra.run.smithi063.stdout:60129542155 2023-12-04T10:44:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.765+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f133c06ae40 msgr2=0x7f133c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.765+0000 7f1358072640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f133c06ae40 0x7f133c06d300 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f13501f6fa0 tx=0x7f1344009040 comp rx=0 tx=0).stop 2023-12-04T10:44:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.765+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13500b4770 msgr2=0x7f13501e7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.765+0000 7f1358072640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13500b4770 0x7f13501e7e30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1340009e80 tx=0x7f1340004a40 comp rx=0 tx=0).stop 2023-12-04T10:44:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.766+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 shutdown_connections 2023-12-04T10:44:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.766+0000 7f1358072640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f133c06ae40 0x7f133c06d300 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.766+0000 7f1358072640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13500cfee0 0x7f135015c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.766+0000 7f1358072640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f13500d02c0 0x7f13501e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.766+0000 7f1358072640 1 --2- 172.21.15.63:0/3213292563 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13500b4770 0x7f13501e7e30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.766+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 >> 172.21.15.63:0/3213292563 conn(0x7f135009c610 msgr2=0x7f13500d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.766+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 shutdown_connections 2023-12-04T10:44:26.769 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.766+0000 7f1358072640 1 -- 172.21.15.63:0/3213292563 wait complete. 2023-12-04T10:44:26.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.773+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcfe8068710 con 0x7fcfe80cfee0 2023-12-04T10:44:26.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.773+0000 7fcfddffb640 1 -- 172.21.15.63:0/1962191664 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcfe4018020 con 0x7fcfe80cfee0 2023-12-04T10:44:26.775 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2023-12-04T10:44:26.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.776+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcfcc06af10 msgr2=0x7fcfcc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.776+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcfcc06af10 0x7fcfcc06d3d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcfd8034000 tx=0x7fcfd8008030 comp rx=0 tx=0).stop 2023-12-04T10:44:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.776+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfe80cfee0 msgr2=0x7fcfe80b08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.776+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80b08e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400caf0 tx=0x7fcfe4002140 comp rx=0 tx=0).stop 2023-12-04T10:44:26.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2dbc0057d0 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 shutdown_connections 2023-12-04T10:44:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcfcc06af10 0x7fcfcc06d3d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcfe80d02c0 0x7fcfe81605c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcfe80cfee0 0x7fcfe80b08e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7fcfef5b6640 1 --2- 172.21.15.63:0/1962191664 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfe80b4770 0x7fcfe8153a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 >> 172.21.15.63:0/1962191664 conn(0x7fcfe809c610 msgr2=0x7fcfe80c6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 shutdown_connections 2023-12-04T10:44:26.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7fcfef5b6640 1 -- 172.21.15.63:0/1962191664 wait complete. 2023-12-04T10:44:26.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.777+0000 7f2dd1ffb640 1 -- 172.21.15.63:0/2695308631 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2dcc017090 con 0x7f2ddc0cf9a0 2023-12-04T10:44:26.781 INFO:teuthology.orchestra.run.smithi063.stdout:64424509450 2023-12-04T10:44:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2dc006aea0 msgr2=0x7f2dc006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2dc006aea0 0x7f2dc006d360 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8007a60 tx=0x7f2dd8008040 comp rx=0 tx=0).stop 2023-12-04T10:44:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 msgr2=0x7f2ddc164b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 0x7f2ddc164b00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2dcc007fd0 tx=0x7f2dcc00c890 comp rx=0 tx=0).stop 2023-12-04T10:44:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 shutdown_connections 2023-12-04T10:44:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2dc006aea0 0x7f2dc006d360 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2ddc14a9b0 0x7f2ddc165040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2ddc0cf9a0 0x7f2ddc164b00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 --2- 172.21.15.63:0/2695308631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2ddc070be0 0x7f2ddc144050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.780+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 >> 172.21.15.63:0/2695308631 conn(0x7f2ddc06a8a0 msgr2=0x7f2ddc1612d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.781+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 shutdown_connections 2023-12-04T10:44:26.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.781+0000 7f2de350f640 1 -- 172.21.15.63:0/2695308631 wait complete. 2023-12-04T10:44:26.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.4 2023-12-04T10:44:26.792 DEBUG:teuthology.parallel:result is None 2023-12-04T10:44:26.801 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.7 2023-12-04T10:44:26.801 DEBUG:teuthology.parallel:result is None 2023-12-04T10:44:26.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509450 got 64424509450 for osd.3 2023-12-04T10:44:26.804 DEBUG:teuthology.parallel:result is None 2023-12-04T10:44:26.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.805+0000 7f4650ff9640 1 -- 172.21.15.63:0/2050496368 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f463c0057d0 con 0x7f466415d270 2023-12-04T10:44:26.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.806+0000 7f4652ffd640 1 -- 172.21.15.63:0/2050496368 <== mon.2 v2:172.21.15.66:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4658076b60 con 0x7f466415d270 2023-12-04T10:44:26.809 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2023-12-04T10:44:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 -- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f464406aea0 msgr2=0x7f464406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f464406aea0 0x7f464406d360 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4654006fd0 tx=0x7f4654008040 comp rx=0 tx=0).stop 2023-12-04T10:44:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 -- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d270 msgr2=0x7f466415ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d270 0x7f466415ef70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4658033000 tx=0x7f46580046c0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 -- 172.21.15.63:0/2050496368 shutdown_connections 2023-12-04T10:44:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f464406aea0 0x7f464406d360 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f466415d270 0x7f466415ef70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f466415d650 0x7f466415fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 --2- 172.21.15.63:0/2050496368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f46640d0410 0x7f46640b8840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.809+0000 7f4650ff9640 1 -- 172.21.15.63:0/2050496368 >> 172.21.15.63:0/2050496368 conn(0x7f466409c3e0 msgr2=0x7f466406af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.810+0000 7f4650ff9640 1 -- 172.21.15.63:0/2050496368 shutdown_connections 2023-12-04T10:44:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.810+0000 7f4650ff9640 1 -- 172.21.15.63:0/2050496368 wait complete. 2023-12-04T10:44:26.829 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.5 2023-12-04T10:44:26.829 DEBUG:teuthology.parallel:result is None 2023-12-04T10:44:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.830+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f1ce806c230 con 0x7f1ce80cfee0 2023-12-04T10:44:26.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.830+0000 7f1ccffff640 1 -- 172.21.15.63:0/1543542398 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1cdc0546c0 con 0x7f1ce80cfee0 2023-12-04T10:44:26.832 INFO:teuthology.orchestra.run.smithi063.stdout:64424509449 2023-12-04T10:44:26.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1cd406ae90 msgr2=0x7f1cd406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1cd406ae90 0x7f1cd406d350 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1cd802b8f0 tx=0x7f1cd803c040 comp rx=0 tx=0).stop 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 msgr2=0x7f1ce80cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80cb830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1cdc00e840 tx=0x7f1cdc00ed00 comp rx=0 tx=0).stop 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 shutdown_connections 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f1cd406ae90 0x7f1cd406d350 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f1ce80d02c0 0x7f1ce80c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1ce80cfee0 0x7f1ce80cb830 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 --2- 172.21.15.63:0/1543542398 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1ce80b4770 0x7f1ce8156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 >> 172.21.15.63:0/1543542398 conn(0x7f1ce809c610 msgr2=0x7f1ce80cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.832+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 shutdown_connections 2023-12-04T10:44:26.835 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:26.833+0000 7f1ceddb6640 1 -- 172.21.15.63:0/1543542398 wait complete. 2023-12-04T10:44:26.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.6 2023-12-04T10:44:26.851 DEBUG:teuthology.parallel:result is None 2023-12-04T10:44:26.851 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-04T10:44:26.851 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T10:44:27.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.112+0000 7ffacf4ad640 1 Processor -- start 2023-12-04T10:44:27.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.112+0000 7ffacf4ad640 1 -- start start 2023-12-04T10:44:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacf4ad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffac8151ca0 0x7ffac806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacf4ad640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ffac815b470 0x7ffac80cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacf4ad640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffac80cc7f0 con 0x7ffac806e0b0 2023-12-04T10:44:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacf4ad640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffac80cca40 con 0x7ffac815b470 2023-12-04T10:44:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacf4ad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80ccd20 con 0x7ffac8151ca0 2023-12-04T10:44:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacecac640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ffac806e0b0 0x7ffac8071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43808/0 (socket says 172.21.15.63:43808) 2023-12-04T10:44:27.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacecac640 1 -- 172.21.15.63:0/2417533056 learned_addr learned my addr 172.21.15.63:0/2417533056 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:27.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1749098212 0 0) 0x7ffac80cc7f0 con 0x7ffac806e0b0 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffab4003520 con 0x7ffac806e0b0 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7ffacdcaa640 1 --2- 172.21.15.63:0/2417533056 >> v2:172.21.15.66:3300/0 conn(0x7ffac815b470 0x7ffac80cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.114+0000 7fface4ab640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffac8151ca0 0x7ffac806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2070609041 0 0) 0x7ffab4003520 con 0x7ffac806e0b0 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffac8151ca0 msgr2=0x7ffac806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffac8151ca0 0x7ffac806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 >> v2:172.21.15.66:3300/0 conn(0x7ffac815b470 msgr2=0x7ffac80cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 --2- 172.21.15.63:0/2417533056 >> v2:172.21.15.66:3300/0 conn(0x7ffac815b470 0x7ffac80cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac80cd000 con 0x7ffac806e0b0 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7ffac00019f0 con 0x7ffac806e0b0 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 >> v1:172.21.15.63:6789/0 conn(0x7ffac806e0b0 legacy=0x7ffac8071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab4003970 0x7ffab4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffab40047c0 0x7ffab4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffac8151ca0 0x7ffab40051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80cca40 con 0x7ffab40047c0 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac80ccd20 con 0x7ffab4003970 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffab400bb10 con 0x7ffac8151ca0 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacdcaa640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffab40047c0 0x7ffab4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7fface4ab640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab4003970 0x7ffab4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.115+0000 7ffacdcaa640 1 -- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffac8151ca0 msgr2=0x7ffab40051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.116+0000 7ffacdcaa640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffac8151ca0 0x7ffab40051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.116+0000 7ffacdcaa640 1 -- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab4003970 msgr2=0x7ffab4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.116+0000 7ffacdcaa640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab4003970 0x7ffab4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.116+0000 7ffacdcaa640 1 -- 172.21.15.63:0/2417533056 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4003520 con 0x7ffab40047c0 2023-12-04T10:44:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacdcaa640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffab40047c0 0x7ffab4004c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffab800ba30 tx=0x7ffab40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82775101c4f3804d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8032680 con 0x7ffab40047c0 2023-12-04T10:44:27.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab80327e0 con 0x7ffab40047c0 2023-12-04T10:44:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacd4a9640 1 -- 172.21.15.63:0/2417533056 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8032b70 con 0x7ffab40047c0 2023-12-04T10:44:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2417533056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffab40047c0 msgr2=0x7ffab4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacf4ad640 1 --2- 172.21.15.63:0/2417533056 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffab40047c0 0x7ffab4004c40 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7ffab800ba30 tx=0x7ffab40057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacecac640 1 -- 172.21.15.63:0/2417533056 reap_dead start 2023-12-04T10:44:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2417533056 shutdown_connections 2023-12-04T10:44:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.117+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2417533056 >> 172.21.15.63:0/2417533056 conn(0x7ffac80b07f0 msgr2=0x7ffac80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.118+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2417533056 shutdown_connections 2023-12-04T10:44:27.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.118+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2417533056 wait complete. 2023-12-04T10:44:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.119+0000 7ffacf4ad640 1 Processor -- start 2023-12-04T10:44:27.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.119+0000 7ffacf4ad640 1 -- start start 2023-12-04T10:44:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.120+0000 7ffacf4ad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffab40047c0 0x7ffac8154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.120+0000 7ffacf4ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffac81599f0 0x7ffac80c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.120+0000 7ffacf4ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffac814ff60 0x7ffac81503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.120+0000 7ffacf4ad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8155a80 con 0x7ffac81599f0 2023-12-04T10:44:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.120+0000 7ffacf4ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8155d60 con 0x7ffac814ff60 2023-12-04T10:44:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.120+0000 7ffacf4ad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffac8150920 con 0x7ffab40047c0 2023-12-04T10:44:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffac81599f0 0x7ffac80c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffac81599f0 0x7ffac80c8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34546/0 (socket says 172.21.15.63:34546) 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 -- 172.21.15.63:0/2924751348 learned_addr learned my addr 172.21.15.63:0/2924751348 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7fface4ab640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffab40047c0 0x7ffac8154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacecac640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffac814ff60 0x7ffac81503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 -- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffab40047c0 msgr2=0x7ffac8154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffab40047c0 0x7ffac8154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 -- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffac814ff60 msgr2=0x7ffac81503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffac814ff60 0x7ffac81503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 -- 172.21.15.63:0/2924751348 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffac815a240 con 0x7ffac81599f0 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7fface4ab640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffab40047c0 0x7ffac8154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacecac640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffac814ff60 0x7ffac81503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:27.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.121+0000 7ffacdcaa640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffac81599f0 0x7ffac80c8130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffab800bb50 tx=0x7ffab8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.122+0000 7ffabeffd640 1 -- 172.21.15.63:0/2924751348 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8004220 con 0x7ffac81599f0 2023-12-04T10:44:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.122+0000 7ffabeffd640 1 -- 172.21.15.63:0/2924751348 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffab80043a0 con 0x7ffac81599f0 2023-12-04T10:44:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.122+0000 7ffabeffd640 1 -- 172.21.15.63:0/2924751348 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffab8030aa0 con 0x7ffac81599f0 2023-12-04T10:44:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.122+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac815a520 con 0x7ffac81599f0 2023-12-04T10:44:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.122+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac8159e70 con 0x7ffac81599f0 2023-12-04T10:44:27.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.123+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac815a000 con 0x7ffac81599f0 2023-12-04T10:44:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.124+0000 7ffabeffd640 1 -- 172.21.15.63:0/2924751348 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ffab8030c00 con 0x7ffac81599f0 2023-12-04T10:44:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.125+0000 7ffabeffd640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ffaac06f250 0x7ffaac071710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.125+0000 7ffabeffd640 1 -- 172.21.15.63:0/2924751348 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ffab80ac3b0 con 0x7ffac81599f0 2023-12-04T10:44:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.125+0000 7fface4ab640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ffaac06f250 0x7ffaac071710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.125+0000 7fface4ab640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ffaac06f250 0x7ffaac071710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffac4006fd0 tx=0x7ffac4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:27.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.129+0000 7ffabeffd640 1 -- 172.21.15.63:0/2924751348 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ffac815a000 con 0x7ffac81599f0 2023-12-04T10:44:27.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.311+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 --> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffac80b20f0 con 0x7ffaac06f250 2023-12-04T10:44:27.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.327+0000 7ffabeffd640 1 -- 172.21.15.63:0/2924751348 <== mgr.4107 v2:172.21.15.63:6832/2779630096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345089 (secure 0 0 0) 0x7ffac80b20f0 con 0x7ffaac06f250 2023-12-04T10:44:27.331 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:27.339 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.335+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ffaac06f250 msgr2=0x7ffaac071710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.335+0000 7ffacf4ad640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ffaac06f250 0x7ffaac071710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffac4006fd0 tx=0x7ffac4008040 comp rx=0 tx=0).stop 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.335+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffac81599f0 msgr2=0x7ffac80c8130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.335+0000 7ffacf4ad640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffac81599f0 0x7ffac80c8130 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ffab800bb50 tx=0x7ffab8004730 comp rx=0 tx=0).stop 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.336+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 shutdown_connections 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.336+0000 7ffacf4ad640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ffaac06f250 0x7ffaac071710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.336+0000 7ffacf4ad640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffac814ff60 0x7ffac81503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.336+0000 7ffacf4ad640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ffac81599f0 0x7ffac80c8130 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.336+0000 7ffacf4ad640 1 --2- 172.21.15.63:0/2924751348 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ffab40047c0 0x7ffac8154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.336+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 >> 172.21.15.63:0/2924751348 conn(0x7ffac80b07f0 msgr2=0x7ffac80b19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.336+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 shutdown_connections 2023-12-04T10:44:27.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.336+0000 7ffacf4ad640 1 -- 172.21.15.63:0/2924751348 wait complete. 2023-12-04T10:44:27.358 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-12-04T10:44:25.974838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219596,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755124,"statfs":{"total":773094113280,"available":772869246976,"internally_reserved":0,"allocated":3514368,"data_stored":2085782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004924"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039141+0000","last_change":"2023-12-04T10:43:52.262642+0000","last_active":"2023-12-04T10:43:58.039141+0000","last_peered":"2023-12-04T10:43:58.039141+0000","last_clean":"2023-12-04T10:43:58.039141+0000","last_became_active":"2023-12-04T10:43:52.262376+0000","last_became_peered":"2023-12-04T10:43:52.262376+0000","last_unstale":"2023-12-04T10:43:58.039141+0000","last_undegraded":"2023-12-04T10:43:58.039141+0000","last_fullsized":"2023-12-04T10:43:58.039141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022140+0000","last_change":"2023-12-04T10:43:52.985649+0000","last_active":"2023-12-04T10:43:58.022140+0000","last_peered":"2023-12-04T10:43:58.022140+0000","last_clean":"2023-12-04T10:43:58.022140+0000","last_became_active":"2023-12-04T10:43:52.980842+0000","last_became_peered":"2023-12-04T10:43:52.980842+0000","last_unstale":"2023-12-04T10:43:58.022140+0000","last_undegraded":"2023-12-04T10:43:58.022140+0000","last_fullsized":"2023-12-04T10:43:58.022140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:35:03.536961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702614+0000","last_change":"2023-12-04T10:43:58.234310+0000","last_active":"2023-12-04T10:43:58.702614+0000","last_peered":"2023-12-04T10:43:58.702614+0000","last_clean":"2023-12-04T10:43:58.702614+0000","last_became_active":"2023-12-04T10:43:58.233037+0000","last_became_peered":"2023-12-04T10:43:58.233037+0000","last_unstale":"2023-12-04T10:43:58.702614+0000","last_undegraded":"2023-12-04T10:43:58.702614+0000","last_fullsized":"2023-12-04T10:43:58.702614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:45:11.650821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022299+0000","last_change":"2023-12-04T10:43:52.244397+0000","last_active":"2023-12-04T10:43:58.022299+0000","last_peered":"2023-12-04T10:43:58.022299+0000","last_clean":"2023-12-04T10:43:58.022299+0000","last_became_active":"2023-12-04T10:43:52.244095+0000","last_became_peered":"2023-12-04T10:43:52.244095+0000","last_unstale":"2023-12-04T10:43:58.022299+0000","last_undegraded":"2023-12-04T10:43:58.022299+0000","last_fullsized":"2023-12-04T10:43:58.022299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:12:59.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037025+0000","last_change":"2023-12-04T10:43:52.991593+0000","last_active":"2023-12-04T10:43:58.037025+0000","last_peered":"2023-12-04T10:43:58.037025+0000","last_clean":"2023-12-04T10:43:58.037025+0000","last_became_active":"2023-12-04T10:43:52.991219+0000","last_became_peered":"2023-12-04T10:43:52.991219+0000","last_unstale":"2023-12-04T10:43:58.037025+0000","last_undegraded":"2023-12-04T10:43:58.037025+0000","last_fullsized":"2023-12-04T10:43:58.037025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704700+0000","last_change":"2023-12-04T10:43:58.054950+0000","last_active":"2023-12-04T10:43:58.704700+0000","last_peered":"2023-12-04T10:43:58.704700+0000","last_clean":"2023-12-04T10:43:58.704700+0000","last_became_active":"2023-12-04T10:43:58.054476+0000","last_became_peered":"2023-12-04T10:43:58.054476+0000","last_unstale":"2023-12-04T10:43:58.704700+0000","last_undegraded":"2023-12-04T10:43:58.704700+0000","last_fullsized":"2023-12-04T10:43:58.704700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:12.751001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219571+0000","last_change":"2023-12-04T10:43:52.267072+0000","last_active":"2023-12-04T10:43:58.219571+0000","last_peered":"2023-12-04T10:43:58.219571+0000","last_clean":"2023-12-04T10:43:58.219571+0000","last_became_active":"2023-12-04T10:43:52.266736+0000","last_became_peered":"2023-12-04T10:43:52.266736+0000","last_unstale":"2023-12-04T10:43:58.219571+0000","last_undegraded":"2023-12-04T10:43:58.219571+0000","last_fullsized":"2023-12-04T10:43:58.219571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:24.986256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040614+0000","last_change":"2023-12-04T10:43:52.973354+0000","last_active":"2023-12-04T10:43:58.040614+0000","last_peered":"2023-12-04T10:43:58.040614+0000","last_clean":"2023-12-04T10:43:58.040614+0000","last_became_active":"2023-12-04T10:43:52.973024+0000","last_became_peered":"2023-12-04T10:43:52.973024+0000","last_unstale":"2023-12-04T10:43:58.040614+0000","last_undegraded":"2023-12-04T10:43:58.040614+0000","last_fullsized":"2023-12-04T10:43:58.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703606+0000","last_change":"2023-12-04T10:43:58.052885+0000","last_active":"2023-12-04T10:43:58.703606+0000","last_peered":"2023-12-04T10:43:58.703606+0000","last_clean":"2023-12-04T10:43:58.703606+0000","last_became_active":"2023-12-04T10:43:58.052363+0000","last_became_peered":"2023-12-04T10:43:58.052363+0000","last_unstale":"2023-12-04T10:43:58.703606+0000","last_undegraded":"2023-12-04T10:43:58.703606+0000","last_fullsized":"2023-12-04T10:43:58.703606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:46.891581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.215836+0000","last_change":"2023-12-04T10:43:52.270824+0000","last_active":"2023-12-04T10:43:58.215836+0000","last_peered":"2023-12-04T10:43:58.215836+0000","last_clean":"2023-12-04T10:43:58.215836+0000","last_became_active":"2023-12-04T10:43:52.270451+0000","last_became_peered":"2023-12-04T10:43:52.270451+0000","last_unstale":"2023-12-04T10:43:58.215836+0000","last_undegraded":"2023-12-04T10:43:58.215836+0000","last_fullsized":"2023-12-04T10:43:58.215836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:09.555889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040349+0000","last_change":"2023-12-04T10:43:52.975366+0000","last_active":"2023-12-04T10:43:58.040349+0000","last_peered":"2023-12-04T10:43:58.040349+0000","last_clean":"2023-12-04T10:43:58.040349+0000","last_became_active":"2023-12-04T10:43:52.975083+0000","last_became_peered":"2023-12-04T10:43:52.975083+0000","last_unstale":"2023-12-04T10:43:58.040349+0000","last_undegraded":"2023-12-04T10:43:58.040349+0000","last_fullsized":"2023-12-04T10:43:58.040349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:46.964865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703374+0000","last_change":"2023-12-04T10:43:58.056032+0000","last_active":"2023-12-04T10:43:58.703374+0000","last_peered":"2023-12-04T10:43:58.703374+0000","last_clean":"2023-12-04T10:43:58.703374+0000","last_became_active":"2023-12-04T10:43:58.055534+0000","last_became_peered":"2023-12-04T10:43:58.055534+0000","last_unstale":"2023-12-04T10:43:58.703374+0000","last_undegraded":"2023-12-04T10:43:58.703374+0000","last_fullsized":"2023-12-04T10:43:58.703374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:17:56.402589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048799+0000","last_change":"2023-12-04T10:43:52.985238+0000","last_active":"2023-12-04T10:43:58.048799+0000","last_peered":"2023-12-04T10:43:58.048799+0000","last_clean":"2023-12-04T10:43:58.048799+0000","last_became_active":"2023-12-04T10:43:52.984911+0000","last_became_peered":"2023-12-04T10:43:52.984911+0000","last_unstale":"2023-12-04T10:43:58.048799+0000","last_undegraded":"2023-12-04T10:43:58.048799+0000","last_fullsized":"2023-12-04T10:43:58.048799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216522+0000","last_change":"2023-12-04T10:43:52.269729+0000","last_active":"2023-12-04T10:43:58.216522+0000","last_peered":"2023-12-04T10:43:58.216522+0000","last_clean":"2023-12-04T10:43:58.216522+0000","last_became_active":"2023-12-04T10:43:52.268943+0000","last_became_peered":"2023-12-04T10:43:52.268943+0000","last_unstale":"2023-12-04T10:43:58.216522+0000","last_undegraded":"2023-12-04T10:43:58.216522+0000","last_fullsized":"2023-12-04T10:43:58.216522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:47.791989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.705778+0000","last_change":"2023-12-04T10:43:58.054574+0000","last_active":"2023-12-04T10:43:58.705778+0000","last_peered":"2023-12-04T10:43:58.705778+0000","last_clean":"2023-12-04T10:43:58.705778+0000","last_became_active":"2023-12-04T10:43:58.052778+0000","last_became_peered":"2023-12-04T10:43:58.052778+0000","last_unstale":"2023-12-04T10:43:58.705778+0000","last_undegraded":"2023-12-04T10:43:58.705778+0000","last_fullsized":"2023-12-04T10:43:58.705778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:14:13.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021096+0000","last_change":"2023-12-04T10:43:52.980176+0000","last_active":"2023-12-04T10:43:58.021096+0000","last_peered":"2023-12-04T10:43:58.021096+0000","last_clean":"2023-12-04T10:43:58.021096+0000","last_became_active":"2023-12-04T10:43:52.979878+0000","last_became_peered":"2023-12-04T10:43:52.979878+0000","last_unstale":"2023-12-04T10:43:58.021096+0000","last_undegraded":"2023-12-04T10:43:58.021096+0000","last_fullsized":"2023-12-04T10:43:58.021096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.031512+0000","last_change":"2023-12-04T10:43:52.251368+0000","last_active":"2023-12-04T10:43:58.031512+0000","last_peered":"2023-12-04T10:43:58.031512+0000","last_clean":"2023-12-04T10:43:58.031512+0000","last_became_active":"2023-12-04T10:43:52.248421+0000","last_became_peered":"2023-12-04T10:43:52.248421+0000","last_unstale":"2023-12-04T10:43:58.031512+0000","last_undegraded":"2023-12-04T10:43:58.031512+0000","last_fullsized":"2023-12-04T10:43:58.031512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:01:30.452121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704063+0000","last_change":"2023-12-04T10:43:58.050763+0000","last_active":"2023-12-04T10:43:58.704063+0000","last_peered":"2023-12-04T10:43:58.704063+0000","last_clean":"2023-12-04T10:43:58.704063+0000","last_became_active":"2023-12-04T10:43:58.050229+0000","last_became_peered":"2023-12-04T10:43:58.050229+0000","last_unstale":"2023-12-04T10:43:58.704063+0000","last_undegraded":"2023-12-04T10:43:58.704063+0000","last_fullsized":"2023-12-04T10:43:58.704063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:49:06.824707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021858+0000","last_change":"2023-12-04T10:43:52.980604+0000","last_active":"2023-12-04T10:43:58.021858+0000","last_peered":"2023-12-04T10:43:58.021858+0000","last_clean":"2023-12-04T10:43:58.021858+0000","last_became_active":"2023-12-04T10:43:52.980217+0000","last_became_peered":"2023-12-04T10:43:52.980217+0000","last_unstale":"2023-12-04T10:43:58.021858+0000","last_undegraded":"2023-12-04T10:43:58.021858+0000","last_fullsized":"2023-12-04T10:43:58.021858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030984+0000","last_change":"2023-12-04T10:43:52.261622+0000","last_active":"2023-12-04T10:43:58.030984+0000","last_peered":"2023-12-04T10:43:58.030984+0000","last_clean":"2023-12-04T10:43:58.030984+0000","last_became_active":"2023-12-04T10:43:52.261298+0000","last_became_peered":"2023-12-04T10:43:52.261298+0000","last_unstale":"2023-12-04T10:43:58.030984+0000","last_undegraded":"2023-12-04T10:43:58.030984+0000","last_fullsized":"2023-12-04T10:43:58.030984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:47.544355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.000863+0000","last_change":"2023-12-04T10:43:58.226091+0000","last_active":"2023-12-04T10:43:59.000863+0000","last_peered":"2023-12-04T10:43:59.000863+0000","last_clean":"2023-12-04T10:43:59.000863+0000","last_became_active":"2023-12-04T10:43:58.225330+0000","last_became_peered":"2023-12-04T10:43:58.225330+0000","last_unstale":"2023-12-04T10:43:59.000863+0000","last_undegraded":"2023-12-04T10:43:59.000863+0000","last_fullsized":"2023-12-04T10:43:59.000863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:55:33.240134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030673+0000","last_change":"2023-12-04T10:43:52.982076+0000","last_active":"2023-12-04T10:43:58.030673+0000","last_peered":"2023-12-04T10:43:58.030673+0000","last_clean":"2023-12-04T10:43:58.030673+0000","last_became_active":"2023-12-04T10:43:52.972016+0000","last_became_peered":"2023-12-04T10:43:52.972016+0000","last_unstale":"2023-12-04T10:43:58.030673+0000","last_undegraded":"2023-12-04T10:43:58.030673+0000","last_fullsized":"2023-12-04T10:43:58.030673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:46:15.950875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.214559+0000","last_change":"2023-12-04T10:43:52.266409+0000","last_active":"2023-12-04T10:43:58.214559+0000","last_peered":"2023-12-04T10:43:58.214559+0000","last_clean":"2023-12-04T10:43:58.214559+0000","last_became_active":"2023-12-04T10:43:52.265294+0000","last_became_peered":"2023-12-04T10:43:52.265294+0000","last_unstale":"2023-12-04T10:43:58.214559+0000","last_undegraded":"2023-12-04T10:43:58.214559+0000","last_fullsized":"2023-12-04T10:43:58.214559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:30:30.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704052+0000","last_change":"2023-12-04T10:43:58.054026+0000","last_active":"2023-12-04T10:43:58.704052+0000","last_peered":"2023-12-04T10:43:58.704052+0000","last_clean":"2023-12-04T10:43:58.704052+0000","last_became_active":"2023-12-04T10:43:58.053503+0000","last_became_peered":"2023-12-04T10:43:58.053503+0000","last_unstale":"2023-12-04T10:43:58.704052+0000","last_undegraded":"2023-12-04T10:43:58.704052+0000","last_fullsized":"2023-12-04T10:43:58.704052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:16:07.199657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039992+0000","last_change":"2023-12-04T10:43:52.985148+0000","last_active":"2023-12-04T10:43:58.039992+0000","last_peered":"2023-12-04T10:43:58.039992+0000","last_clean":"2023-12-04T10:43:58.039992+0000","last_became_active":"2023-12-04T10:43:52.984813+0000","last_became_peered":"2023-12-04T10:43:52.984813+0000","last_unstale":"2023-12-04T10:43:58.039992+0000","last_undegraded":"2023-12-04T10:43:58.039992+0000","last_fullsized":"2023-12-04T10:43:58.039992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049600+0000","last_change":"2023-12-04T10:43:52.270015+0000","last_active":"2023-12-04T10:43:58.049600+0000","last_peered":"2023-12-04T10:43:58.049600+0000","last_clean":"2023-12-04T10:43:58.049600+0000","last_became_active":"2023-12-04T10:43:52.269682+0000","last_became_peered":"2023-12-04T10:43:52.269682+0000","last_unstale":"2023-12-04T10:43:58.049600+0000","last_undegraded":"2023-12-04T10:43:58.049600+0000","last_fullsized":"2023-12-04T10:43:58.049600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703352+0000","last_change":"2023-12-04T10:43:58.223739+0000","last_active":"2023-12-04T10:43:58.703352+0000","last_peered":"2023-12-04T10:43:58.703352+0000","last_clean":"2023-12-04T10:43:58.703352+0000","last_became_active":"2023-12-04T10:43:58.223091+0000","last_became_peered":"2023-12-04T10:43:58.223091+0000","last_unstale":"2023-12-04T10:43:58.703352+0000","last_undegraded":"2023-12-04T10:43:58.703352+0000","last_fullsized":"2023-12-04T10:43:58.703352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:20:24.266893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.023237+0000","last_change":"2023-12-04T10:43:52.980989+0000","last_active":"2023-12-04T10:43:58.023237+0000","last_peered":"2023-12-04T10:43:58.023237+0000","last_clean":"2023-12-04T10:43:58.023237+0000","last_became_active":"2023-12-04T10:43:52.980436+0000","last_became_peered":"2023-12-04T10:43:52.980436+0000","last_unstale":"2023-12-04T10:43:58.023237+0000","last_undegraded":"2023-12-04T10:43:58.023237+0000","last_fullsized":"2023-12-04T10:43:58.023237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030910+0000","last_change":"2023-12-04T10:43:52.258606+0000","last_active":"2023-12-04T10:43:58.030910+0000","last_peered":"2023-12-04T10:43:58.030910+0000","last_clean":"2023-12-04T10:43:58.030910+0000","last_became_active":"2023-12-04T10:43:52.258209+0000","last_became_peered":"2023-12-04T10:43:52.258209+0000","last_unstale":"2023-12-04T10:43:58.030910+0000","last_undegraded":"2023-12-04T10:43:58.030910+0000","last_fullsized":"2023-12-04T10:43:58.030910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:15:20.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702285+0000","last_change":"2023-12-04T10:43:58.215546+0000","last_active":"2023-12-04T10:43:58.702285+0000","last_peered":"2023-12-04T10:43:58.702285+0000","last_clean":"2023-12-04T10:43:58.702285+0000","last_became_active":"2023-12-04T10:43:58.214293+0000","last_became_peered":"2023-12-04T10:43:58.214293+0000","last_unstale":"2023-12-04T10:43:58.702285+0000","last_undegraded":"2023-12-04T10:43:58.702285+0000","last_fullsized":"2023-12-04T10:43:58.702285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:57:02.248236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034123+0000","last_change":"2023-12-04T10:43:52.973852+0000","last_active":"2023-12-04T10:43:58.034123+0000","last_peered":"2023-12-04T10:43:58.034123+0000","last_clean":"2023-12-04T10:43:58.034123+0000","last_became_active":"2023-12-04T10:43:52.972253+0000","last_became_peered":"2023-12-04T10:43:52.972253+0000","last_unstale":"2023-12-04T10:43:58.034123+0000","last_undegraded":"2023-12-04T10:43:58.034123+0000","last_fullsized":"2023-12-04T10:43:58.034123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:20:19.481533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.220155+0000","last_change":"2023-12-04T10:43:52.261351+0000","last_active":"2023-12-04T10:43:58.220155+0000","last_peered":"2023-12-04T10:43:58.220155+0000","last_clean":"2023-12-04T10:43:58.220155+0000","last_became_active":"2023-12-04T10:43:52.261052+0000","last_became_peered":"2023-12-04T10:43:52.261052+0000","last_unstale":"2023-12-04T10:43:58.220155+0000","last_undegraded":"2023-12-04T10:43:58.220155+0000","last_fullsized":"2023-12-04T10:43:58.220155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:03.065751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995773+0000","last_change":"2023-12-04T10:43:58.215971+0000","last_active":"2023-12-04T10:43:58.995773+0000","last_peered":"2023-12-04T10:43:58.995773+0000","last_clean":"2023-12-04T10:43:58.995773+0000","last_became_active":"2023-12-04T10:43:58.214859+0000","last_became_peered":"2023-12-04T10:43:58.214859+0000","last_unstale":"2023-12-04T10:43:58.995773+0000","last_undegraded":"2023-12-04T10:43:58.995773+0000","last_fullsized":"2023-12-04T10:43:58.995773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:32:49.715432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040441+0000","last_change":"2023-12-04T10:43:52.994569+0000","last_active":"2023-12-04T10:43:58.040441+0000","last_peered":"2023-12-04T10:43:58.040441+0000","last_clean":"2023-12-04T10:43:58.040441+0000","last_became_active":"2023-12-04T10:43:52.994301+0000","last_became_peered":"2023-12-04T10:43:52.994301+0000","last_unstale":"2023-12-04T10:43:58.040441+0000","last_undegraded":"2023-12-04T10:43:58.040441+0000","last_fullsized":"2023-12-04T10:43:58.040441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:21.236244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034230+0000","last_change":"2023-12-04T10:43:52.249758+0000","last_active":"2023-12-04T10:43:58.034230+0000","last_peered":"2023-12-04T10:43:58.034230+0000","last_clean":"2023-12-04T10:43:58.034230+0000","last_became_active":"2023-12-04T10:43:52.248998+0000","last_became_peered":"2023-12-04T10:43:52.248998+0000","last_unstale":"2023-12-04T10:43:58.034230+0000","last_undegraded":"2023-12-04T10:43:58.034230+0000","last_fullsized":"2023-12-04T10:43:58.034230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:18:12.560014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.998783+0000","last_change":"2023-12-04T10:43:58.049867+0000","last_active":"2023-12-04T10:43:58.998783+0000","last_peered":"2023-12-04T10:43:58.998783+0000","last_clean":"2023-12-04T10:43:58.998783+0000","last_became_active":"2023-12-04T10:43:58.049454+0000","last_became_peered":"2023-12-04T10:43:58.049454+0000","last_unstale":"2023-12-04T10:43:58.998783+0000","last_undegraded":"2023-12-04T10:43:58.998783+0000","last_fullsized":"2023-12-04T10:43:58.998783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:14:13.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037424+0000","last_change":"2023-12-04T10:43:52.980950+0000","last_active":"2023-12-04T10:43:58.037424+0000","last_peered":"2023-12-04T10:43:58.037424+0000","last_clean":"2023-12-04T10:43:58.037424+0000","last_became_active":"2023-12-04T10:43:52.980633+0000","last_became_peered":"2023-12-04T10:43:52.980633+0000","last_unstale":"2023-12-04T10:43:58.037424+0000","last_undegraded":"2023-12-04T10:43:58.037424+0000","last_fullsized":"2023-12-04T10:43:58.037424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:24:23.025254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.035013+0000","last_change":"2023-12-04T10:43:52.259456+0000","last_active":"2023-12-04T10:43:58.035013+0000","last_peered":"2023-12-04T10:43:58.035013+0000","last_clean":"2023-12-04T10:43:58.035013+0000","last_became_active":"2023-12-04T10:43:52.254414+0000","last_became_peered":"2023-12-04T10:43:52.254414+0000","last_unstale":"2023-12-04T10:43:58.035013+0000","last_undegraded":"2023-12-04T10:43:58.035013+0000","last_fullsized":"2023-12-04T10:43:58.035013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:03.065751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.000962+0000","last_change":"2023-12-04T10:43:58.053734+0000","last_active":"2023-12-04T10:43:59.000962+0000","last_peered":"2023-12-04T10:43:59.000962+0000","last_clean":"2023-12-04T10:43:59.000962+0000","last_became_active":"2023-12-04T10:43:58.053373+0000","last_became_peered":"2023-12-04T10:43:58.053373+0000","last_unstale":"2023-12-04T10:43:59.000962+0000","last_undegraded":"2023-12-04T10:43:59.000962+0000","last_fullsized":"2023-12-04T10:43:59.000962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:22:58.696286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030598+0000","last_change":"2023-12-04T10:43:52.974356+0000","last_active":"2023-12-04T10:43:58.030598+0000","last_peered":"2023-12-04T10:43:58.030598+0000","last_clean":"2023-12-04T10:43:58.030598+0000","last_became_active":"2023-12-04T10:43:52.974025+0000","last_became_peered":"2023-12-04T10:43:52.974025+0000","last_unstale":"2023-12-04T10:43:58.030598+0000","last_undegraded":"2023-12-04T10:43:58.030598+0000","last_fullsized":"2023-12-04T10:43:58.030598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:02:21.706862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.044424+0000","last_change":"2023-12-04T10:43:52.251063+0000","last_active":"2023-12-04T10:43:58.044424+0000","last_peered":"2023-12-04T10:43:58.044424+0000","last_clean":"2023-12-04T10:43:58.044424+0000","last_became_active":"2023-12-04T10:43:52.250274+0000","last_became_peered":"2023-12-04T10:43:52.250274+0000","last_unstale":"2023-12-04T10:43:58.044424+0000","last_undegraded":"2023-12-04T10:43:58.044424+0000","last_fullsized":"2023-12-04T10:43:58.044424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:20.848140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.001269+0000","last_change":"2023-12-04T10:43:58.046943+0000","last_active":"2023-12-04T10:43:59.001269+0000","last_peered":"2023-12-04T10:43:59.001269+0000","last_clean":"2023-12-04T10:43:59.001269+0000","last_became_active":"2023-12-04T10:43:58.046583+0000","last_became_peered":"2023-12-04T10:43:58.046583+0000","last_unstale":"2023-12-04T10:43:59.001269+0000","last_undegraded":"2023-12-04T10:43:59.001269+0000","last_fullsized":"2023-12-04T10:43:59.001269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:18:58.227614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.032594+0000","last_change":"2023-12-04T10:43:52.973314+0000","last_active":"2023-12-04T10:43:58.032594+0000","last_peered":"2023-12-04T10:43:58.032594+0000","last_clean":"2023-12-04T10:43:58.032594+0000","last_became_active":"2023-12-04T10:43:52.973027+0000","last_became_peered":"2023-12-04T10:43:52.973027+0000","last_unstale":"2023-12-04T10:43:58.032594+0000","last_undegraded":"2023-12-04T10:43:58.032594+0000","last_fullsized":"2023-12-04T10:43:58.032594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216818+0000","last_change":"2023-12-04T10:43:52.264881+0000","last_active":"2023-12-04T10:43:58.216818+0000","last_peered":"2023-12-04T10:43:58.216818+0000","last_clean":"2023-12-04T10:43:58.216818+0000","last_became_active":"2023-12-04T10:43:52.262303+0000","last_became_peered":"2023-12-04T10:43:52.262303+0000","last_unstale":"2023-12-04T10:43:58.216818+0000","last_undegraded":"2023-12-04T10:43:58.216818+0000","last_fullsized":"2023-12-04T10:43:58.216818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995766+0000","last_change":"2023-12-04T10:43:58.235583+0000","last_active":"2023-12-04T10:43:58.995766+0000","last_peered":"2023-12-04T10:43:58.995766+0000","last_clean":"2023-12-04T10:43:58.995766+0000","last_became_active":"2023-12-04T10:43:58.231876+0000","last_became_peered":"2023-12-04T10:43:58.231876+0000","last_unstale":"2023-12-04T10:43:58.995766+0000","last_undegraded":"2023-12-04T10:43:58.995766+0000","last_fullsized":"2023-12-04T10:43:58.995766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:59.475236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020643+0000","last_change":"2023-12-04T10:43:52.988166+0000","last_active":"2023-12-04T10:43:58.020643+0000","last_peered":"2023-12-04T10:43:58.020643+0000","last_clean":"2023-12-04T10:43:58.020643+0000","last_became_active":"2023-12-04T10:43:52.987801+0000","last_became_peered":"2023-12-04T10:43:52.987801+0000","last_unstale":"2023-12-04T10:43:58.020643+0000","last_undegraded":"2023-12-04T10:43:58.020643+0000","last_fullsized":"2023-12-04T10:43:58.020643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041216+0000","last_change":"2023-12-04T10:43:52.261710+0000","last_active":"2023-12-04T10:43:58.041216+0000","last_peered":"2023-12-04T10:43:58.041216+0000","last_clean":"2023-12-04T10:43:58.041216+0000","last_became_active":"2023-12-04T10:43:52.253457+0000","last_became_peered":"2023-12-04T10:43:52.253457+0000","last_unstale":"2023-12-04T10:43:58.041216+0000","last_undegraded":"2023-12-04T10:43:58.041216+0000","last_fullsized":"2023-12-04T10:43:58.041216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:24.986256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.215951+0000","last_change":"2023-12-04T10:43:48.111279+0000","last_active":"2023-12-04T10:43:58.215951+0000","last_peered":"2023-12-04T10:43:58.215951+0000","last_clean":"2023-12-04T10:43:58.215951+0000","last_became_active":"2023-12-04T10:43:48.108038+0000","last_became_peered":"2023-12-04T10:43:48.108038+0000","last_unstale":"2023-12-04T10:43:58.215951+0000","last_undegraded":"2023-12-04T10:43:58.215951+0000","last_fullsized":"2023-12-04T10:43:58.215951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_clean_scrub_stamp":"2023-12-04T10:43:46.528449+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:31:15.475210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.707014+0000","last_change":"2023-12-04T10:43:58.229941+0000","last_active":"2023-12-04T10:43:58.707014+0000","last_peered":"2023-12-04T10:43:58.707014+0000","last_clean":"2023-12-04T10:43:58.707014+0000","last_became_active":"2023-12-04T10:43:58.225120+0000","last_became_peered":"2023-12-04T10:43:58.225120+0000","last_unstale":"2023-12-04T10:43:58.707014+0000","last_undegraded":"2023-12-04T10:43:58.707014+0000","last_fullsized":"2023-12-04T10:43:58.707014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:15.863508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219407+0000","last_change":"2023-12-04T10:43:52.982313+0000","last_active":"2023-12-04T10:43:58.219407+0000","last_peered":"2023-12-04T10:43:58.219407+0000","last_clean":"2023-12-04T10:43:58.219407+0000","last_became_active":"2023-12-04T10:43:52.979562+0000","last_became_peered":"2023-12-04T10:43:52.979562+0000","last_unstale":"2023-12-04T10:43:58.219407+0000","last_undegraded":"2023-12-04T10:43:58.219407+0000","last_fullsized":"2023-12-04T10:43:58.219407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:46.964865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049829+0000","last_change":"2023-12-04T10:43:52.267801+0000","last_active":"2023-12-04T10:43:58.049829+0000","last_peered":"2023-12-04T10:43:58.049829+0000","last_clean":"2023-12-04T10:43:58.049829+0000","last_became_active":"2023-12-04T10:43:52.267514+0000","last_became_peered":"2023-12-04T10:43:52.267514+0000","last_unstale":"2023-12-04T10:43:58.049829+0000","last_undegraded":"2023-12-04T10:43:58.049829+0000","last_fullsized":"2023-12-04T10:43:58.049829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:46:14.667542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.705960+0000","last_change":"2023-12-04T10:43:58.218053+0000","last_active":"2023-12-04T10:43:58.705960+0000","last_peered":"2023-12-04T10:43:58.705960+0000","last_clean":"2023-12-04T10:43:58.705960+0000","last_became_active":"2023-12-04T10:43:58.216729+0000","last_became_peered":"2023-12-04T10:43:58.216729+0000","last_unstale":"2023-12-04T10:43:58.705960+0000","last_undegraded":"2023-12-04T10:43:58.705960+0000","last_fullsized":"2023-12-04T10:43:58.705960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:05.657652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040709+0000","last_change":"2023-12-04T10:43:52.993942+0000","last_active":"2023-12-04T10:43:58.040709+0000","last_peered":"2023-12-04T10:43:58.040709+0000","last_clean":"2023-12-04T10:43:58.040709+0000","last_became_active":"2023-12-04T10:43:52.993613+0000","last_became_peered":"2023-12-04T10:43:52.993613+0000","last_unstale":"2023-12-04T10:43:58.040709+0000","last_undegraded":"2023-12-04T10:43:58.040709+0000","last_fullsized":"2023-12-04T10:43:58.040709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:11.078149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030147+0000","last_change":"2023-12-04T10:43:52.253522+0000","last_active":"2023-12-04T10:43:58.030147+0000","last_peered":"2023-12-04T10:43:58.030147+0000","last_clean":"2023-12-04T10:43:58.030147+0000","last_became_active":"2023-12-04T10:43:52.253254+0000","last_became_peered":"2023-12-04T10:43:52.253254+0000","last_unstale":"2023-12-04T10:43:58.030147+0000","last_undegraded":"2023-12-04T10:43:58.030147+0000","last_fullsized":"2023-12-04T10:43:58.030147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:59.001748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.996252+0000","last_change":"2023-12-04T10:43:58.049520+0000","last_active":"2023-12-04T10:43:58.996252+0000","last_peered":"2023-12-04T10:43:58.996252+0000","last_clean":"2023-12-04T10:43:58.996252+0000","last_became_active":"2023-12-04T10:43:58.049110+0000","last_became_peered":"2023-12-04T10:43:58.049110+0000","last_unstale":"2023-12-04T10:43:58.996252+0000","last_undegraded":"2023-12-04T10:43:58.996252+0000","last_fullsized":"2023-12-04T10:43:58.996252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:29.332279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.221876+0000","last_change":"2023-12-04T10:43:52.992408+0000","last_active":"2023-12-04T10:43:58.221876+0000","last_peered":"2023-12-04T10:43:58.221876+0000","last_clean":"2023-12-04T10:43:58.221876+0000","last_became_active":"2023-12-04T10:43:52.992078+0000","last_became_peered":"2023-12-04T10:43:52.992078+0000","last_unstale":"2023-12-04T10:43:58.221876+0000","last_undegraded":"2023-12-04T10:43:58.221876+0000","last_fullsized":"2023-12-04T10:43:58.221876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:24.546919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.046433+0000","last_change":"2023-12-04T10:43:52.251057+0000","last_active":"2023-12-04T10:43:58.046433+0000","last_peered":"2023-12-04T10:43:58.046433+0000","last_clean":"2023-12-04T10:43:58.046433+0000","last_became_active":"2023-12-04T10:43:52.250572+0000","last_became_peered":"2023-12-04T10:43:52.250572+0000","last_unstale":"2023-12-04T10:43:58.046433+0000","last_undegraded":"2023-12-04T10:43:58.046433+0000","last_fullsized":"2023-12-04T10:43:58.046433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:24:21.741921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.996401+0000","last_change":"2023-12-04T10:43:58.228293+0000","last_active":"2023-12-04T10:43:58.996401+0000","last_peered":"2023-12-04T10:43:58.996401+0000","last_clean":"2023-12-04T10:43:58.996401+0000","last_became_active":"2023-12-04T10:43:58.227230+0000","last_became_peered":"2023-12-04T10:43:58.227230+0000","last_unstale":"2023-12-04T10:43:58.996401+0000","last_undegraded":"2023-12-04T10:43:58.996401+0000","last_fullsized":"2023-12-04T10:43:58.996401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:45:11.650821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219484+0000","last_change":"2023-12-04T10:43:52.986513+0000","last_active":"2023-12-04T10:43:58.219484+0000","last_peered":"2023-12-04T10:43:58.219484+0000","last_clean":"2023-12-04T10:43:58.219484+0000","last_became_active":"2023-12-04T10:43:52.985480+0000","last_became_peered":"2023-12-04T10:43:52.985480+0000","last_unstale":"2023-12-04T10:43:58.219484+0000","last_undegraded":"2023-12-04T10:43:58.219484+0000","last_fullsized":"2023-12-04T10:43:58.219484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:54.689876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033674+0000","last_change":"2023-12-04T10:43:52.248849+0000","last_active":"2023-12-04T10:43:58.033674+0000","last_peered":"2023-12-04T10:43:58.033674+0000","last_clean":"2023-12-04T10:43:58.033674+0000","last_became_active":"2023-12-04T10:43:52.248072+0000","last_became_peered":"2023-12-04T10:43:52.248072+0000","last_unstale":"2023-12-04T10:43:58.033674+0000","last_undegraded":"2023-12-04T10:43:58.033674+0000","last_fullsized":"2023-12-04T10:43:58.033674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:55:50.076235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704337+0000","last_change":"2023-12-04T10:43:58.054851+0000","last_active":"2023-12-04T10:43:58.704337+0000","last_peered":"2023-12-04T10:43:58.704337+0000","last_clean":"2023-12-04T10:43:58.704337+0000","last_became_active":"2023-12-04T10:43:58.053543+0000","last_became_peered":"2023-12-04T10:43:58.053543+0000","last_unstale":"2023-12-04T10:43:58.704337+0000","last_undegraded":"2023-12-04T10:43:58.704337+0000","last_fullsized":"2023-12-04T10:43:58.704337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:36.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.217048+0000","last_change":"2023-12-04T10:43:52.988930+0000","last_active":"2023-12-04T10:43:58.217048+0000","last_peered":"2023-12-04T10:43:58.217048+0000","last_clean":"2023-12-04T10:43:58.217048+0000","last_became_active":"2023-12-04T10:43:52.988638+0000","last_became_peered":"2023-12-04T10:43:52.988638+0000","last_unstale":"2023-12-04T10:43:58.217048+0000","last_undegraded":"2023-12-04T10:43:58.217048+0000","last_fullsized":"2023-12-04T10:43:58.217048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041474+0000","last_change":"2023-12-04T10:43:52.245850+0000","last_active":"2023-12-04T10:43:58.041474+0000","last_peered":"2023-12-04T10:43:58.041474+0000","last_clean":"2023-12-04T10:43:58.041474+0000","last_became_active":"2023-12-04T10:43:52.245241+0000","last_became_peered":"2023-12-04T10:43:52.245241+0000","last_unstale":"2023-12-04T10:43:58.041474+0000","last_undegraded":"2023-12-04T10:43:58.041474+0000","last_fullsized":"2023-12-04T10:43:58.041474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:01:30.452121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995405+0000","last_change":"2023-12-04T10:43:58.057996+0000","last_active":"2023-12-04T10:43:58.995405+0000","last_peered":"2023-12-04T10:43:58.995405+0000","last_clean":"2023-12-04T10:43:58.995405+0000","last_became_active":"2023-12-04T10:43:58.052353+0000","last_became_peered":"2023-12-04T10:43:58.052353+0000","last_unstale":"2023-12-04T10:43:58.995405+0000","last_undegraded":"2023-12-04T10:43:58.995405+0000","last_fullsized":"2023-12-04T10:43:58.995405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:44.810269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048575+0000","last_change":"2023-12-04T10:43:52.986974+0000","last_active":"2023-12-04T10:43:58.048575+0000","last_peered":"2023-12-04T10:43:58.048575+0000","last_clean":"2023-12-04T10:43:58.048575+0000","last_became_active":"2023-12-04T10:43:52.986644+0000","last_became_peered":"2023-12-04T10:43:52.986644+0000","last_unstale":"2023-12-04T10:43:58.048575+0000","last_undegraded":"2023-12-04T10:43:58.048575+0000","last_fullsized":"2023-12-04T10:43:58.048575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048730+0000","last_change":"2023-12-04T10:43:52.262403+0000","last_active":"2023-12-04T10:43:58.048730+0000","last_peered":"2023-12-04T10:43:58.048730+0000","last_clean":"2023-12-04T10:43:58.048730+0000","last_became_active":"2023-12-04T10:43:52.261992+0000","last_became_peered":"2023-12-04T10:43:52.261992+0000","last_unstale":"2023-12-04T10:43:58.048730+0000","last_undegraded":"2023-12-04T10:43:58.048730+0000","last_fullsized":"2023-12-04T10:43:58.048730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:53:18.654556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704536+0000","last_change":"2023-12-04T10:43:58.227429+0000","last_active":"2023-12-04T10:43:58.704536+0000","last_peered":"2023-12-04T10:43:58.704536+0000","last_clean":"2023-12-04T10:43:58.704536+0000","last_became_active":"2023-12-04T10:43:58.226172+0000","last_became_peered":"2023-12-04T10:43:58.226172+0000","last_unstale":"2023-12-04T10:43:58.704536+0000","last_undegraded":"2023-12-04T10:43:58.704536+0000","last_fullsized":"2023-12-04T10:43:58.704536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:24:19.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216035+0000","last_change":"2023-12-04T10:43:52.991297+0000","last_active":"2023-12-04T10:43:58.216035+0000","last_peered":"2023-12-04T10:43:58.216035+0000","last_clean":"2023-12-04T10:43:58.216035+0000","last_became_active":"2023-12-04T10:43:52.990881+0000","last_became_peered":"2023-12-04T10:43:52.990881+0000","last_unstale":"2023-12-04T10:43:58.216035+0000","last_undegraded":"2023-12-04T10:43:58.216035+0000","last_fullsized":"2023-12-04T10:43:58.216035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:11.078149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034868+0000","last_change":"2023-12-04T10:43:52.262989+0000","last_active":"2023-12-04T10:43:58.034868+0000","last_peered":"2023-12-04T10:43:58.034868+0000","last_clean":"2023-12-04T10:43:58.034868+0000","last_became_active":"2023-12-04T10:43:52.262666+0000","last_became_peered":"2023-12-04T10:43:52.262666+0000","last_unstale":"2023-12-04T10:43:58.034868+0000","last_undegraded":"2023-12-04T10:43:58.034868+0000","last_fullsized":"2023-12-04T10:43:58.034868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:25.093855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703956+0000","last_change":"2023-12-04T10:43:58.215319+0000","last_active":"2023-12-04T10:43:58.703956+0000","last_peered":"2023-12-04T10:43:58.703956+0000","last_clean":"2023-12-04T10:43:58.703956+0000","last_became_active":"2023-12-04T10:43:58.214315+0000","last_became_peered":"2023-12-04T10:43:58.214315+0000","last_unstale":"2023-12-04T10:43:58.703956+0000","last_undegraded":"2023-12-04T10:43:58.703956+0000","last_fullsized":"2023-12-04T10:43:58.703956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:20:30.277031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033921+0000","last_change":"2023-12-04T10:43:52.977398+0000","last_active":"2023-12-04T10:43:58.033921+0000","last_peered":"2023-12-04T10:43:58.033921+0000","last_clean":"2023-12-04T10:43:58.033921+0000","last_became_active":"2023-12-04T10:43:52.977024+0000","last_became_peered":"2023-12-04T10:43:52.977024+0000","last_unstale":"2023-12-04T10:43:58.033921+0000","last_undegraded":"2023-12-04T10:43:58.033921+0000","last_fullsized":"2023-12-04T10:43:58.033921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039616+0000","last_change":"2023-12-04T10:43:52.255501+0000","last_active":"2023-12-04T10:43:58.039616+0000","last_peered":"2023-12-04T10:43:58.039616+0000","last_clean":"2023-12-04T10:43:58.039616+0000","last_became_active":"2023-12-04T10:43:52.255013+0000","last_became_peered":"2023-12-04T10:43:52.255013+0000","last_unstale":"2023-12-04T10:43:58.039616+0000","last_undegraded":"2023-12-04T10:43:58.039616+0000","last_fullsized":"2023-12-04T10:43:58.039616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.999729+0000","last_change":"2023-12-04T10:43:58.216747+0000","last_active":"2023-12-04T10:43:58.999729+0000","last_peered":"2023-12-04T10:43:58.999729+0000","last_clean":"2023-12-04T10:43:58.999729+0000","last_became_active":"2023-12-04T10:43:58.215380+0000","last_became_peered":"2023-12-04T10:43:58.215380+0000","last_unstale":"2023-12-04T10:43:58.999729+0000","last_undegraded":"2023-12-04T10:43:58.999729+0000","last_fullsized":"2023-12-04T10:43:58.999729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:06:26.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219253+0000","last_change":"2023-12-04T10:43:52.986160+0000","last_active":"2023-12-04T10:43:58.219253+0000","last_peered":"2023-12-04T10:43:58.219253+0000","last_clean":"2023-12-04T10:43:58.219253+0000","last_became_active":"2023-12-04T10:43:52.985651+0000","last_became_peered":"2023-12-04T10:43:52.985651+0000","last_unstale":"2023-12-04T10:43:58.219253+0000","last_undegraded":"2023-12-04T10:43:58.219253+0000","last_fullsized":"2023-12-04T10:43:58.219253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:21.236244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:44:13.361227+0000","last_change":"2023-12-04T10:43:52.259456+0000","last_active":"2023-12-04T10:44:13.361227+0000","last_peered":"2023-12-04T10:44:13.361227+0000","last_clean":"2023-12-04T10:44:13.361227+0000","last_became_active":"2023-12-04T10:43:52.259142+0000","last_became_peered":"2023-12-04T10:43:52.259142+0000","last_unstale":"2023-12-04T10:44:13.361227+0000","last_undegraded":"2023-12-04T10:44:13.361227+0000","last_fullsized":"2023-12-04T10:44:13.361227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:14:32.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.999714+0000","last_change":"2023-12-04T10:43:58.055299+0000","last_active":"2023-12-04T10:43:58.999714+0000","last_peered":"2023-12-04T10:43:58.999714+0000","last_clean":"2023-12-04T10:43:58.999714+0000","last_became_active":"2023-12-04T10:43:58.054806+0000","last_became_peered":"2023-12-04T10:43:58.054806+0000","last_unstale":"2023-12-04T10:43:58.999714+0000","last_undegraded":"2023-12-04T10:43:58.999714+0000","last_fullsized":"2023-12-04T10:43:58.999714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:15:21.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.038505+0000","last_change":"2023-12-04T10:43:52.980883+0000","last_active":"2023-12-04T10:43:58.038505+0000","last_peered":"2023-12-04T10:43:58.038505+0000","last_clean":"2023-12-04T10:43:58.038505+0000","last_became_active":"2023-12-04T10:43:52.980510+0000","last_became_peered":"2023-12-04T10:43:52.980510+0000","last_unstale":"2023-12-04T10:43:58.038505+0000","last_undegraded":"2023-12-04T10:43:58.038505+0000","last_fullsized":"2023-12-04T10:43:58.038505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:48.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030038+0000","last_change":"2023-12-04T10:43:52.256393+0000","last_active":"2023-12-04T10:43:58.030038+0000","last_peered":"2023-12-04T10:43:58.030038+0000","last_clean":"2023-12-04T10:43:58.030038+0000","last_became_active":"2023-12-04T10:43:52.256172+0000","last_became_peered":"2023-12-04T10:43:52.256172+0000","last_unstale":"2023-12-04T10:43:58.030038+0000","last_undegraded":"2023-12-04T10:43:58.030038+0000","last_fullsized":"2023-12-04T10:43:58.030038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:50:43.248614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704573+0000","last_change":"2023-12-04T10:43:58.053865+0000","last_active":"2023-12-04T10:43:58.704573+0000","last_peered":"2023-12-04T10:43:58.704573+0000","last_clean":"2023-12-04T10:43:58.704573+0000","last_became_active":"2023-12-04T10:43:58.053350+0000","last_became_peered":"2023-12-04T10:43:58.053350+0000","last_unstale":"2023-12-04T10:43:58.704573+0000","last_undegraded":"2023-12-04T10:43:58.704573+0000","last_fullsized":"2023-12-04T10:43:58.704573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:53:18.451370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039041+0000","last_change":"2023-12-04T10:43:52.979625+0000","last_active":"2023-12-04T10:43:58.039041+0000","last_peered":"2023-12-04T10:43:58.039041+0000","last_clean":"2023-12-04T10:43:58.039041+0000","last_became_active":"2023-12-04T10:43:52.979301+0000","last_became_peered":"2023-12-04T10:43:52.979301+0000","last_unstale":"2023-12-04T10:43:58.039041+0000","last_undegraded":"2023-12-04T10:43:58.039041+0000","last_fullsized":"2023-12-04T10:43:58.039041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040479+0000","last_change":"2023-12-04T10:43:52.256384+0000","last_active":"2023-12-04T10:43:58.040479+0000","last_peered":"2023-12-04T10:43:58.040479+0000","last_clean":"2023-12-04T10:43:58.040479+0000","last_became_active":"2023-12-04T10:43:52.255923+0000","last_became_peered":"2023-12-04T10:43:52.255923+0000","last_unstale":"2023-12-04T10:43:58.040479+0000","last_undegraded":"2023-12-04T10:43:58.040479+0000","last_fullsized":"2023-12-04T10:43:58.040479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:25.210732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702798+0000","last_change":"2023-12-04T10:43:58.052271+0000","last_active":"2023-12-04T10:43:58.702798+0000","last_peered":"2023-12-04T10:43:58.702798+0000","last_clean":"2023-12-04T10:43:58.702798+0000","last_became_active":"2023-12-04T10:43:58.051959+0000","last_became_peered":"2023-12-04T10:43:58.051959+0000","last_unstale":"2023-12-04T10:43:58.702798+0000","last_undegraded":"2023-12-04T10:43:58.702798+0000","last_fullsized":"2023-12-04T10:43:58.702798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:06:26.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040336+0000","last_change":"2023-12-04T10:43:52.982397+0000","last_active":"2023-12-04T10:43:58.040336+0000","last_peered":"2023-12-04T10:43:58.040336+0000","last_clean":"2023-12-04T10:43:58.040336+0000","last_became_active":"2023-12-04T10:43:52.979862+0000","last_became_peered":"2023-12-04T10:43:52.979862+0000","last_unstale":"2023-12-04T10:43:58.040336+0000","last_undegraded":"2023-12-04T10:43:58.040336+0000","last_fullsized":"2023-12-04T10:43:58.040336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:40.024910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049485+0000","last_change":"2023-12-04T10:43:52.267763+0000","last_active":"2023-12-04T10:43:58.049485+0000","last_peered":"2023-12-04T10:43:58.049485+0000","last_clean":"2023-12-04T10:43:58.049485+0000","last_became_active":"2023-12-04T10:43:52.267415+0000","last_became_peered":"2023-12-04T10:43:52.267415+0000","last_unstale":"2023-12-04T10:43:58.049485+0000","last_undegraded":"2023-12-04T10:43:58.049485+0000","last_fullsized":"2023-12-04T10:43:58.049485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702869+0000","last_change":"2023-12-04T10:43:58.225596+0000","last_active":"2023-12-04T10:43:58.702869+0000","last_peered":"2023-12-04T10:43:58.702869+0000","last_clean":"2023-12-04T10:43:58.702869+0000","last_became_active":"2023-12-04T10:43:58.225115+0000","last_became_peered":"2023-12-04T10:43:58.225115+0000","last_unstale":"2023-12-04T10:43:58.702869+0000","last_undegraded":"2023-12-04T10:43:58.702869+0000","last_fullsized":"2023-12-04T10:43:58.702869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:53.914156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995318+0000","last_change":"2023-12-04T10:43:58.235031+0000","last_active":"2023-12-04T10:43:58.995318+0000","last_peered":"2023-12-04T10:43:58.995318+0000","last_clean":"2023-12-04T10:43:58.995318+0000","last_became_active":"2023-12-04T10:43:58.231370+0000","last_became_peered":"2023-12-04T10:43:58.231370+0000","last_unstale":"2023-12-04T10:43:58.995318+0000","last_undegraded":"2023-12-04T10:43:58.995318+0000","last_fullsized":"2023-12-04T10:43:58.995318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:51.750224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030753+0000","last_change":"2023-12-04T10:43:52.970184+0000","last_active":"2023-12-04T10:43:58.030753+0000","last_peered":"2023-12-04T10:43:58.030753+0000","last_clean":"2023-12-04T10:43:58.030753+0000","last_became_active":"2023-12-04T10:43:52.967857+0000","last_became_peered":"2023-12-04T10:43:52.967857+0000","last_unstale":"2023-12-04T10:43:58.030753+0000","last_undegraded":"2023-12-04T10:43:58.030753+0000","last_fullsized":"2023-12-04T10:43:58.030753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:17:13.264517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033298+0000","last_change":"2023-12-04T10:43:52.257154+0000","last_active":"2023-12-04T10:43:58.033298+0000","last_peered":"2023-12-04T10:43:58.033298+0000","last_clean":"2023-12-04T10:43:58.033298+0000","last_became_active":"2023-12-04T10:43:52.256821+0000","last_became_peered":"2023-12-04T10:43:52.256821+0000","last_unstale":"2023-12-04T10:43:58.033298+0000","last_undegraded":"2023-12-04T10:43:58.033298+0000","last_fullsized":"2023-12-04T10:43:58.033298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.707431+0000","last_change":"2023-12-04T10:43:58.063557+0000","last_active":"2023-12-04T10:43:58.707431+0000","last_peered":"2023-12-04T10:43:58.707431+0000","last_clean":"2023-12-04T10:43:58.707431+0000","last_became_active":"2023-12-04T10:43:58.062970+0000","last_became_peered":"2023-12-04T10:43:58.062970+0000","last_unstale":"2023-12-04T10:43:58.707431+0000","last_undegraded":"2023-12-04T10:43:58.707431+0000","last_fullsized":"2023-12-04T10:43:58.707431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:26.021604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021732+0000","last_change":"2023-12-04T10:43:52.984856+0000","last_active":"2023-12-04T10:43:58.021732+0000","last_peered":"2023-12-04T10:43:58.021732+0000","last_clean":"2023-12-04T10:43:58.021732+0000","last_became_active":"2023-12-04T10:43:52.983649+0000","last_became_peered":"2023-12-04T10:43:52.983649+0000","last_unstale":"2023-12-04T10:43:58.021732+0000","last_undegraded":"2023-12-04T10:43:58.021732+0000","last_fullsized":"2023-12-04T10:43:58.021732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022422+0000","last_change":"2023-12-04T10:43:52.251972+0000","last_active":"2023-12-04T10:43:58.022422+0000","last_peered":"2023-12-04T10:43:58.022422+0000","last_clean":"2023-12-04T10:43:58.022422+0000","last_became_active":"2023-12-04T10:43:52.251253+0000","last_became_peered":"2023-12-04T10:43:52.251253+0000","last_unstale":"2023-12-04T10:43:58.022422+0000","last_undegraded":"2023-12-04T10:43:58.022422+0000","last_fullsized":"2023-12-04T10:43:58.022422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:51.960369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048941+0000","last_change":"2023-12-04T10:43:52.260562+0000","last_active":"2023-12-04T10:43:58.048941+0000","last_peered":"2023-12-04T10:43:58.048941+0000","last_clean":"2023-12-04T10:43:58.048941+0000","last_became_active":"2023-12-04T10:43:52.260219+0000","last_became_peered":"2023-12-04T10:43:52.260219+0000","last_unstale":"2023-12-04T10:43:58.048941+0000","last_undegraded":"2023-12-04T10:43:58.048941+0000","last_fullsized":"2023-12-04T10:43:58.048941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:12:59.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041543+0000","last_change":"2023-12-04T10:43:52.987240+0000","last_active":"2023-12-04T10:43:58.041543+0000","last_peered":"2023-12-04T10:43:58.041543+0000","last_clean":"2023-12-04T10:43:58.041543+0000","last_became_active":"2023-12-04T10:43:52.986937+0000","last_became_peered":"2023-12-04T10:43:52.986937+0000","last_unstale":"2023-12-04T10:43:58.041543+0000","last_undegraded":"2023-12-04T10:43:58.041543+0000","last_fullsized":"2023-12-04T10:43:58.041543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.997827+0000","last_change":"2023-12-04T10:43:58.051595+0000","last_active":"2023-12-04T10:43:58.997827+0000","last_peered":"2023-12-04T10:43:58.997827+0000","last_clean":"2023-12-04T10:43:58.997827+0000","last_became_active":"2023-12-04T10:43:58.051043+0000","last_became_peered":"2023-12-04T10:43:58.051043+0000","last_unstale":"2023-12-04T10:43:58.997827+0000","last_undegraded":"2023-12-04T10:43:58.997827+0000","last_fullsized":"2023-12-04T10:43:58.997827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:16:05.070439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021505+0000","last_change":"2023-12-04T10:43:52.265562+0000","last_active":"2023-12-04T10:43:58.021505+0000","last_peered":"2023-12-04T10:43:58.021505+0000","last_clean":"2023-12-04T10:43:58.021505+0000","last_became_active":"2023-12-04T10:43:52.265254+0000","last_became_peered":"2023-12-04T10:43:52.265254+0000","last_unstale":"2023-12-04T10:43:58.021505+0000","last_undegraded":"2023-12-04T10:43:58.021505+0000","last_fullsized":"2023-12-04T10:43:58.021505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:09.555889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.035837+0000","last_change":"2023-12-04T10:43:52.980838+0000","last_active":"2023-12-04T10:43:58.035837+0000","last_peered":"2023-12-04T10:43:58.035837+0000","last_clean":"2023-12-04T10:43:58.035837+0000","last_became_active":"2023-12-04T10:43:52.980492+0000","last_became_peered":"2023-12-04T10:43:52.980492+0000","last_unstale":"2023-12-04T10:43:58.035837+0000","last_undegraded":"2023-12-04T10:43:58.035837+0000","last_fullsized":"2023-12-04T10:43:58.035837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:22.131473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703967+0000","last_change":"2023-12-04T10:43:58.049380+0000","last_active":"2023-12-04T10:43:58.703967+0000","last_peered":"2023-12-04T10:43:58.703967+0000","last_clean":"2023-12-04T10:43:58.703967+0000","last_became_active":"2023-12-04T10:43:58.048992+0000","last_became_peered":"2023-12-04T10:43:58.048992+0000","last_unstale":"2023-12-04T10:43:58.703967+0000","last_undegraded":"2023-12-04T10:43:58.703967+0000","last_fullsized":"2023-12-04T10:43:58.703967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:53:06.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048566+0000","last_change":"2023-12-04T10:43:52.980960+0000","last_active":"2023-12-04T10:43:58.048566+0000","last_peered":"2023-12-04T10:43:58.048566+0000","last_clean":"2023-12-04T10:43:58.048566+0000","last_became_active":"2023-12-04T10:43:52.980414+0000","last_became_peered":"2023-12-04T10:43:52.980414+0000","last_unstale":"2023-12-04T10:43:58.048566+0000","last_undegraded":"2023-12-04T10:43:58.048566+0000","last_fullsized":"2023-12-04T10:43:58.048566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:26.269589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.044326+0000","last_change":"2023-12-04T10:43:52.991417+0000","last_active":"2023-12-04T10:43:58.044326+0000","last_peered":"2023-12-04T10:43:58.044326+0000","last_clean":"2023-12-04T10:43:58.044326+0000","last_became_active":"2023-12-04T10:43:52.991128+0000","last_became_peered":"2023-12-04T10:43:52.991128+0000","last_unstale":"2023-12-04T10:43:58.044326+0000","last_undegraded":"2023-12-04T10:43:58.044326+0000","last_fullsized":"2023-12-04T10:43:58.044326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:48.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034634+0000","last_change":"2023-12-04T10:43:52.979726+0000","last_active":"2023-12-04T10:43:58.034634+0000","last_peered":"2023-12-04T10:43:58.034634+0000","last_clean":"2023-12-04T10:43:58.034634+0000","last_became_active":"2023-12-04T10:43:52.979418+0000","last_became_peered":"2023-12-04T10:43:52.979418+0000","last_unstale":"2023-12-04T10:43:58.034634+0000","last_undegraded":"2023-12-04T10:43:58.034634+0000","last_fullsized":"2023-12-04T10:43:58.034634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:35:03.536961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037625+0000","last_change":"2023-12-04T10:43:52.983306+0000","last_active":"2023-12-04T10:43:58.037625+0000","last_peered":"2023-12-04T10:43:58.037625+0000","last_clean":"2023-12-04T10:43:58.037625+0000","last_became_active":"2023-12-04T10:43:52.982993+0000","last_became_peered":"2023-12-04T10:43:52.982993+0000","last_unstale":"2023-12-04T10:43:58.037625+0000","last_undegraded":"2023-12-04T10:43:58.037625+0000","last_fullsized":"2023-12-04T10:43:58.037625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:26.269589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021434+0000","last_change":"2023-12-04T10:43:52.977063+0000","last_active":"2023-12-04T10:43:58.021434+0000","last_peered":"2023-12-04T10:43:58.021434+0000","last_clean":"2023-12-04T10:43:58.021434+0000","last_became_active":"2023-12-04T10:43:52.975971+0000","last_became_peered":"2023-12-04T10:43:52.975971+0000","last_unstale":"2023-12-04T10:43:58.021434+0000","last_undegraded":"2023-12-04T10:43:58.021434+0000","last_fullsized":"2023-12-04T10:43:58.021434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.029916+0000","last_change":"2023-12-04T10:43:52.982380+0000","last_active":"2023-12-04T10:43:58.029916+0000","last_peered":"2023-12-04T10:43:58.029916+0000","last_clean":"2023-12-04T10:43:58.029916+0000","last_became_active":"2023-12-04T10:43:52.981200+0000","last_became_peered":"2023-12-04T10:43:52.981200+0000","last_unstale":"2023-12-04T10:43:58.029916+0000","last_undegraded":"2023-12-04T10:43:58.029916+0000","last_fullsized":"2023-12-04T10:43:58.029916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:35:52.376732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.050824+0000","last_change":"2023-12-04T10:43:52.987443+0000","last_active":"2023-12-04T10:43:58.050824+0000","last_peered":"2023-12-04T10:43:58.050824+0000","last_clean":"2023-12-04T10:43:58.050824+0000","last_became_active":"2023-12-04T10:43:52.987177+0000","last_became_peered":"2023-12-04T10:43:52.987177+0000","last_unstale":"2023-12-04T10:43:58.050824+0000","last_undegraded":"2023-12-04T10:43:58.050824+0000","last_fullsized":"2023-12-04T10:43:58.050824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.023146+0000","last_change":"2023-12-04T10:43:52.986477+0000","last_active":"2023-12-04T10:43:58.023146+0000","last_peered":"2023-12-04T10:43:58.023146+0000","last_clean":"2023-12-04T10:43:58.023146+0000","last_became_active":"2023-12-04T10:43:52.986072+0000","last_became_peered":"2023-12-04T10:43:52.986072+0000","last_unstale":"2023-12-04T10:43:58.023146+0000","last_undegraded":"2023-12-04T10:43:58.023146+0000","last_fullsized":"2023-12-04T10:43:58.023146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033092+0000","last_change":"2023-12-04T10:43:52.993638+0000","last_active":"2023-12-04T10:43:58.033092+0000","last_peered":"2023-12-04T10:43:58.033092+0000","last_clean":"2023-12-04T10:43:58.033092+0000","last_became_active":"2023-12-04T10:43:52.993364+0000","last_became_peered":"2023-12-04T10:43:52.993364+0000","last_unstale":"2023-12-04T10:43:58.033092+0000","last_undegraded":"2023-12-04T10:43:58.033092+0000","last_fullsized":"2023-12-04T10:43:58.033092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022326+0000","last_change":"2023-12-04T10:43:52.986640+0000","last_active":"2023-12-04T10:43:58.022326+0000","last_peered":"2023-12-04T10:43:58.022326+0000","last_clean":"2023-12-04T10:43:58.022326+0000","last_became_active":"2023-12-04T10:43:52.983310+0000","last_became_peered":"2023-12-04T10:43:52.983310+0000","last_unstale":"2023-12-04T10:43:58.022326+0000","last_undegraded":"2023-12-04T10:43:58.022326+0000","last_fullsized":"2023-12-04T10:43:58.022326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034400+0000","last_change":"2023-12-04T10:43:52.982396+0000","last_active":"2023-12-04T10:43:58.034400+0000","last_peered":"2023-12-04T10:43:58.034400+0000","last_clean":"2023-12-04T10:43:58.034400+0000","last_became_active":"2023-12-04T10:43:52.980007+0000","last_became_peered":"2023-12-04T10:43:52.980007+0000","last_unstale":"2023-12-04T10:43:58.034400+0000","last_undegraded":"2023-12-04T10:43:58.034400+0000","last_fullsized":"2023-12-04T10:43:58.034400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037514+0000","last_change":"2023-12-04T10:43:52.979531+0000","last_active":"2023-12-04T10:43:58.037514+0000","last_peered":"2023-12-04T10:43:58.037514+0000","last_clean":"2023-12-04T10:43:58.037514+0000","last_became_active":"2023-12-04T10:43:52.979210+0000","last_became_peered":"2023-12-04T10:43:52.979210+0000","last_unstale":"2023-12-04T10:43:58.037514+0000","last_undegraded":"2023-12-04T10:43:58.037514+0000","last_fullsized":"2023-12-04T10:43:58.037514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:14:33.669944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048898+0000","last_change":"2023-12-04T10:43:52.986872+0000","last_active":"2023-12-04T10:43:58.048898+0000","last_peered":"2023-12-04T10:43:58.048898+0000","last_clean":"2023-12-04T10:43:58.048898+0000","last_became_active":"2023-12-04T10:43:52.981778+0000","last_became_peered":"2023-12-04T10:43:52.981778+0000","last_unstale":"2023-12-04T10:43:58.048898+0000","last_undegraded":"2023-12-04T10:43:58.048898+0000","last_fullsized":"2023-12-04T10:43:58.048898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219648+0000","last_change":"2023-12-04T10:43:52.985981+0000","last_active":"2023-12-04T10:43:58.219648+0000","last_peered":"2023-12-04T10:43:58.219648+0000","last_clean":"2023-12-04T10:43:58.219648+0000","last_became_active":"2023-12-04T10:43:52.982061+0000","last_became_peered":"2023-12-04T10:43:52.982061+0000","last_unstale":"2023-12-04T10:43:58.219648+0000","last_undegraded":"2023-12-04T10:43:58.219648+0000","last_fullsized":"2023-12-04T10:43:58.219648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:40.024910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.046541+0000","last_change":"2023-12-04T10:43:52.973616+0000","last_active":"2023-12-04T10:43:58.046541+0000","last_peered":"2023-12-04T10:43:58.046541+0000","last_clean":"2023-12-04T10:43:58.046541+0000","last_became_active":"2023-12-04T10:43:52.973295+0000","last_became_peered":"2023-12-04T10:43:52.973295+0000","last_unstale":"2023-12-04T10:43:58.046541+0000","last_undegraded":"2023-12-04T10:43:58.046541+0000","last_fullsized":"2023-12-04T10:43:58.046541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:57:45.678858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041620+0000","last_change":"2023-12-04T10:43:52.988142+0000","last_active":"2023-12-04T10:43:58.041620+0000","last_peered":"2023-12-04T10:43:58.041620+0000","last_clean":"2023-12-04T10:43:58.041620+0000","last_became_active":"2023-12-04T10:43:52.979726+0000","last_became_peered":"2023-12-04T10:43:52.979726+0000","last_unstale":"2023-12-04T10:43:58.041620+0000","last_undegraded":"2023-12-04T10:43:58.041620+0000","last_fullsized":"2023-12-04T10:43:58.041620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:54.689876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.032829+0000","last_change":"2023-12-04T10:43:52.979067+0000","last_active":"2023-12-04T10:43:58.032829+0000","last_peered":"2023-12-04T10:43:58.032829+0000","last_clean":"2023-12-04T10:43:58.032829+0000","last_became_active":"2023-12-04T10:43:52.978720+0000","last_became_peered":"2023-12-04T10:43:52.978720+0000","last_unstale":"2023-12-04T10:43:58.032829+0000","last_undegraded":"2023-12-04T10:43:58.032829+0000","last_fullsized":"2023-12-04T10:43:58.032829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030859+0000","last_change":"2023-12-04T10:43:52.976129+0000","last_active":"2023-12-04T10:43:58.030859+0000","last_peered":"2023-12-04T10:43:58.030859+0000","last_clean":"2023-12-04T10:43:58.030859+0000","last_became_active":"2023-12-04T10:43:52.975844+0000","last_became_peered":"2023-12-04T10:43:52.975844+0000","last_unstale":"2023-12-04T10:43:58.030859+0000","last_undegraded":"2023-12-04T10:43:58.030859+0000","last_fullsized":"2023-12-04T10:43:58.030859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:37:49.291916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033802+0000","last_change":"2023-12-04T10:43:52.984631+0000","last_active":"2023-12-04T10:43:58.033802+0000","last_peered":"2023-12-04T10:43:58.033802+0000","last_clean":"2023-12-04T10:43:58.033802+0000","last_became_active":"2023-12-04T10:43:52.984276+0000","last_became_peered":"2023-12-04T10:43:52.984276+0000","last_unstale":"2023-12-04T10:43:58.033802+0000","last_undegraded":"2023-12-04T10:43:58.033802+0000","last_fullsized":"2023-12-04T10:43:58.033802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:53:19.937888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020905+0000","last_change":"2023-12-04T10:43:52.978860+0000","last_active":"2023-12-04T10:43:58.020905+0000","last_peered":"2023-12-04T10:43:58.020905+0000","last_clean":"2023-12-04T10:43:58.020905+0000","last_became_active":"2023-12-04T10:43:52.978564+0000","last_became_peered":"2023-12-04T10:43:52.978564+0000","last_unstale":"2023-12-04T10:43:58.020905+0000","last_undegraded":"2023-12-04T10:43:58.020905+0000","last_fullsized":"2023-12-04T10:43:58.020905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.038398+0000","last_change":"2023-12-04T10:43:52.973000+0000","last_active":"2023-12-04T10:43:58.038398+0000","last_peered":"2023-12-04T10:43:58.038398+0000","last_clean":"2023-12-04T10:43:58.038398+0000","last_became_active":"2023-12-04T10:43:52.972621+0000","last_became_peered":"2023-12-04T10:43:52.972621+0000","last_unstale":"2023-12-04T10:43:58.038398+0000","last_undegraded":"2023-12-04T10:43:58.038398+0000","last_fullsized":"2023-12-04T10:43:58.038398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:57:45.678858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049439+0000","last_change":"2023-12-04T10:43:52.982066+0000","last_active":"2023-12-04T10:43:58.049439+0000","last_peered":"2023-12-04T10:43:58.049439+0000","last_clean":"2023-12-04T10:43:58.049439+0000","last_became_active":"2023-12-04T10:43:52.981727+0000","last_became_peered":"2023-12-04T10:43:52.981727+0000","last_unstale":"2023-12-04T10:43:58.049439+0000","last_undegraded":"2023-12-04T10:43:58.049439+0000","last_fullsized":"2023-12-04T10:43:58.049439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.050796+0000","last_change":"2023-12-04T10:43:52.983361+0000","last_active":"2023-12-04T10:43:58.050796+0000","last_peered":"2023-12-04T10:43:58.050796+0000","last_clean":"2023-12-04T10:43:58.050796+0000","last_became_active":"2023-12-04T10:43:52.983081+0000","last_became_peered":"2023-12-04T10:43:52.983081+0000","last_unstale":"2023-12-04T10:43:58.050796+0000","last_undegraded":"2023-12-04T10:43:58.050796+0000","last_fullsized":"2023-12-04T10:43:58.050796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.221587+0000","last_change":"2023-12-04T10:43:52.994001+0000","last_active":"2023-12-04T10:43:58.221587+0000","last_peered":"2023-12-04T10:43:58.221587+0000","last_clean":"2023-12-04T10:43:58.221587+0000","last_became_active":"2023-12-04T10:43:52.993633+0000","last_became_peered":"2023-12-04T10:43:52.993633+0000","last_unstale":"2023-12-04T10:43:58.221587+0000","last_undegraded":"2023-12-04T10:43:58.221587+0000","last_fullsized":"2023-12-04T10:43:58.221587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:50:20.802003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020739+0000","last_change":"2023-12-04T10:43:52.988344+0000","last_active":"2023-12-04T10:43:58.020739+0000","last_peered":"2023-12-04T10:43:58.020739+0000","last_clean":"2023-12-04T10:43:58.020739+0000","last_became_active":"2023-12-04T10:43:52.988051+0000","last_became_peered":"2023-12-04T10:43:52.988051+0000","last_unstale":"2023-12-04T10:43:58.020739+0000","last_undegraded":"2023-12-04T10:43:58.020739+0000","last_fullsized":"2023-12-04T10:43:58.020739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.213667+0000","last_change":"2023-12-04T10:43:52.977848+0000","last_active":"2023-12-04T10:43:58.213667+0000","last_peered":"2023-12-04T10:43:58.213667+0000","last_clean":"2023-12-04T10:43:58.213667+0000","last_became_active":"2023-12-04T10:43:52.977443+0000","last_became_peered":"2023-12-04T10:43:52.977443+0000","last_unstale":"2023-12-04T10:43:58.213667+0000","last_undegraded":"2023-12-04T10:43:58.213667+0000","last_fullsized":"2023-12-04T10:43:58.213667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034180+0000","last_change":"2023-12-04T10:43:52.978013+0000","last_active":"2023-12-04T10:43:58.034180+0000","last_peered":"2023-12-04T10:43:58.034180+0000","last_clean":"2023-12-04T10:43:58.034180+0000","last_became_active":"2023-12-04T10:43:52.976233+0000","last_became_peered":"2023-12-04T10:43:52.976233+0000","last_unstale":"2023-12-04T10:43:58.034180+0000","last_undegraded":"2023-12-04T10:43:58.034180+0000","last_fullsized":"2023-12-04T10:43:58.034180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216255+0000","last_change":"2023-12-04T10:43:52.987505+0000","last_active":"2023-12-04T10:43:58.216255+0000","last_peered":"2023-12-04T10:43:58.216255+0000","last_clean":"2023-12-04T10:43:58.216255+0000","last_became_active":"2023-12-04T10:43:52.982436+0000","last_became_peered":"2023-12-04T10:43:52.982436+0000","last_unstale":"2023-12-04T10:43:58.216255+0000","last_undegraded":"2023-12-04T10:43:58.216255+0000","last_fullsized":"2023-12-04T10:43:58.216255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040439+0000","last_change":"2023-12-04T10:43:52.988667+0000","last_active":"2023-12-04T10:43:58.040439+0000","last_peered":"2023-12-04T10:43:58.040439+0000","last_clean":"2023-12-04T10:43:58.040439+0000","last_became_active":"2023-12-04T10:43:52.988296+0000","last_became_peered":"2023-12-04T10:43:52.988296+0000","last_unstale":"2023-12-04T10:43:58.040439+0000","last_undegraded":"2023-12-04T10:43:58.040439+0000","last_fullsized":"2023-12-04T10:43:58.040439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037780+0000","last_change":"2023-12-04T10:43:52.983801+0000","last_active":"2023-12-04T10:43:58.037780+0000","last_peered":"2023-12-04T10:43:58.037780+0000","last_clean":"2023-12-04T10:43:58.037780+0000","last_became_active":"2023-12-04T10:43:52.981238+0000","last_became_peered":"2023-12-04T10:43:52.981238+0000","last_unstale":"2023-12-04T10:43:58.037780+0000","last_undegraded":"2023-12-04T10:43:58.037780+0000","last_fullsized":"2023-12-04T10:43:58.037780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030806+0000","last_change":"2023-12-04T10:43:52.978663+0000","last_active":"2023-12-04T10:43:58.030806+0000","last_peered":"2023-12-04T10:43:58.030806+0000","last_clean":"2023-12-04T10:43:58.030806+0000","last_became_active":"2023-12-04T10:43:52.978251+0000","last_became_peered":"2023-12-04T10:43:52.978251+0000","last_unstale":"2023-12-04T10:43:58.030806+0000","last_undegraded":"2023-12-04T10:43:58.030806+0000","last_fullsized":"2023-12-04T10:43:58.030806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:17:51.617229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.220292+0000","last_change":"2023-12-04T10:43:52.985634+0000","last_active":"2023-12-04T10:43:58.220292+0000","last_peered":"2023-12-04T10:43:58.220292+0000","last_clean":"2023-12-04T10:43:58.220292+0000","last_became_active":"2023-12-04T10:43:52.981676+0000","last_became_peered":"2023-12-04T10:43:52.981676+0000","last_unstale":"2023-12-04T10:43:58.220292+0000","last_undegraded":"2023-12-04T10:43:58.220292+0000","last_fullsized":"2023-12-04T10:43:58.220292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:32:44.930072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":702921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9159999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9910000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7410000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":112061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":702977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":112097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5190000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5750000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":111971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T10:44:27.363 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T10:44:27.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.622+0000 7f2f78294640 1 Processor -- start 2023-12-04T10:44:27.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.622+0000 7f2f78294640 1 -- start start 2023-12-04T10:44:27.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.624+0000 7f2f78294640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2f7006d400 0x7f2f7006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.624+0000 7f2f78294640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2f70072270 0x7f2f70070770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.624+0000 7f2f78294640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f7015a9a0 con 0x7f2f701572f0 2023-12-04T10:44:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.624+0000 7f2f78294640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f70159db0 con 0x7f2f7006d400 2023-12-04T10:44:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.624+0000 7f2f78294640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f7015a070 con 0x7f2f70072270 2023-12-04T10:44:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f7582f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2f7006d400 0x7f2f7006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f76030640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2f701572f0 0x7f2f7006ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43812/0 (socket says 172.21.15.63:43812) 2023-12-04T10:44:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f76030640 1 -- 172.21.15.63:0/774387381 learned_addr learned my addr 172.21.15.63:0/774387381 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:27.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f76831640 1 --2- 172.21.15.63:0/774387381 >> v2:172.21.15.66:3300/0 conn(0x7f2f70072270 0x7f2f70070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f7582f640 1 -- 172.21.15.63:0/774387381 >> v2:172.21.15.66:3300/0 conn(0x7f2f70072270 msgr2=0x7f2f70070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:27.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f7582f640 1 --2- 172.21.15.63:0/774387381 >> v2:172.21.15.66:3300/0 conn(0x7f2f70072270 0x7f2f70070770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f7582f640 1 -- 172.21.15.63:0/774387381 >> v1:172.21.15.63:6789/0 conn(0x7f2f701572f0 legacy=0x7f2f7006ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f7582f640 1 -- 172.21.15.63:0/774387381 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7015a350 con 0x7f2f7006d400 2023-12-04T10:44:27.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f76831640 1 --2- 172.21.15.63:0/774387381 >> v2:172.21.15.66:3300/0 conn(0x7f2f70072270 0x7f2f70070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:27.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.625+0000 7f2f7502e640 1 -- 172.21.15.63:0/774387381 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820277268 0 0) 0x7f2f7015a9a0 con 0x7f2f701572f0 2023-12-04T10:44:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.626+0000 7f2f7582f640 1 --2- 172.21.15.63:0/774387381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f7006d400 0x7f2f7006db70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2f700c9c10 tx=0x7f2f6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8564a1350f3326 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f7502e640 1 -- 172.21.15.63:0/774387381 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6002e070 con 0x7f2f7006d400 2023-12-04T10:44:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f7502e640 1 -- 172.21.15.63:0/774387381 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f600315a0 con 0x7f2f7006d400 2023-12-04T10:44:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f7502e640 1 -- 172.21.15.63:0/774387381 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f60031930 con 0x7f2f7006d400 2023-12-04T10:44:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f78294640 1 -- 172.21.15.63:0/774387381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f7006d400 msgr2=0x7f2f7006db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f78294640 1 --2- 172.21.15.63:0/774387381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f7006d400 0x7f2f7006db70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2f700c9c10 tx=0x7f2f6002b840 comp rx=0 tx=0).stop 2023-12-04T10:44:27.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f78294640 1 -- 172.21.15.63:0/774387381 shutdown_connections 2023-12-04T10:44:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f78294640 1 --2- 172.21.15.63:0/774387381 >> v2:172.21.15.66:3300/0 conn(0x7f2f70072270 0x7f2f70070770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f78294640 1 --2- 172.21.15.63:0/774387381 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f7006d400 0x7f2f7006db70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f78294640 1 -- 172.21.15.63:0/774387381 >> 172.21.15.63:0/774387381 conn(0x7f2f700cee80 msgr2=0x7f2f700cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f78294640 1 -- 172.21.15.63:0/774387381 shutdown_connections 2023-12-04T10:44:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.627+0000 7f2f78294640 1 -- 172.21.15.63:0/774387381 wait complete. 2023-12-04T10:44:27.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.629+0000 7f2f78294640 1 Processor -- start 2023-12-04T10:44:27.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.629+0000 7f2f78294640 1 -- start start 2023-12-04T10:44:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f78294640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f7006d400 0x7f2f70158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f78294640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f70072270 0x7f2f701f2cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f78294640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f701572f0 0x7f2f7014aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f78294640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f701f3750 con 0x7f2f701572f0 2023-12-04T10:44:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f78294640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f701f3a30 con 0x7f2f7006d400 2023-12-04T10:44:27.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f78294640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f701f3d10 con 0x7f2f70072270 2023-12-04T10:44:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f76831640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f701572f0 0x7f2f7014aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f76831640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f701572f0 0x7f2f7014aa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34568/0 (socket says 172.21.15.63:34568) 2023-12-04T10:44:27.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.630+0000 7f2f76831640 1 -- 172.21.15.63:0/504735317 learned_addr learned my addr 172.21.15.63:0/504735317 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f76030640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f7006d400 0x7f2f70158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f7582f640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f70072270 0x7f2f701f2cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f76831640 1 -- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f70072270 msgr2=0x7f2f701f2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f76831640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f70072270 0x7f2f701f2cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f76831640 1 -- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f7006d400 msgr2=0x7f2f70158330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f76831640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f7006d400 0x7f2f70158330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f76831640 1 -- 172.21.15.63:0/504735317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60009400 con 0x7f2f701572f0 2023-12-04T10:44:27.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f76030640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f7006d400 0x7f2f70158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f76831640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f701572f0 0x7f2f7014aa80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f68007ef0 tx=0x7f2f6800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f66ffd640 1 -- 172.21.15.63:0/504735317 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f68003b90 con 0x7f2f701572f0 2023-12-04T10:44:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f66ffd640 1 -- 172.21.15.63:0/504735317 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f6800f040 con 0x7f2f701572f0 2023-12-04T10:44:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f66ffd640 1 -- 172.21.15.63:0/504735317 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f6800de80 con 0x7f2f701572f0 2023-12-04T10:44:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.631+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f701f3ff0 con 0x7f2f701572f0 2023-12-04T10:44:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.632+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f70156490 con 0x7f2f701572f0 2023-12-04T10:44:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.633+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f70068710 con 0x7f2f701572f0 2023-12-04T10:44:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.634+0000 7f2f66ffd640 1 -- 172.21.15.63:0/504735317 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2f68004030 con 0x7f2f701572f0 2023-12-04T10:44:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.634+0000 7f2f66ffd640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2f5406ae40 0x7f2f5406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.635+0000 7f2f66ffd640 1 -- 172.21.15.63:0/504735317 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2f68089bd0 con 0x7f2f701572f0 2023-12-04T10:44:27.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.635+0000 7f2f76030640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2f5406ae40 0x7f2f5406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:27.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.636+0000 7f2f76030640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2f5406ae40 0x7f2f5406d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000f60 tx=0x7f2f6c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:27.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.640+0000 7f2f66ffd640 1 -- 172.21.15.63:0/504735317 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2f680549a0 con 0x7f2f701572f0 2023-12-04T10:44:27.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.829+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 --> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f700c9700 con 0x7f2f5406ae40 2023-12-04T10:44:27.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.855+0000 7f2f66ffd640 1 -- 172.21.15.63:0/504735317 <== mgr.4107 v2:172.21.15.63:6832/2779630096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345089 (secure 0 0 0) 0x7f2f6c001c90 con 0x7f2f5406ae40 2023-12-04T10:44:27.860 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:27.864 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.863+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2f5406ae40 msgr2=0x7f2f5406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.863+0000 7f2f78294640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2f5406ae40 0x7f2f5406d300 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2f6c000f60 tx=0x7f2f6c009040 comp rx=0 tx=0).stop 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f701572f0 msgr2=0x7f2f7014aa80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f701572f0 0x7f2f7014aa80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f2f68007ef0 tx=0x7f2f6800d4a0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 shutdown_connections 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2f5406ae40 0x7f2f5406d300 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2f70072270 0x7f2f701f2cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2f701572f0 0x7f2f7014aa80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 --2- 172.21.15.63:0/504735317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f7006d400 0x7f2f70158330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 >> 172.21.15.63:0/504735317 conn(0x7f2f700cee80 msgr2=0x7f2f70158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:27.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 shutdown_connections 2023-12-04T10:44:27.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:27.864+0000 7f2f78294640 1 -- 172.21.15.63:0/504735317 wait complete. 2023-12-04T10:44:27.886 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2023-12-04T10:44:25.974838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595007,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219596,"kb_used_data":3432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755124,"statfs":{"total":773094113280,"available":772869246976,"internally_reserved":0,"allocated":3514368,"data_stored":2085782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004924"},"pg_stats":[{"pgid":"2.1f","version":"21'4","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039141+0000","last_change":"2023-12-04T10:43:52.262642+0000","last_active":"2023-12-04T10:43:58.039141+0000","last_peered":"2023-12-04T10:43:58.039141+0000","last_clean":"2023-12-04T10:43:58.039141+0000","last_became_active":"2023-12-04T10:43:52.262376+0000","last_became_peered":"2023-12-04T10:43:52.262376+0000","last_unstale":"2023-12-04T10:43:58.039141+0000","last_undegraded":"2023-12-04T10:43:58.039141+0000","last_fullsized":"2023-12-04T10:43:58.039141+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022140+0000","last_change":"2023-12-04T10:43:52.985649+0000","last_active":"2023-12-04T10:43:58.022140+0000","last_peered":"2023-12-04T10:43:58.022140+0000","last_clean":"2023-12-04T10:43:58.022140+0000","last_became_active":"2023-12-04T10:43:52.980842+0000","last_became_peered":"2023-12-04T10:43:52.980842+0000","last_unstale":"2023-12-04T10:43:58.022140+0000","last_undegraded":"2023-12-04T10:43:58.022140+0000","last_fullsized":"2023-12-04T10:43:58.022140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:35:03.536961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702614+0000","last_change":"2023-12-04T10:43:58.234310+0000","last_active":"2023-12-04T10:43:58.702614+0000","last_peered":"2023-12-04T10:43:58.702614+0000","last_clean":"2023-12-04T10:43:58.702614+0000","last_became_active":"2023-12-04T10:43:58.233037+0000","last_became_peered":"2023-12-04T10:43:58.233037+0000","last_unstale":"2023-12-04T10:43:58.702614+0000","last_undegraded":"2023-12-04T10:43:58.702614+0000","last_fullsized":"2023-12-04T10:43:58.702614+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:45:11.650821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022299+0000","last_change":"2023-12-04T10:43:52.244397+0000","last_active":"2023-12-04T10:43:58.022299+0000","last_peered":"2023-12-04T10:43:58.022299+0000","last_clean":"2023-12-04T10:43:58.022299+0000","last_became_active":"2023-12-04T10:43:52.244095+0000","last_became_peered":"2023-12-04T10:43:52.244095+0000","last_unstale":"2023-12-04T10:43:58.022299+0000","last_undegraded":"2023-12-04T10:43:58.022299+0000","last_fullsized":"2023-12-04T10:43:58.022299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:12:59.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037025+0000","last_change":"2023-12-04T10:43:52.991593+0000","last_active":"2023-12-04T10:43:58.037025+0000","last_peered":"2023-12-04T10:43:58.037025+0000","last_clean":"2023-12-04T10:43:58.037025+0000","last_became_active":"2023-12-04T10:43:52.991219+0000","last_became_peered":"2023-12-04T10:43:52.991219+0000","last_unstale":"2023-12-04T10:43:58.037025+0000","last_undegraded":"2023-12-04T10:43:58.037025+0000","last_fullsized":"2023-12-04T10:43:58.037025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704700+0000","last_change":"2023-12-04T10:43:58.054950+0000","last_active":"2023-12-04T10:43:58.704700+0000","last_peered":"2023-12-04T10:43:58.704700+0000","last_clean":"2023-12-04T10:43:58.704700+0000","last_became_active":"2023-12-04T10:43:58.054476+0000","last_became_peered":"2023-12-04T10:43:58.054476+0000","last_unstale":"2023-12-04T10:43:58.704700+0000","last_undegraded":"2023-12-04T10:43:58.704700+0000","last_fullsized":"2023-12-04T10:43:58.704700+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:12.751001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219571+0000","last_change":"2023-12-04T10:43:52.267072+0000","last_active":"2023-12-04T10:43:58.219571+0000","last_peered":"2023-12-04T10:43:58.219571+0000","last_clean":"2023-12-04T10:43:58.219571+0000","last_became_active":"2023-12-04T10:43:52.266736+0000","last_became_peered":"2023-12-04T10:43:52.266736+0000","last_unstale":"2023-12-04T10:43:58.219571+0000","last_undegraded":"2023-12-04T10:43:58.219571+0000","last_fullsized":"2023-12-04T10:43:58.219571+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:24.986256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040614+0000","last_change":"2023-12-04T10:43:52.973354+0000","last_active":"2023-12-04T10:43:58.040614+0000","last_peered":"2023-12-04T10:43:58.040614+0000","last_clean":"2023-12-04T10:43:58.040614+0000","last_became_active":"2023-12-04T10:43:52.973024+0000","last_became_peered":"2023-12-04T10:43:52.973024+0000","last_unstale":"2023-12-04T10:43:58.040614+0000","last_undegraded":"2023-12-04T10:43:58.040614+0000","last_fullsized":"2023-12-04T10:43:58.040614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703606+0000","last_change":"2023-12-04T10:43:58.052885+0000","last_active":"2023-12-04T10:43:58.703606+0000","last_peered":"2023-12-04T10:43:58.703606+0000","last_clean":"2023-12-04T10:43:58.703606+0000","last_became_active":"2023-12-04T10:43:58.052363+0000","last_became_peered":"2023-12-04T10:43:58.052363+0000","last_unstale":"2023-12-04T10:43:58.703606+0000","last_undegraded":"2023-12-04T10:43:58.703606+0000","last_fullsized":"2023-12-04T10:43:58.703606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:46:46.891581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.215836+0000","last_change":"2023-12-04T10:43:52.270824+0000","last_active":"2023-12-04T10:43:58.215836+0000","last_peered":"2023-12-04T10:43:58.215836+0000","last_clean":"2023-12-04T10:43:58.215836+0000","last_became_active":"2023-12-04T10:43:52.270451+0000","last_became_peered":"2023-12-04T10:43:52.270451+0000","last_unstale":"2023-12-04T10:43:58.215836+0000","last_undegraded":"2023-12-04T10:43:58.215836+0000","last_fullsized":"2023-12-04T10:43:58.215836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:09.555889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040349+0000","last_change":"2023-12-04T10:43:52.975366+0000","last_active":"2023-12-04T10:43:58.040349+0000","last_peered":"2023-12-04T10:43:58.040349+0000","last_clean":"2023-12-04T10:43:58.040349+0000","last_became_active":"2023-12-04T10:43:52.975083+0000","last_became_peered":"2023-12-04T10:43:52.975083+0000","last_unstale":"2023-12-04T10:43:58.040349+0000","last_undegraded":"2023-12-04T10:43:58.040349+0000","last_fullsized":"2023-12-04T10:43:58.040349+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:46.964865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703374+0000","last_change":"2023-12-04T10:43:58.056032+0000","last_active":"2023-12-04T10:43:58.703374+0000","last_peered":"2023-12-04T10:43:58.703374+0000","last_clean":"2023-12-04T10:43:58.703374+0000","last_became_active":"2023-12-04T10:43:58.055534+0000","last_became_peered":"2023-12-04T10:43:58.055534+0000","last_unstale":"2023-12-04T10:43:58.703374+0000","last_undegraded":"2023-12-04T10:43:58.703374+0000","last_fullsized":"2023-12-04T10:43:58.703374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:17:56.402589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048799+0000","last_change":"2023-12-04T10:43:52.985238+0000","last_active":"2023-12-04T10:43:58.048799+0000","last_peered":"2023-12-04T10:43:58.048799+0000","last_clean":"2023-12-04T10:43:58.048799+0000","last_became_active":"2023-12-04T10:43:52.984911+0000","last_became_peered":"2023-12-04T10:43:52.984911+0000","last_unstale":"2023-12-04T10:43:58.048799+0000","last_undegraded":"2023-12-04T10:43:58.048799+0000","last_fullsized":"2023-12-04T10:43:58.048799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216522+0000","last_change":"2023-12-04T10:43:52.269729+0000","last_active":"2023-12-04T10:43:58.216522+0000","last_peered":"2023-12-04T10:43:58.216522+0000","last_clean":"2023-12-04T10:43:58.216522+0000","last_became_active":"2023-12-04T10:43:52.268943+0000","last_became_peered":"2023-12-04T10:43:52.268943+0000","last_unstale":"2023-12-04T10:43:58.216522+0000","last_undegraded":"2023-12-04T10:43:58.216522+0000","last_fullsized":"2023-12-04T10:43:58.216522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:47.791989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.705778+0000","last_change":"2023-12-04T10:43:58.054574+0000","last_active":"2023-12-04T10:43:58.705778+0000","last_peered":"2023-12-04T10:43:58.705778+0000","last_clean":"2023-12-04T10:43:58.705778+0000","last_became_active":"2023-12-04T10:43:58.052778+0000","last_became_peered":"2023-12-04T10:43:58.052778+0000","last_unstale":"2023-12-04T10:43:58.705778+0000","last_undegraded":"2023-12-04T10:43:58.705778+0000","last_fullsized":"2023-12-04T10:43:58.705778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:14:13.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021096+0000","last_change":"2023-12-04T10:43:52.980176+0000","last_active":"2023-12-04T10:43:58.021096+0000","last_peered":"2023-12-04T10:43:58.021096+0000","last_clean":"2023-12-04T10:43:58.021096+0000","last_became_active":"2023-12-04T10:43:52.979878+0000","last_became_peered":"2023-12-04T10:43:52.979878+0000","last_unstale":"2023-12-04T10:43:58.021096+0000","last_undegraded":"2023-12-04T10:43:58.021096+0000","last_fullsized":"2023-12-04T10:43:58.021096+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.031512+0000","last_change":"2023-12-04T10:43:52.251368+0000","last_active":"2023-12-04T10:43:58.031512+0000","last_peered":"2023-12-04T10:43:58.031512+0000","last_clean":"2023-12-04T10:43:58.031512+0000","last_became_active":"2023-12-04T10:43:52.248421+0000","last_became_peered":"2023-12-04T10:43:52.248421+0000","last_unstale":"2023-12-04T10:43:58.031512+0000","last_undegraded":"2023-12-04T10:43:58.031512+0000","last_fullsized":"2023-12-04T10:43:58.031512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:01:30.452121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704063+0000","last_change":"2023-12-04T10:43:58.050763+0000","last_active":"2023-12-04T10:43:58.704063+0000","last_peered":"2023-12-04T10:43:58.704063+0000","last_clean":"2023-12-04T10:43:58.704063+0000","last_became_active":"2023-12-04T10:43:58.050229+0000","last_became_peered":"2023-12-04T10:43:58.050229+0000","last_unstale":"2023-12-04T10:43:58.704063+0000","last_undegraded":"2023-12-04T10:43:58.704063+0000","last_fullsized":"2023-12-04T10:43:58.704063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:49:06.824707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021858+0000","last_change":"2023-12-04T10:43:52.980604+0000","last_active":"2023-12-04T10:43:58.021858+0000","last_peered":"2023-12-04T10:43:58.021858+0000","last_clean":"2023-12-04T10:43:58.021858+0000","last_became_active":"2023-12-04T10:43:52.980217+0000","last_became_peered":"2023-12-04T10:43:52.980217+0000","last_unstale":"2023-12-04T10:43:58.021858+0000","last_undegraded":"2023-12-04T10:43:58.021858+0000","last_fullsized":"2023-12-04T10:43:58.021858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030984+0000","last_change":"2023-12-04T10:43:52.261622+0000","last_active":"2023-12-04T10:43:58.030984+0000","last_peered":"2023-12-04T10:43:58.030984+0000","last_clean":"2023-12-04T10:43:58.030984+0000","last_became_active":"2023-12-04T10:43:52.261298+0000","last_became_peered":"2023-12-04T10:43:52.261298+0000","last_unstale":"2023-12-04T10:43:58.030984+0000","last_undegraded":"2023-12-04T10:43:58.030984+0000","last_fullsized":"2023-12-04T10:43:58.030984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:47.544355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.000863+0000","last_change":"2023-12-04T10:43:58.226091+0000","last_active":"2023-12-04T10:43:59.000863+0000","last_peered":"2023-12-04T10:43:59.000863+0000","last_clean":"2023-12-04T10:43:59.000863+0000","last_became_active":"2023-12-04T10:43:58.225330+0000","last_became_peered":"2023-12-04T10:43:58.225330+0000","last_unstale":"2023-12-04T10:43:59.000863+0000","last_undegraded":"2023-12-04T10:43:59.000863+0000","last_fullsized":"2023-12-04T10:43:59.000863+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:55:33.240134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030673+0000","last_change":"2023-12-04T10:43:52.982076+0000","last_active":"2023-12-04T10:43:58.030673+0000","last_peered":"2023-12-04T10:43:58.030673+0000","last_clean":"2023-12-04T10:43:58.030673+0000","last_became_active":"2023-12-04T10:43:52.972016+0000","last_became_peered":"2023-12-04T10:43:52.972016+0000","last_unstale":"2023-12-04T10:43:58.030673+0000","last_undegraded":"2023-12-04T10:43:58.030673+0000","last_fullsized":"2023-12-04T10:43:58.030673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:46:15.950875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.214559+0000","last_change":"2023-12-04T10:43:52.266409+0000","last_active":"2023-12-04T10:43:58.214559+0000","last_peered":"2023-12-04T10:43:58.214559+0000","last_clean":"2023-12-04T10:43:58.214559+0000","last_became_active":"2023-12-04T10:43:52.265294+0000","last_became_peered":"2023-12-04T10:43:52.265294+0000","last_unstale":"2023-12-04T10:43:58.214559+0000","last_undegraded":"2023-12-04T10:43:58.214559+0000","last_fullsized":"2023-12-04T10:43:58.214559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:30:30.992569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704052+0000","last_change":"2023-12-04T10:43:58.054026+0000","last_active":"2023-12-04T10:43:58.704052+0000","last_peered":"2023-12-04T10:43:58.704052+0000","last_clean":"2023-12-04T10:43:58.704052+0000","last_became_active":"2023-12-04T10:43:58.053503+0000","last_became_peered":"2023-12-04T10:43:58.053503+0000","last_unstale":"2023-12-04T10:43:58.704052+0000","last_undegraded":"2023-12-04T10:43:58.704052+0000","last_fullsized":"2023-12-04T10:43:58.704052+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:16:07.199657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039992+0000","last_change":"2023-12-04T10:43:52.985148+0000","last_active":"2023-12-04T10:43:58.039992+0000","last_peered":"2023-12-04T10:43:58.039992+0000","last_clean":"2023-12-04T10:43:58.039992+0000","last_became_active":"2023-12-04T10:43:52.984813+0000","last_became_peered":"2023-12-04T10:43:52.984813+0000","last_unstale":"2023-12-04T10:43:58.039992+0000","last_undegraded":"2023-12-04T10:43:58.039992+0000","last_fullsized":"2023-12-04T10:43:58.039992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049600+0000","last_change":"2023-12-04T10:43:52.270015+0000","last_active":"2023-12-04T10:43:58.049600+0000","last_peered":"2023-12-04T10:43:58.049600+0000","last_clean":"2023-12-04T10:43:58.049600+0000","last_became_active":"2023-12-04T10:43:52.269682+0000","last_became_peered":"2023-12-04T10:43:52.269682+0000","last_unstale":"2023-12-04T10:43:58.049600+0000","last_undegraded":"2023-12-04T10:43:58.049600+0000","last_fullsized":"2023-12-04T10:43:58.049600+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703352+0000","last_change":"2023-12-04T10:43:58.223739+0000","last_active":"2023-12-04T10:43:58.703352+0000","last_peered":"2023-12-04T10:43:58.703352+0000","last_clean":"2023-12-04T10:43:58.703352+0000","last_became_active":"2023-12-04T10:43:58.223091+0000","last_became_peered":"2023-12-04T10:43:58.223091+0000","last_unstale":"2023-12-04T10:43:58.703352+0000","last_undegraded":"2023-12-04T10:43:58.703352+0000","last_fullsized":"2023-12-04T10:43:58.703352+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:20:24.266893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.023237+0000","last_change":"2023-12-04T10:43:52.980989+0000","last_active":"2023-12-04T10:43:58.023237+0000","last_peered":"2023-12-04T10:43:58.023237+0000","last_clean":"2023-12-04T10:43:58.023237+0000","last_became_active":"2023-12-04T10:43:52.980436+0000","last_became_peered":"2023-12-04T10:43:52.980436+0000","last_unstale":"2023-12-04T10:43:58.023237+0000","last_undegraded":"2023-12-04T10:43:58.023237+0000","last_fullsized":"2023-12-04T10:43:58.023237+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030910+0000","last_change":"2023-12-04T10:43:52.258606+0000","last_active":"2023-12-04T10:43:58.030910+0000","last_peered":"2023-12-04T10:43:58.030910+0000","last_clean":"2023-12-04T10:43:58.030910+0000","last_became_active":"2023-12-04T10:43:52.258209+0000","last_became_peered":"2023-12-04T10:43:52.258209+0000","last_unstale":"2023-12-04T10:43:58.030910+0000","last_undegraded":"2023-12-04T10:43:58.030910+0000","last_fullsized":"2023-12-04T10:43:58.030910+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:15:20.465351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702285+0000","last_change":"2023-12-04T10:43:58.215546+0000","last_active":"2023-12-04T10:43:58.702285+0000","last_peered":"2023-12-04T10:43:58.702285+0000","last_clean":"2023-12-04T10:43:58.702285+0000","last_became_active":"2023-12-04T10:43:58.214293+0000","last_became_peered":"2023-12-04T10:43:58.214293+0000","last_unstale":"2023-12-04T10:43:58.702285+0000","last_undegraded":"2023-12-04T10:43:58.702285+0000","last_fullsized":"2023-12-04T10:43:58.702285+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:57:02.248236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034123+0000","last_change":"2023-12-04T10:43:52.973852+0000","last_active":"2023-12-04T10:43:58.034123+0000","last_peered":"2023-12-04T10:43:58.034123+0000","last_clean":"2023-12-04T10:43:58.034123+0000","last_became_active":"2023-12-04T10:43:52.972253+0000","last_became_peered":"2023-12-04T10:43:52.972253+0000","last_unstale":"2023-12-04T10:43:58.034123+0000","last_undegraded":"2023-12-04T10:43:58.034123+0000","last_fullsized":"2023-12-04T10:43:58.034123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:20:19.481533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.220155+0000","last_change":"2023-12-04T10:43:52.261351+0000","last_active":"2023-12-04T10:43:58.220155+0000","last_peered":"2023-12-04T10:43:58.220155+0000","last_clean":"2023-12-04T10:43:58.220155+0000","last_became_active":"2023-12-04T10:43:52.261052+0000","last_became_peered":"2023-12-04T10:43:52.261052+0000","last_unstale":"2023-12-04T10:43:58.220155+0000","last_undegraded":"2023-12-04T10:43:58.220155+0000","last_fullsized":"2023-12-04T10:43:58.220155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:03.065751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995773+0000","last_change":"2023-12-04T10:43:58.215971+0000","last_active":"2023-12-04T10:43:58.995773+0000","last_peered":"2023-12-04T10:43:58.995773+0000","last_clean":"2023-12-04T10:43:58.995773+0000","last_became_active":"2023-12-04T10:43:58.214859+0000","last_became_peered":"2023-12-04T10:43:58.214859+0000","last_unstale":"2023-12-04T10:43:58.995773+0000","last_undegraded":"2023-12-04T10:43:58.995773+0000","last_fullsized":"2023-12-04T10:43:58.995773+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:32:49.715432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040441+0000","last_change":"2023-12-04T10:43:52.994569+0000","last_active":"2023-12-04T10:43:58.040441+0000","last_peered":"2023-12-04T10:43:58.040441+0000","last_clean":"2023-12-04T10:43:58.040441+0000","last_became_active":"2023-12-04T10:43:52.994301+0000","last_became_peered":"2023-12-04T10:43:52.994301+0000","last_unstale":"2023-12-04T10:43:58.040441+0000","last_undegraded":"2023-12-04T10:43:58.040441+0000","last_fullsized":"2023-12-04T10:43:58.040441+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:21.236244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034230+0000","last_change":"2023-12-04T10:43:52.249758+0000","last_active":"2023-12-04T10:43:58.034230+0000","last_peered":"2023-12-04T10:43:58.034230+0000","last_clean":"2023-12-04T10:43:58.034230+0000","last_became_active":"2023-12-04T10:43:52.248998+0000","last_became_peered":"2023-12-04T10:43:52.248998+0000","last_unstale":"2023-12-04T10:43:58.034230+0000","last_undegraded":"2023-12-04T10:43:58.034230+0000","last_fullsized":"2023-12-04T10:43:58.034230+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:18:12.560014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.998783+0000","last_change":"2023-12-04T10:43:58.049867+0000","last_active":"2023-12-04T10:43:58.998783+0000","last_peered":"2023-12-04T10:43:58.998783+0000","last_clean":"2023-12-04T10:43:58.998783+0000","last_became_active":"2023-12-04T10:43:58.049454+0000","last_became_peered":"2023-12-04T10:43:58.049454+0000","last_unstale":"2023-12-04T10:43:58.998783+0000","last_undegraded":"2023-12-04T10:43:58.998783+0000","last_fullsized":"2023-12-04T10:43:58.998783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:14:13.371816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037424+0000","last_change":"2023-12-04T10:43:52.980950+0000","last_active":"2023-12-04T10:43:58.037424+0000","last_peered":"2023-12-04T10:43:58.037424+0000","last_clean":"2023-12-04T10:43:58.037424+0000","last_became_active":"2023-12-04T10:43:52.980633+0000","last_became_peered":"2023-12-04T10:43:52.980633+0000","last_unstale":"2023-12-04T10:43:58.037424+0000","last_undegraded":"2023-12-04T10:43:58.037424+0000","last_fullsized":"2023-12-04T10:43:58.037424+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:24:23.025254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.035013+0000","last_change":"2023-12-04T10:43:52.259456+0000","last_active":"2023-12-04T10:43:58.035013+0000","last_peered":"2023-12-04T10:43:58.035013+0000","last_clean":"2023-12-04T10:43:58.035013+0000","last_became_active":"2023-12-04T10:43:52.254414+0000","last_became_peered":"2023-12-04T10:43:52.254414+0000","last_unstale":"2023-12-04T10:43:58.035013+0000","last_undegraded":"2023-12-04T10:43:58.035013+0000","last_fullsized":"2023-12-04T10:43:58.035013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:03.065751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.000962+0000","last_change":"2023-12-04T10:43:58.053734+0000","last_active":"2023-12-04T10:43:59.000962+0000","last_peered":"2023-12-04T10:43:59.000962+0000","last_clean":"2023-12-04T10:43:59.000962+0000","last_became_active":"2023-12-04T10:43:58.053373+0000","last_became_peered":"2023-12-04T10:43:58.053373+0000","last_unstale":"2023-12-04T10:43:59.000962+0000","last_undegraded":"2023-12-04T10:43:59.000962+0000","last_fullsized":"2023-12-04T10:43:59.000962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:22:58.696286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030598+0000","last_change":"2023-12-04T10:43:52.974356+0000","last_active":"2023-12-04T10:43:58.030598+0000","last_peered":"2023-12-04T10:43:58.030598+0000","last_clean":"2023-12-04T10:43:58.030598+0000","last_became_active":"2023-12-04T10:43:52.974025+0000","last_became_peered":"2023-12-04T10:43:52.974025+0000","last_unstale":"2023-12-04T10:43:58.030598+0000","last_undegraded":"2023-12-04T10:43:58.030598+0000","last_fullsized":"2023-12-04T10:43:58.030598+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:02:21.706862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.044424+0000","last_change":"2023-12-04T10:43:52.251063+0000","last_active":"2023-12-04T10:43:58.044424+0000","last_peered":"2023-12-04T10:43:58.044424+0000","last_clean":"2023-12-04T10:43:58.044424+0000","last_became_active":"2023-12-04T10:43:52.250274+0000","last_became_peered":"2023-12-04T10:43:52.250274+0000","last_unstale":"2023-12-04T10:43:58.044424+0000","last_undegraded":"2023-12-04T10:43:58.044424+0000","last_fullsized":"2023-12-04T10:43:58.044424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:20.848140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:59.001269+0000","last_change":"2023-12-04T10:43:58.046943+0000","last_active":"2023-12-04T10:43:59.001269+0000","last_peered":"2023-12-04T10:43:59.001269+0000","last_clean":"2023-12-04T10:43:59.001269+0000","last_became_active":"2023-12-04T10:43:58.046583+0000","last_became_peered":"2023-12-04T10:43:58.046583+0000","last_unstale":"2023-12-04T10:43:59.001269+0000","last_undegraded":"2023-12-04T10:43:59.001269+0000","last_fullsized":"2023-12-04T10:43:59.001269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:18:58.227614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.032594+0000","last_change":"2023-12-04T10:43:52.973314+0000","last_active":"2023-12-04T10:43:58.032594+0000","last_peered":"2023-12-04T10:43:58.032594+0000","last_clean":"2023-12-04T10:43:58.032594+0000","last_became_active":"2023-12-04T10:43:52.973027+0000","last_became_peered":"2023-12-04T10:43:52.973027+0000","last_unstale":"2023-12-04T10:43:58.032594+0000","last_undegraded":"2023-12-04T10:43:58.032594+0000","last_fullsized":"2023-12-04T10:43:58.032594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216818+0000","last_change":"2023-12-04T10:43:52.264881+0000","last_active":"2023-12-04T10:43:58.216818+0000","last_peered":"2023-12-04T10:43:58.216818+0000","last_clean":"2023-12-04T10:43:58.216818+0000","last_became_active":"2023-12-04T10:43:52.262303+0000","last_became_peered":"2023-12-04T10:43:52.262303+0000","last_unstale":"2023-12-04T10:43:58.216818+0000","last_undegraded":"2023-12-04T10:43:58.216818+0000","last_fullsized":"2023-12-04T10:43:58.216818+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995766+0000","last_change":"2023-12-04T10:43:58.235583+0000","last_active":"2023-12-04T10:43:58.995766+0000","last_peered":"2023-12-04T10:43:58.995766+0000","last_clean":"2023-12-04T10:43:58.995766+0000","last_became_active":"2023-12-04T10:43:58.231876+0000","last_became_peered":"2023-12-04T10:43:58.231876+0000","last_unstale":"2023-12-04T10:43:58.995766+0000","last_undegraded":"2023-12-04T10:43:58.995766+0000","last_fullsized":"2023-12-04T10:43:58.995766+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:59.475236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020643+0000","last_change":"2023-12-04T10:43:52.988166+0000","last_active":"2023-12-04T10:43:58.020643+0000","last_peered":"2023-12-04T10:43:58.020643+0000","last_clean":"2023-12-04T10:43:58.020643+0000","last_became_active":"2023-12-04T10:43:52.987801+0000","last_became_peered":"2023-12-04T10:43:52.987801+0000","last_unstale":"2023-12-04T10:43:58.020643+0000","last_undegraded":"2023-12-04T10:43:58.020643+0000","last_fullsized":"2023-12-04T10:43:58.020643+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041216+0000","last_change":"2023-12-04T10:43:52.261710+0000","last_active":"2023-12-04T10:43:58.041216+0000","last_peered":"2023-12-04T10:43:58.041216+0000","last_clean":"2023-12-04T10:43:58.041216+0000","last_became_active":"2023-12-04T10:43:52.253457+0000","last_became_peered":"2023-12-04T10:43:52.253457+0000","last_unstale":"2023-12-04T10:43:58.041216+0000","last_undegraded":"2023-12-04T10:43:58.041216+0000","last_fullsized":"2023-12-04T10:43:58.041216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:24.986256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":170,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.215951+0000","last_change":"2023-12-04T10:43:48.111279+0000","last_active":"2023-12-04T10:43:58.215951+0000","last_peered":"2023-12-04T10:43:58.215951+0000","last_clean":"2023-12-04T10:43:58.215951+0000","last_became_active":"2023-12-04T10:43:48.108038+0000","last_became_peered":"2023-12-04T10:43:48.108038+0000","last_unstale":"2023-12-04T10:43:58.215951+0000","last_undegraded":"2023-12-04T10:43:58.215951+0000","last_fullsized":"2023-12-04T10:43:58.215951+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_clean_scrub_stamp":"2023-12-04T10:43:46.528449+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:31:15.475210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.707014+0000","last_change":"2023-12-04T10:43:58.229941+0000","last_active":"2023-12-04T10:43:58.707014+0000","last_peered":"2023-12-04T10:43:58.707014+0000","last_clean":"2023-12-04T10:43:58.707014+0000","last_became_active":"2023-12-04T10:43:58.225120+0000","last_became_peered":"2023-12-04T10:43:58.225120+0000","last_unstale":"2023-12-04T10:43:58.707014+0000","last_undegraded":"2023-12-04T10:43:58.707014+0000","last_fullsized":"2023-12-04T10:43:58.707014+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:15.863508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219407+0000","last_change":"2023-12-04T10:43:52.982313+0000","last_active":"2023-12-04T10:43:58.219407+0000","last_peered":"2023-12-04T10:43:58.219407+0000","last_clean":"2023-12-04T10:43:58.219407+0000","last_became_active":"2023-12-04T10:43:52.979562+0000","last_became_peered":"2023-12-04T10:43:52.979562+0000","last_unstale":"2023-12-04T10:43:58.219407+0000","last_undegraded":"2023-12-04T10:43:58.219407+0000","last_fullsized":"2023-12-04T10:43:58.219407+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:46.964865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049829+0000","last_change":"2023-12-04T10:43:52.267801+0000","last_active":"2023-12-04T10:43:58.049829+0000","last_peered":"2023-12-04T10:43:58.049829+0000","last_clean":"2023-12-04T10:43:58.049829+0000","last_became_active":"2023-12-04T10:43:52.267514+0000","last_became_peered":"2023-12-04T10:43:52.267514+0000","last_unstale":"2023-12-04T10:43:58.049829+0000","last_undegraded":"2023-12-04T10:43:58.049829+0000","last_fullsized":"2023-12-04T10:43:58.049829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:46:14.667542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.705960+0000","last_change":"2023-12-04T10:43:58.218053+0000","last_active":"2023-12-04T10:43:58.705960+0000","last_peered":"2023-12-04T10:43:58.705960+0000","last_clean":"2023-12-04T10:43:58.705960+0000","last_became_active":"2023-12-04T10:43:58.216729+0000","last_became_peered":"2023-12-04T10:43:58.216729+0000","last_unstale":"2023-12-04T10:43:58.705960+0000","last_undegraded":"2023-12-04T10:43:58.705960+0000","last_fullsized":"2023-12-04T10:43:58.705960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:05.657652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040709+0000","last_change":"2023-12-04T10:43:52.993942+0000","last_active":"2023-12-04T10:43:58.040709+0000","last_peered":"2023-12-04T10:43:58.040709+0000","last_clean":"2023-12-04T10:43:58.040709+0000","last_became_active":"2023-12-04T10:43:52.993613+0000","last_became_peered":"2023-12-04T10:43:52.993613+0000","last_unstale":"2023-12-04T10:43:58.040709+0000","last_undegraded":"2023-12-04T10:43:58.040709+0000","last_fullsized":"2023-12-04T10:43:58.040709+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:11.078149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030147+0000","last_change":"2023-12-04T10:43:52.253522+0000","last_active":"2023-12-04T10:43:58.030147+0000","last_peered":"2023-12-04T10:43:58.030147+0000","last_clean":"2023-12-04T10:43:58.030147+0000","last_became_active":"2023-12-04T10:43:52.253254+0000","last_became_peered":"2023-12-04T10:43:52.253254+0000","last_unstale":"2023-12-04T10:43:58.030147+0000","last_undegraded":"2023-12-04T10:43:58.030147+0000","last_fullsized":"2023-12-04T10:43:58.030147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:59.001748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.996252+0000","last_change":"2023-12-04T10:43:58.049520+0000","last_active":"2023-12-04T10:43:58.996252+0000","last_peered":"2023-12-04T10:43:58.996252+0000","last_clean":"2023-12-04T10:43:58.996252+0000","last_became_active":"2023-12-04T10:43:58.049110+0000","last_became_peered":"2023-12-04T10:43:58.049110+0000","last_unstale":"2023-12-04T10:43:58.996252+0000","last_undegraded":"2023-12-04T10:43:58.996252+0000","last_fullsized":"2023-12-04T10:43:58.996252+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:29.332279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.221876+0000","last_change":"2023-12-04T10:43:52.992408+0000","last_active":"2023-12-04T10:43:58.221876+0000","last_peered":"2023-12-04T10:43:58.221876+0000","last_clean":"2023-12-04T10:43:58.221876+0000","last_became_active":"2023-12-04T10:43:52.992078+0000","last_became_peered":"2023-12-04T10:43:52.992078+0000","last_unstale":"2023-12-04T10:43:58.221876+0000","last_undegraded":"2023-12-04T10:43:58.221876+0000","last_fullsized":"2023-12-04T10:43:58.221876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:44:24.546919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.046433+0000","last_change":"2023-12-04T10:43:52.251057+0000","last_active":"2023-12-04T10:43:58.046433+0000","last_peered":"2023-12-04T10:43:58.046433+0000","last_clean":"2023-12-04T10:43:58.046433+0000","last_became_active":"2023-12-04T10:43:52.250572+0000","last_became_peered":"2023-12-04T10:43:52.250572+0000","last_unstale":"2023-12-04T10:43:58.046433+0000","last_undegraded":"2023-12-04T10:43:58.046433+0000","last_fullsized":"2023-12-04T10:43:58.046433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:24:21.741921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.996401+0000","last_change":"2023-12-04T10:43:58.228293+0000","last_active":"2023-12-04T10:43:58.996401+0000","last_peered":"2023-12-04T10:43:58.996401+0000","last_clean":"2023-12-04T10:43:58.996401+0000","last_became_active":"2023-12-04T10:43:58.227230+0000","last_became_peered":"2023-12-04T10:43:58.227230+0000","last_unstale":"2023-12-04T10:43:58.996401+0000","last_undegraded":"2023-12-04T10:43:58.996401+0000","last_fullsized":"2023-12-04T10:43:58.996401+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:45:11.650821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219484+0000","last_change":"2023-12-04T10:43:52.986513+0000","last_active":"2023-12-04T10:43:58.219484+0000","last_peered":"2023-12-04T10:43:58.219484+0000","last_clean":"2023-12-04T10:43:58.219484+0000","last_became_active":"2023-12-04T10:43:52.985480+0000","last_became_peered":"2023-12-04T10:43:52.985480+0000","last_unstale":"2023-12-04T10:43:58.219484+0000","last_undegraded":"2023-12-04T10:43:58.219484+0000","last_fullsized":"2023-12-04T10:43:58.219484+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:54.689876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033674+0000","last_change":"2023-12-04T10:43:52.248849+0000","last_active":"2023-12-04T10:43:58.033674+0000","last_peered":"2023-12-04T10:43:58.033674+0000","last_clean":"2023-12-04T10:43:58.033674+0000","last_became_active":"2023-12-04T10:43:52.248072+0000","last_became_peered":"2023-12-04T10:43:52.248072+0000","last_unstale":"2023-12-04T10:43:58.033674+0000","last_undegraded":"2023-12-04T10:43:58.033674+0000","last_fullsized":"2023-12-04T10:43:58.033674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:55:50.076235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704337+0000","last_change":"2023-12-04T10:43:58.054851+0000","last_active":"2023-12-04T10:43:58.704337+0000","last_peered":"2023-12-04T10:43:58.704337+0000","last_clean":"2023-12-04T10:43:58.704337+0000","last_became_active":"2023-12-04T10:43:58.053543+0000","last_became_peered":"2023-12-04T10:43:58.053543+0000","last_unstale":"2023-12-04T10:43:58.704337+0000","last_undegraded":"2023-12-04T10:43:58.704337+0000","last_fullsized":"2023-12-04T10:43:58.704337+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:51:36.088926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.217048+0000","last_change":"2023-12-04T10:43:52.988930+0000","last_active":"2023-12-04T10:43:58.217048+0000","last_peered":"2023-12-04T10:43:58.217048+0000","last_clean":"2023-12-04T10:43:58.217048+0000","last_became_active":"2023-12-04T10:43:52.988638+0000","last_became_peered":"2023-12-04T10:43:52.988638+0000","last_unstale":"2023-12-04T10:43:58.217048+0000","last_undegraded":"2023-12-04T10:43:58.217048+0000","last_fullsized":"2023-12-04T10:43:58.217048+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041474+0000","last_change":"2023-12-04T10:43:52.245850+0000","last_active":"2023-12-04T10:43:58.041474+0000","last_peered":"2023-12-04T10:43:58.041474+0000","last_clean":"2023-12-04T10:43:58.041474+0000","last_became_active":"2023-12-04T10:43:52.245241+0000","last_became_peered":"2023-12-04T10:43:52.245241+0000","last_unstale":"2023-12-04T10:43:58.041474+0000","last_undegraded":"2023-12-04T10:43:58.041474+0000","last_fullsized":"2023-12-04T10:43:58.041474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:01:30.452121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995405+0000","last_change":"2023-12-04T10:43:58.057996+0000","last_active":"2023-12-04T10:43:58.995405+0000","last_peered":"2023-12-04T10:43:58.995405+0000","last_clean":"2023-12-04T10:43:58.995405+0000","last_became_active":"2023-12-04T10:43:58.052353+0000","last_became_peered":"2023-12-04T10:43:58.052353+0000","last_unstale":"2023-12-04T10:43:58.995405+0000","last_undegraded":"2023-12-04T10:43:58.995405+0000","last_fullsized":"2023-12-04T10:43:58.995405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:44.810269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048575+0000","last_change":"2023-12-04T10:43:52.986974+0000","last_active":"2023-12-04T10:43:58.048575+0000","last_peered":"2023-12-04T10:43:58.048575+0000","last_clean":"2023-12-04T10:43:58.048575+0000","last_became_active":"2023-12-04T10:43:52.986644+0000","last_became_peered":"2023-12-04T10:43:52.986644+0000","last_unstale":"2023-12-04T10:43:58.048575+0000","last_undegraded":"2023-12-04T10:43:58.048575+0000","last_fullsized":"2023-12-04T10:43:58.048575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048730+0000","last_change":"2023-12-04T10:43:52.262403+0000","last_active":"2023-12-04T10:43:58.048730+0000","last_peered":"2023-12-04T10:43:58.048730+0000","last_clean":"2023-12-04T10:43:58.048730+0000","last_became_active":"2023-12-04T10:43:52.261992+0000","last_became_peered":"2023-12-04T10:43:52.261992+0000","last_unstale":"2023-12-04T10:43:58.048730+0000","last_undegraded":"2023-12-04T10:43:58.048730+0000","last_fullsized":"2023-12-04T10:43:58.048730+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:53:18.654556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704536+0000","last_change":"2023-12-04T10:43:58.227429+0000","last_active":"2023-12-04T10:43:58.704536+0000","last_peered":"2023-12-04T10:43:58.704536+0000","last_clean":"2023-12-04T10:43:58.704536+0000","last_became_active":"2023-12-04T10:43:58.226172+0000","last_became_peered":"2023-12-04T10:43:58.226172+0000","last_unstale":"2023-12-04T10:43:58.704536+0000","last_undegraded":"2023-12-04T10:43:58.704536+0000","last_fullsized":"2023-12-04T10:43:58.704536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:24:19.677824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216035+0000","last_change":"2023-12-04T10:43:52.991297+0000","last_active":"2023-12-04T10:43:58.216035+0000","last_peered":"2023-12-04T10:43:58.216035+0000","last_clean":"2023-12-04T10:43:58.216035+0000","last_became_active":"2023-12-04T10:43:52.990881+0000","last_became_peered":"2023-12-04T10:43:52.990881+0000","last_unstale":"2023-12-04T10:43:58.216035+0000","last_undegraded":"2023-12-04T10:43:58.216035+0000","last_fullsized":"2023-12-04T10:43:58.216035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:38:11.078149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034868+0000","last_change":"2023-12-04T10:43:52.262989+0000","last_active":"2023-12-04T10:43:58.034868+0000","last_peered":"2023-12-04T10:43:58.034868+0000","last_clean":"2023-12-04T10:43:58.034868+0000","last_became_active":"2023-12-04T10:43:52.262666+0000","last_became_peered":"2023-12-04T10:43:52.262666+0000","last_unstale":"2023-12-04T10:43:58.034868+0000","last_undegraded":"2023-12-04T10:43:58.034868+0000","last_fullsized":"2023-12-04T10:43:58.034868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:25.093855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703956+0000","last_change":"2023-12-04T10:43:58.215319+0000","last_active":"2023-12-04T10:43:58.703956+0000","last_peered":"2023-12-04T10:43:58.703956+0000","last_clean":"2023-12-04T10:43:58.703956+0000","last_became_active":"2023-12-04T10:43:58.214315+0000","last_became_peered":"2023-12-04T10:43:58.214315+0000","last_unstale":"2023-12-04T10:43:58.703956+0000","last_undegraded":"2023-12-04T10:43:58.703956+0000","last_fullsized":"2023-12-04T10:43:58.703956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:20:30.277031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033921+0000","last_change":"2023-12-04T10:43:52.977398+0000","last_active":"2023-12-04T10:43:58.033921+0000","last_peered":"2023-12-04T10:43:58.033921+0000","last_clean":"2023-12-04T10:43:58.033921+0000","last_became_active":"2023-12-04T10:43:52.977024+0000","last_became_peered":"2023-12-04T10:43:52.977024+0000","last_unstale":"2023-12-04T10:43:58.033921+0000","last_undegraded":"2023-12-04T10:43:58.033921+0000","last_fullsized":"2023-12-04T10:43:58.033921+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":19,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039616+0000","last_change":"2023-12-04T10:43:52.255501+0000","last_active":"2023-12-04T10:43:58.039616+0000","last_peered":"2023-12-04T10:43:58.039616+0000","last_clean":"2023-12-04T10:43:58.039616+0000","last_became_active":"2023-12-04T10:43:52.255013+0000","last_became_peered":"2023-12-04T10:43:52.255013+0000","last_unstale":"2023-12-04T10:43:58.039616+0000","last_undegraded":"2023-12-04T10:43:58.039616+0000","last_fullsized":"2023-12-04T10:43:58.039616+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.999729+0000","last_change":"2023-12-04T10:43:58.216747+0000","last_active":"2023-12-04T10:43:58.999729+0000","last_peered":"2023-12-04T10:43:58.999729+0000","last_clean":"2023-12-04T10:43:58.999729+0000","last_became_active":"2023-12-04T10:43:58.215380+0000","last_became_peered":"2023-12-04T10:43:58.215380+0000","last_unstale":"2023-12-04T10:43:58.999729+0000","last_undegraded":"2023-12-04T10:43:58.999729+0000","last_fullsized":"2023-12-04T10:43:58.999729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:06:26.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219253+0000","last_change":"2023-12-04T10:43:52.986160+0000","last_active":"2023-12-04T10:43:58.219253+0000","last_peered":"2023-12-04T10:43:58.219253+0000","last_clean":"2023-12-04T10:43:58.219253+0000","last_became_active":"2023-12-04T10:43:52.985651+0000","last_became_peered":"2023-12-04T10:43:52.985651+0000","last_unstale":"2023-12-04T10:43:58.219253+0000","last_undegraded":"2023-12-04T10:43:58.219253+0000","last_fullsized":"2023-12-04T10:43:58.219253+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:21.236244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'10","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:44:13.361227+0000","last_change":"2023-12-04T10:43:52.259456+0000","last_active":"2023-12-04T10:44:13.361227+0000","last_peered":"2023-12-04T10:44:13.361227+0000","last_clean":"2023-12-04T10:44:13.361227+0000","last_became_active":"2023-12-04T10:43:52.259142+0000","last_became_peered":"2023-12-04T10:43:52.259142+0000","last_unstale":"2023-12-04T10:44:13.361227+0000","last_undegraded":"2023-12-04T10:44:13.361227+0000","last_fullsized":"2023-12-04T10:44:13.361227+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:14:32.386612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3841,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.999714+0000","last_change":"2023-12-04T10:43:58.055299+0000","last_active":"2023-12-04T10:43:58.999714+0000","last_peered":"2023-12-04T10:43:58.999714+0000","last_clean":"2023-12-04T10:43:58.999714+0000","last_became_active":"2023-12-04T10:43:58.054806+0000","last_became_peered":"2023-12-04T10:43:58.054806+0000","last_unstale":"2023-12-04T10:43:58.999714+0000","last_undegraded":"2023-12-04T10:43:58.999714+0000","last_fullsized":"2023-12-04T10:43:58.999714+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:15:21.428416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.038505+0000","last_change":"2023-12-04T10:43:52.980883+0000","last_active":"2023-12-04T10:43:58.038505+0000","last_peered":"2023-12-04T10:43:58.038505+0000","last_clean":"2023-12-04T10:43:58.038505+0000","last_became_active":"2023-12-04T10:43:52.980510+0000","last_became_peered":"2023-12-04T10:43:52.980510+0000","last_unstale":"2023-12-04T10:43:58.038505+0000","last_undegraded":"2023-12-04T10:43:58.038505+0000","last_fullsized":"2023-12-04T10:43:58.038505+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:48.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":20,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030038+0000","last_change":"2023-12-04T10:43:52.256393+0000","last_active":"2023-12-04T10:43:58.030038+0000","last_peered":"2023-12-04T10:43:58.030038+0000","last_clean":"2023-12-04T10:43:58.030038+0000","last_became_active":"2023-12-04T10:43:52.256172+0000","last_became_peered":"2023-12-04T10:43:52.256172+0000","last_unstale":"2023-12-04T10:43:58.030038+0000","last_undegraded":"2023-12-04T10:43:58.030038+0000","last_fullsized":"2023-12-04T10:43:58.030038+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:50:43.248614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.704573+0000","last_change":"2023-12-04T10:43:58.053865+0000","last_active":"2023-12-04T10:43:58.704573+0000","last_peered":"2023-12-04T10:43:58.704573+0000","last_clean":"2023-12-04T10:43:58.704573+0000","last_became_active":"2023-12-04T10:43:58.053350+0000","last_became_peered":"2023-12-04T10:43:58.053350+0000","last_unstale":"2023-12-04T10:43:58.704573+0000","last_undegraded":"2023-12-04T10:43:58.704573+0000","last_fullsized":"2023-12-04T10:43:58.704573+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:53:18.451370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.039041+0000","last_change":"2023-12-04T10:43:52.979625+0000","last_active":"2023-12-04T10:43:58.039041+0000","last_peered":"2023-12-04T10:43:58.039041+0000","last_clean":"2023-12-04T10:43:58.039041+0000","last_became_active":"2023-12-04T10:43:52.979301+0000","last_became_peered":"2023-12-04T10:43:52.979301+0000","last_unstale":"2023-12-04T10:43:58.039041+0000","last_undegraded":"2023-12-04T10:43:58.039041+0000","last_fullsized":"2023-12-04T10:43:58.039041+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040479+0000","last_change":"2023-12-04T10:43:52.256384+0000","last_active":"2023-12-04T10:43:58.040479+0000","last_peered":"2023-12-04T10:43:58.040479+0000","last_clean":"2023-12-04T10:43:58.040479+0000","last_became_active":"2023-12-04T10:43:52.255923+0000","last_became_peered":"2023-12-04T10:43:52.255923+0000","last_unstale":"2023-12-04T10:43:58.040479+0000","last_undegraded":"2023-12-04T10:43:58.040479+0000","last_fullsized":"2023-12-04T10:43:58.040479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:25.210732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702798+0000","last_change":"2023-12-04T10:43:58.052271+0000","last_active":"2023-12-04T10:43:58.702798+0000","last_peered":"2023-12-04T10:43:58.702798+0000","last_clean":"2023-12-04T10:43:58.702798+0000","last_became_active":"2023-12-04T10:43:58.051959+0000","last_became_peered":"2023-12-04T10:43:58.051959+0000","last_unstale":"2023-12-04T10:43:58.702798+0000","last_undegraded":"2023-12-04T10:43:58.702798+0000","last_fullsized":"2023-12-04T10:43:58.702798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:06:26.618031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040336+0000","last_change":"2023-12-04T10:43:52.982397+0000","last_active":"2023-12-04T10:43:58.040336+0000","last_peered":"2023-12-04T10:43:58.040336+0000","last_clean":"2023-12-04T10:43:58.040336+0000","last_became_active":"2023-12-04T10:43:52.979862+0000","last_became_peered":"2023-12-04T10:43:52.979862+0000","last_unstale":"2023-12-04T10:43:58.040336+0000","last_undegraded":"2023-12-04T10:43:58.040336+0000","last_fullsized":"2023-12-04T10:43:58.040336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:40.024910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049485+0000","last_change":"2023-12-04T10:43:52.267763+0000","last_active":"2023-12-04T10:43:58.049485+0000","last_peered":"2023-12-04T10:43:58.049485+0000","last_clean":"2023-12-04T10:43:58.049485+0000","last_became_active":"2023-12-04T10:43:52.267415+0000","last_became_peered":"2023-12-04T10:43:52.267415+0000","last_unstale":"2023-12-04T10:43:58.049485+0000","last_undegraded":"2023-12-04T10:43:58.049485+0000","last_fullsized":"2023-12-04T10:43:58.049485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:15:16.693367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.702869+0000","last_change":"2023-12-04T10:43:58.225596+0000","last_active":"2023-12-04T10:43:58.702869+0000","last_peered":"2023-12-04T10:43:58.702869+0000","last_clean":"2023-12-04T10:43:58.702869+0000","last_became_active":"2023-12-04T10:43:58.225115+0000","last_became_peered":"2023-12-04T10:43:58.225115+0000","last_unstale":"2023-12-04T10:43:58.702869+0000","last_undegraded":"2023-12-04T10:43:58.702869+0000","last_fullsized":"2023-12-04T10:43:58.702869+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:52:53.914156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.995318+0000","last_change":"2023-12-04T10:43:58.235031+0000","last_active":"2023-12-04T10:43:58.995318+0000","last_peered":"2023-12-04T10:43:58.995318+0000","last_clean":"2023-12-04T10:43:58.995318+0000","last_became_active":"2023-12-04T10:43:58.231370+0000","last_became_peered":"2023-12-04T10:43:58.231370+0000","last_unstale":"2023-12-04T10:43:58.995318+0000","last_undegraded":"2023-12-04T10:43:58.995318+0000","last_fullsized":"2023-12-04T10:43:58.995318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:49:51.750224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030753+0000","last_change":"2023-12-04T10:43:52.970184+0000","last_active":"2023-12-04T10:43:58.030753+0000","last_peered":"2023-12-04T10:43:58.030753+0000","last_clean":"2023-12-04T10:43:58.030753+0000","last_became_active":"2023-12-04T10:43:52.967857+0000","last_became_peered":"2023-12-04T10:43:52.967857+0000","last_unstale":"2023-12-04T10:43:58.030753+0000","last_undegraded":"2023-12-04T10:43:58.030753+0000","last_fullsized":"2023-12-04T10:43:58.030753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:17:13.264517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033298+0000","last_change":"2023-12-04T10:43:52.257154+0000","last_active":"2023-12-04T10:43:58.033298+0000","last_peered":"2023-12-04T10:43:58.033298+0000","last_clean":"2023-12-04T10:43:58.033298+0000","last_became_active":"2023-12-04T10:43:52.256821+0000","last_became_peered":"2023-12-04T10:43:52.256821+0000","last_unstale":"2023-12-04T10:43:58.033298+0000","last_undegraded":"2023-12-04T10:43:58.033298+0000","last_fullsized":"2023-12-04T10:43:58.033298+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:20:37.280361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.707431+0000","last_change":"2023-12-04T10:43:58.063557+0000","last_active":"2023-12-04T10:43:58.707431+0000","last_peered":"2023-12-04T10:43:58.707431+0000","last_clean":"2023-12-04T10:43:58.707431+0000","last_became_active":"2023-12-04T10:43:58.062970+0000","last_became_peered":"2023-12-04T10:43:58.062970+0000","last_unstale":"2023-12-04T10:43:58.707431+0000","last_undegraded":"2023-12-04T10:43:58.707431+0000","last_fullsized":"2023-12-04T10:43:58.707431+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:40:26.021604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021732+0000","last_change":"2023-12-04T10:43:52.984856+0000","last_active":"2023-12-04T10:43:58.021732+0000","last_peered":"2023-12-04T10:43:58.021732+0000","last_clean":"2023-12-04T10:43:58.021732+0000","last_became_active":"2023-12-04T10:43:52.983649+0000","last_became_peered":"2023-12-04T10:43:52.983649+0000","last_unstale":"2023-12-04T10:43:58.021732+0000","last_undegraded":"2023-12-04T10:43:58.021732+0000","last_fullsized":"2023-12-04T10:43:58.021732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022422+0000","last_change":"2023-12-04T10:43:52.251972+0000","last_active":"2023-12-04T10:43:58.022422+0000","last_peered":"2023-12-04T10:43:58.022422+0000","last_clean":"2023-12-04T10:43:58.022422+0000","last_became_active":"2023-12-04T10:43:52.251253+0000","last_became_peered":"2023-12-04T10:43:52.251253+0000","last_unstale":"2023-12-04T10:43:58.022422+0000","last_undegraded":"2023-12-04T10:43:58.022422+0000","last_fullsized":"2023-12-04T10:43:58.022422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:59:51.960369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048941+0000","last_change":"2023-12-04T10:43:52.260562+0000","last_active":"2023-12-04T10:43:58.048941+0000","last_peered":"2023-12-04T10:43:58.048941+0000","last_clean":"2023-12-04T10:43:58.048941+0000","last_became_active":"2023-12-04T10:43:52.260219+0000","last_became_peered":"2023-12-04T10:43:52.260219+0000","last_unstale":"2023-12-04T10:43:58.048941+0000","last_undegraded":"2023-12-04T10:43:58.048941+0000","last_fullsized":"2023-12-04T10:43:58.048941+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:12:59.642045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041543+0000","last_change":"2023-12-04T10:43:52.987240+0000","last_active":"2023-12-04T10:43:58.041543+0000","last_peered":"2023-12-04T10:43:58.041543+0000","last_clean":"2023-12-04T10:43:58.041543+0000","last_became_active":"2023-12-04T10:43:52.986937+0000","last_became_peered":"2023-12-04T10:43:52.986937+0000","last_unstale":"2023-12-04T10:43:58.041543+0000","last_undegraded":"2023-12-04T10:43:58.041543+0000","last_fullsized":"2023-12-04T10:43:58.041543+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.997827+0000","last_change":"2023-12-04T10:43:58.051595+0000","last_active":"2023-12-04T10:43:58.997827+0000","last_peered":"2023-12-04T10:43:58.997827+0000","last_clean":"2023-12-04T10:43:58.997827+0000","last_became_active":"2023-12-04T10:43:58.051043+0000","last_became_peered":"2023-12-04T10:43:58.051043+0000","last_unstale":"2023-12-04T10:43:58.997827+0000","last_undegraded":"2023-12-04T10:43:58.997827+0000","last_fullsized":"2023-12-04T10:43:58.997827+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:16:05.070439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021505+0000","last_change":"2023-12-04T10:43:52.265562+0000","last_active":"2023-12-04T10:43:58.021505+0000","last_peered":"2023-12-04T10:43:58.021505+0000","last_clean":"2023-12-04T10:43:58.021505+0000","last_became_active":"2023-12-04T10:43:52.265254+0000","last_became_peered":"2023-12-04T10:43:52.265254+0000","last_unstale":"2023-12-04T10:43:58.021505+0000","last_undegraded":"2023-12-04T10:43:58.021505+0000","last_fullsized":"2023-12-04T10:43:58.021505+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:50.929699+0000","last_clean_scrub_stamp":"2023-12-04T10:43:50.929699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:19:09.555889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.035837+0000","last_change":"2023-12-04T10:43:52.980838+0000","last_active":"2023-12-04T10:43:58.035837+0000","last_peered":"2023-12-04T10:43:58.035837+0000","last_clean":"2023-12-04T10:43:58.035837+0000","last_became_active":"2023-12-04T10:43:52.980492+0000","last_became_peered":"2023-12-04T10:43:52.980492+0000","last_unstale":"2023-12-04T10:43:58.035837+0000","last_undegraded":"2023-12-04T10:43:58.035837+0000","last_fullsized":"2023-12-04T10:43:58.035837+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:22.131473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.703967+0000","last_change":"2023-12-04T10:43:58.049380+0000","last_active":"2023-12-04T10:43:58.703967+0000","last_peered":"2023-12-04T10:43:58.703967+0000","last_clean":"2023-12-04T10:43:58.703967+0000","last_became_active":"2023-12-04T10:43:58.048992+0000","last_became_peered":"2023-12-04T10:43:58.048992+0000","last_unstale":"2023-12-04T10:43:58.703967+0000","last_undegraded":"2023-12-04T10:43:58.703967+0000","last_fullsized":"2023-12-04T10:43:58.703967+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:56.998391+0000","last_clean_scrub_stamp":"2023-12-04T10:43:56.998391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:53:06.680881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048566+0000","last_change":"2023-12-04T10:43:52.980960+0000","last_active":"2023-12-04T10:43:58.048566+0000","last_peered":"2023-12-04T10:43:58.048566+0000","last_clean":"2023-12-04T10:43:58.048566+0000","last_became_active":"2023-12-04T10:43:52.980414+0000","last_became_peered":"2023-12-04T10:43:52.980414+0000","last_unstale":"2023-12-04T10:43:58.048566+0000","last_undegraded":"2023-12-04T10:43:58.048566+0000","last_fullsized":"2023-12-04T10:43:58.048566+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:26.269589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.044326+0000","last_change":"2023-12-04T10:43:52.991417+0000","last_active":"2023-12-04T10:43:58.044326+0000","last_peered":"2023-12-04T10:43:58.044326+0000","last_clean":"2023-12-04T10:43:58.044326+0000","last_became_active":"2023-12-04T10:43:52.991128+0000","last_became_peered":"2023-12-04T10:43:52.991128+0000","last_unstale":"2023-12-04T10:43:58.044326+0000","last_undegraded":"2023-12-04T10:43:58.044326+0000","last_fullsized":"2023-12-04T10:43:58.044326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:30:48.827688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034634+0000","last_change":"2023-12-04T10:43:52.979726+0000","last_active":"2023-12-04T10:43:58.034634+0000","last_peered":"2023-12-04T10:43:58.034634+0000","last_clean":"2023-12-04T10:43:58.034634+0000","last_became_active":"2023-12-04T10:43:52.979418+0000","last_became_peered":"2023-12-04T10:43:52.979418+0000","last_unstale":"2023-12-04T10:43:58.034634+0000","last_undegraded":"2023-12-04T10:43:58.034634+0000","last_fullsized":"2023-12-04T10:43:58.034634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:35:03.536961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037625+0000","last_change":"2023-12-04T10:43:52.983306+0000","last_active":"2023-12-04T10:43:58.037625+0000","last_peered":"2023-12-04T10:43:58.037625+0000","last_clean":"2023-12-04T10:43:58.037625+0000","last_became_active":"2023-12-04T10:43:52.982993+0000","last_became_peered":"2023-12-04T10:43:52.982993+0000","last_unstale":"2023-12-04T10:43:58.037625+0000","last_undegraded":"2023-12-04T10:43:58.037625+0000","last_fullsized":"2023-12-04T10:43:58.037625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:15:26.269589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.021434+0000","last_change":"2023-12-04T10:43:52.977063+0000","last_active":"2023-12-04T10:43:58.021434+0000","last_peered":"2023-12-04T10:43:58.021434+0000","last_clean":"2023-12-04T10:43:58.021434+0000","last_became_active":"2023-12-04T10:43:52.975971+0000","last_became_peered":"2023-12-04T10:43:52.975971+0000","last_unstale":"2023-12-04T10:43:58.021434+0000","last_undegraded":"2023-12-04T10:43:58.021434+0000","last_fullsized":"2023-12-04T10:43:58.021434+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.029916+0000","last_change":"2023-12-04T10:43:52.982380+0000","last_active":"2023-12-04T10:43:58.029916+0000","last_peered":"2023-12-04T10:43:58.029916+0000","last_clean":"2023-12-04T10:43:58.029916+0000","last_became_active":"2023-12-04T10:43:52.981200+0000","last_became_peered":"2023-12-04T10:43:52.981200+0000","last_unstale":"2023-12-04T10:43:58.029916+0000","last_undegraded":"2023-12-04T10:43:58.029916+0000","last_fullsized":"2023-12-04T10:43:58.029916+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:35:52.376732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.050824+0000","last_change":"2023-12-04T10:43:52.987443+0000","last_active":"2023-12-04T10:43:58.050824+0000","last_peered":"2023-12-04T10:43:58.050824+0000","last_clean":"2023-12-04T10:43:58.050824+0000","last_became_active":"2023-12-04T10:43:52.987177+0000","last_became_peered":"2023-12-04T10:43:52.987177+0000","last_unstale":"2023-12-04T10:43:58.050824+0000","last_undegraded":"2023-12-04T10:43:58.050824+0000","last_fullsized":"2023-12-04T10:43:58.050824+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:04:04.349083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.023146+0000","last_change":"2023-12-04T10:43:52.986477+0000","last_active":"2023-12-04T10:43:58.023146+0000","last_peered":"2023-12-04T10:43:58.023146+0000","last_clean":"2023-12-04T10:43:58.023146+0000","last_became_active":"2023-12-04T10:43:52.986072+0000","last_became_peered":"2023-12-04T10:43:52.986072+0000","last_unstale":"2023-12-04T10:43:58.023146+0000","last_undegraded":"2023-12-04T10:43:58.023146+0000","last_fullsized":"2023-12-04T10:43:58.023146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033092+0000","last_change":"2023-12-04T10:43:52.993638+0000","last_active":"2023-12-04T10:43:58.033092+0000","last_peered":"2023-12-04T10:43:58.033092+0000","last_clean":"2023-12-04T10:43:58.033092+0000","last_became_active":"2023-12-04T10:43:52.993364+0000","last_became_peered":"2023-12-04T10:43:52.993364+0000","last_unstale":"2023-12-04T10:43:58.033092+0000","last_undegraded":"2023-12-04T10:43:58.033092+0000","last_fullsized":"2023-12-04T10:43:58.033092+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.022326+0000","last_change":"2023-12-04T10:43:52.986640+0000","last_active":"2023-12-04T10:43:58.022326+0000","last_peered":"2023-12-04T10:43:58.022326+0000","last_clean":"2023-12-04T10:43:58.022326+0000","last_became_active":"2023-12-04T10:43:52.983310+0000","last_became_peered":"2023-12-04T10:43:52.983310+0000","last_unstale":"2023-12-04T10:43:58.022326+0000","last_undegraded":"2023-12-04T10:43:58.022326+0000","last_fullsized":"2023-12-04T10:43:58.022326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:34:26.494064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034400+0000","last_change":"2023-12-04T10:43:52.982396+0000","last_active":"2023-12-04T10:43:58.034400+0000","last_peered":"2023-12-04T10:43:58.034400+0000","last_clean":"2023-12-04T10:43:58.034400+0000","last_became_active":"2023-12-04T10:43:52.980007+0000","last_became_peered":"2023-12-04T10:43:52.980007+0000","last_unstale":"2023-12-04T10:43:58.034400+0000","last_undegraded":"2023-12-04T10:43:58.034400+0000","last_fullsized":"2023-12-04T10:43:58.034400+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:22:27.463482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037514+0000","last_change":"2023-12-04T10:43:52.979531+0000","last_active":"2023-12-04T10:43:58.037514+0000","last_peered":"2023-12-04T10:43:58.037514+0000","last_clean":"2023-12-04T10:43:58.037514+0000","last_became_active":"2023-12-04T10:43:52.979210+0000","last_became_peered":"2023-12-04T10:43:52.979210+0000","last_unstale":"2023-12-04T10:43:58.037514+0000","last_undegraded":"2023-12-04T10:43:58.037514+0000","last_fullsized":"2023-12-04T10:43:58.037514+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:14:33.669944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.048898+0000","last_change":"2023-12-04T10:43:52.986872+0000","last_active":"2023-12-04T10:43:58.048898+0000","last_peered":"2023-12-04T10:43:58.048898+0000","last_clean":"2023-12-04T10:43:58.048898+0000","last_became_active":"2023-12-04T10:43:52.981778+0000","last_became_peered":"2023-12-04T10:43:52.981778+0000","last_unstale":"2023-12-04T10:43:58.048898+0000","last_undegraded":"2023-12-04T10:43:58.048898+0000","last_fullsized":"2023-12-04T10:43:58.048898+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.219648+0000","last_change":"2023-12-04T10:43:52.985981+0000","last_active":"2023-12-04T10:43:58.219648+0000","last_peered":"2023-12-04T10:43:58.219648+0000","last_clean":"2023-12-04T10:43:58.219648+0000","last_became_active":"2023-12-04T10:43:52.982061+0000","last_became_peered":"2023-12-04T10:43:52.982061+0000","last_unstale":"2023-12-04T10:43:58.219648+0000","last_undegraded":"2023-12-04T10:43:58.219648+0000","last_fullsized":"2023-12-04T10:43:58.219648+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:25:40.024910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.046541+0000","last_change":"2023-12-04T10:43:52.973616+0000","last_active":"2023-12-04T10:43:58.046541+0000","last_peered":"2023-12-04T10:43:58.046541+0000","last_clean":"2023-12-04T10:43:58.046541+0000","last_became_active":"2023-12-04T10:43:52.973295+0000","last_became_peered":"2023-12-04T10:43:52.973295+0000","last_unstale":"2023-12-04T10:43:58.046541+0000","last_undegraded":"2023-12-04T10:43:58.046541+0000","last_fullsized":"2023-12-04T10:43:58.046541+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:57:45.678858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.041620+0000","last_change":"2023-12-04T10:43:52.988142+0000","last_active":"2023-12-04T10:43:58.041620+0000","last_peered":"2023-12-04T10:43:58.041620+0000","last_clean":"2023-12-04T10:43:58.041620+0000","last_became_active":"2023-12-04T10:43:52.979726+0000","last_became_peered":"2023-12-04T10:43:52.979726+0000","last_unstale":"2023-12-04T10:43:58.041620+0000","last_undegraded":"2023-12-04T10:43:58.041620+0000","last_fullsized":"2023-12-04T10:43:58.041620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:42:54.689876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.032829+0000","last_change":"2023-12-04T10:43:52.979067+0000","last_active":"2023-12-04T10:43:58.032829+0000","last_peered":"2023-12-04T10:43:58.032829+0000","last_clean":"2023-12-04T10:43:58.032829+0000","last_became_active":"2023-12-04T10:43:52.978720+0000","last_became_peered":"2023-12-04T10:43:52.978720+0000","last_unstale":"2023-12-04T10:43:58.032829+0000","last_undegraded":"2023-12-04T10:43:58.032829+0000","last_fullsized":"2023-12-04T10:43:58.032829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030859+0000","last_change":"2023-12-04T10:43:52.976129+0000","last_active":"2023-12-04T10:43:58.030859+0000","last_peered":"2023-12-04T10:43:58.030859+0000","last_clean":"2023-12-04T10:43:58.030859+0000","last_became_active":"2023-12-04T10:43:52.975844+0000","last_became_peered":"2023-12-04T10:43:52.975844+0000","last_unstale":"2023-12-04T10:43:58.030859+0000","last_undegraded":"2023-12-04T10:43:58.030859+0000","last_fullsized":"2023-12-04T10:43:58.030859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:37:49.291916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.033802+0000","last_change":"2023-12-04T10:43:52.984631+0000","last_active":"2023-12-04T10:43:58.033802+0000","last_peered":"2023-12-04T10:43:58.033802+0000","last_clean":"2023-12-04T10:43:58.033802+0000","last_became_active":"2023-12-04T10:43:52.984276+0000","last_became_peered":"2023-12-04T10:43:52.984276+0000","last_unstale":"2023-12-04T10:43:58.033802+0000","last_undegraded":"2023-12-04T10:43:58.033802+0000","last_fullsized":"2023-12-04T10:43:58.033802+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:53:19.937888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020905+0000","last_change":"2023-12-04T10:43:52.978860+0000","last_active":"2023-12-04T10:43:58.020905+0000","last_peered":"2023-12-04T10:43:58.020905+0000","last_clean":"2023-12-04T10:43:58.020905+0000","last_became_active":"2023-12-04T10:43:52.978564+0000","last_became_peered":"2023-12-04T10:43:52.978564+0000","last_unstale":"2023-12-04T10:43:58.020905+0000","last_undegraded":"2023-12-04T10:43:58.020905+0000","last_fullsized":"2023-12-04T10:43:58.020905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":15,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.038398+0000","last_change":"2023-12-04T10:43:52.973000+0000","last_active":"2023-12-04T10:43:58.038398+0000","last_peered":"2023-12-04T10:43:58.038398+0000","last_clean":"2023-12-04T10:43:58.038398+0000","last_became_active":"2023-12-04T10:43:52.972621+0000","last_became_peered":"2023-12-04T10:43:52.972621+0000","last_unstale":"2023-12-04T10:43:58.038398+0000","last_undegraded":"2023-12-04T10:43:58.038398+0000","last_fullsized":"2023-12-04T10:43:58.038398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:57:45.678858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.049439+0000","last_change":"2023-12-04T10:43:52.982066+0000","last_active":"2023-12-04T10:43:58.049439+0000","last_peered":"2023-12-04T10:43:58.049439+0000","last_clean":"2023-12-04T10:43:58.049439+0000","last_became_active":"2023-12-04T10:43:52.981727+0000","last_became_peered":"2023-12-04T10:43:52.981727+0000","last_unstale":"2023-12-04T10:43:58.049439+0000","last_undegraded":"2023-12-04T10:43:58.049439+0000","last_fullsized":"2023-12-04T10:43:58.049439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:54:15.570429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.050796+0000","last_change":"2023-12-04T10:43:52.983361+0000","last_active":"2023-12-04T10:43:58.050796+0000","last_peered":"2023-12-04T10:43:58.050796+0000","last_clean":"2023-12-04T10:43:58.050796+0000","last_became_active":"2023-12-04T10:43:52.983081+0000","last_became_peered":"2023-12-04T10:43:52.983081+0000","last_unstale":"2023-12-04T10:43:58.050796+0000","last_undegraded":"2023-12-04T10:43:58.050796+0000","last_fullsized":"2023-12-04T10:43:58.050796+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:15:26.377187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.221587+0000","last_change":"2023-12-04T10:43:52.994001+0000","last_active":"2023-12-04T10:43:58.221587+0000","last_peered":"2023-12-04T10:43:58.221587+0000","last_clean":"2023-12-04T10:43:58.221587+0000","last_became_active":"2023-12-04T10:43:52.993633+0000","last_became_peered":"2023-12-04T10:43:52.993633+0000","last_unstale":"2023-12-04T10:43:58.221587+0000","last_undegraded":"2023-12-04T10:43:58.221587+0000","last_fullsized":"2023-12-04T10:43:58.221587+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:50:20.802003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.020739+0000","last_change":"2023-12-04T10:43:52.988344+0000","last_active":"2023-12-04T10:43:58.020739+0000","last_peered":"2023-12-04T10:43:58.020739+0000","last_clean":"2023-12-04T10:43:58.020739+0000","last_became_active":"2023-12-04T10:43:52.988051+0000","last_became_peered":"2023-12-04T10:43:52.988051+0000","last_unstale":"2023-12-04T10:43:58.020739+0000","last_undegraded":"2023-12-04T10:43:58.020739+0000","last_fullsized":"2023-12-04T10:43:58.020739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:46:49.075321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.213667+0000","last_change":"2023-12-04T10:43:52.977848+0000","last_active":"2023-12-04T10:43:58.213667+0000","last_peered":"2023-12-04T10:43:58.213667+0000","last_clean":"2023-12-04T10:43:58.213667+0000","last_became_active":"2023-12-04T10:43:52.977443+0000","last_became_peered":"2023-12-04T10:43:52.977443+0000","last_unstale":"2023-12-04T10:43:58.213667+0000","last_undegraded":"2023-12-04T10:43:58.213667+0000","last_fullsized":"2023-12-04T10:43:58.213667+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.034180+0000","last_change":"2023-12-04T10:43:52.978013+0000","last_active":"2023-12-04T10:43:58.034180+0000","last_peered":"2023-12-04T10:43:58.034180+0000","last_clean":"2023-12-04T10:43:58.034180+0000","last_became_active":"2023-12-04T10:43:52.976233+0000","last_became_peered":"2023-12-04T10:43:52.976233+0000","last_unstale":"2023-12-04T10:43:58.034180+0000","last_undegraded":"2023-12-04T10:43:58.034180+0000","last_fullsized":"2023-12-04T10:43:58.034180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:18:39.891763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.216255+0000","last_change":"2023-12-04T10:43:52.987505+0000","last_active":"2023-12-04T10:43:58.216255+0000","last_peered":"2023-12-04T10:43:58.216255+0000","last_clean":"2023-12-04T10:43:58.216255+0000","last_became_active":"2023-12-04T10:43:52.982436+0000","last_became_peered":"2023-12-04T10:43:52.982436+0000","last_unstale":"2023-12-04T10:43:58.216255+0000","last_undegraded":"2023-12-04T10:43:58.216255+0000","last_fullsized":"2023-12-04T10:43:58.216255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:00:00.872292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.040439+0000","last_change":"2023-12-04T10:43:52.988667+0000","last_active":"2023-12-04T10:43:58.040439+0000","last_peered":"2023-12-04T10:43:58.040439+0000","last_clean":"2023-12-04T10:43:58.040439+0000","last_became_active":"2023-12-04T10:43:52.988296+0000","last_became_peered":"2023-12-04T10:43:52.988296+0000","last_unstale":"2023-12-04T10:43:58.040439+0000","last_undegraded":"2023-12-04T10:43:58.040439+0000","last_fullsized":"2023-12-04T10:43:58.040439+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:03:41.373521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.037780+0000","last_change":"2023-12-04T10:43:52.983801+0000","last_active":"2023-12-04T10:43:58.037780+0000","last_peered":"2023-12-04T10:43:58.037780+0000","last_clean":"2023-12-04T10:43:58.037780+0000","last_became_active":"2023-12-04T10:43:52.981238+0000","last_became_peered":"2023-12-04T10:43:52.981238+0000","last_unstale":"2023-12-04T10:43:58.037780+0000","last_undegraded":"2023-12-04T10:43:58.037780+0000","last_fullsized":"2023-12-04T10:43:58.037780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T21:05:09.890113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.030806+0000","last_change":"2023-12-04T10:43:52.978663+0000","last_active":"2023-12-04T10:43:58.030806+0000","last_peered":"2023-12-04T10:43:58.030806+0000","last_clean":"2023-12-04T10:43:58.030806+0000","last_became_active":"2023-12-04T10:43:52.978251+0000","last_became_peered":"2023-12-04T10:43:52.978251+0000","last_unstale":"2023-12-04T10:43:58.030806+0000","last_undegraded":"2023-12-04T10:43:58.030806+0000","last_fullsized":"2023-12-04T10:43:58.030806+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:17:51.617229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2023-12-04T10:43:58.220292+0000","last_change":"2023-12-04T10:43:52.985634+0000","last_active":"2023-12-04T10:43:58.220292+0000","last_peered":"2023-12-04T10:43:58.220292+0000","last_clean":"2023-12-04T10:43:58.220292+0000","last_became_active":"2023-12-04T10:43:52.981676+0000","last_became_peered":"2023-12-04T10:43:52.981676+0000","last_unstale":"2023-12-04T10:43:58.220292+0000","last_undegraded":"2023-12-04T10:43:58.220292+0000","last_fullsized":"2023-12-04T10:43:58.220292+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:52.213032+0000","last_clean_scrub_stamp":"2023-12-04T10:43:52.213032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:32:44.930072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4639,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":860,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":880640,"data_stored":702921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.151}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9159999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6739999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9910000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509449,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70699999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1950000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5429999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7410000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509449,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":286720,"data_stored":112061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.454}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.579}]}]},{"osd":3,"up_from":15,"seq":64424509450,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":115812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.389}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2390000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.214}]}]},{"osd":0,"up_from":15,"seq":64424509450,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":888832,"data_stored":702977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75900000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.29}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3320000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.042}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":294912,"data_stored":112097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5190000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.5750000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.179}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":111971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.01}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.143}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2010000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6519999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542156,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":290816,"data_stored":112131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1930000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.872}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3841,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T10:44:27.891 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-04T10:44:27.892 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-04T10:44:27.892 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-04T10:44:27.892 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-04T10:44:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.151+0000 7f7d6b59e640 1 Processor -- start 2023-12-04T10:44:28.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.151+0000 7f7d6b59e640 1 -- start start 2023-12-04T10:44:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.152+0000 7f7d6b59e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7d6c151ca0 0x7f7d6c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.152+0000 7f7d6b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c06e0b0 0x7f7d6c071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.152+0000 7f7d6b59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d6c0cc7f0 con 0x7f7d6c15b470 2023-12-04T10:44:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.152+0000 7f7d6b59e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d6c0cca40 con 0x7f7d6c151ca0 2023-12-04T10:44:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.152+0000 7f7d6b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0ccd20 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.153+0000 7f7d6a59c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7d6c151ca0 0x7f7d6c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.153+0000 7f7d6a59c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f7d6c151ca0 0x7f7d6c06db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34578/0 (socket says 172.21.15.63:34578) 2023-12-04T10:44:28.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.153+0000 7f7d6a59c640 1 -- 172.21.15.63:0/782697105 learned_addr learned my addr 172.21.15.63:0/782697105 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.153+0000 7f7d6a59c640 1 -- 172.21.15.63:0/782697105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c06e0b0 msgr2=0x7f7d6c071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.153+0000 7f7d6a59c640 1 --2- 172.21.15.63:0/782697105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c06e0b0 0x7f7d6c071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.153+0000 7f7d6a59c640 1 -- 172.21.15.63:0/782697105 >> v1:172.21.15.66:6789/0 conn(0x7f7d6c15b470 legacy=0x7f7d6c0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.153+0000 7f7d6a59c640 1 -- 172.21.15.63:0/782697105 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d6c0cd000 con 0x7f7d6c151ca0 2023-12-04T10:44:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.154+0000 7f7d6a59c640 1 --2- 172.21.15.63:0/782697105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c151ca0 0x7f7d6c06db70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009870 tx=0x7f7d5c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72700f5aec41beef server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.154+0000 7f7d69d9b640 1 -- 172.21.15.63:0/782697105 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0317c0 con 0x7f7d6c151ca0 2023-12-04T10:44:28.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.154+0000 7f7d69d9b640 1 -- 172.21.15.63:0/782697105 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c031920 con 0x7f7d6c151ca0 2023-12-04T10:44:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.154+0000 7f7d69d9b640 1 -- 172.21.15.63:0/782697105 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c031cb0 con 0x7f7d6c151ca0 2023-12-04T10:44:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.155+0000 7f7d6b59e640 1 -- 172.21.15.63:0/782697105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c151ca0 msgr2=0x7f7d6c06db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.155+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/782697105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c151ca0 0x7f7d6c06db70 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c009870 tx=0x7f7d5c02b860 comp rx=0 tx=0).stop 2023-12-04T10:44:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.155+0000 7f7d6b59e640 1 -- 172.21.15.63:0/782697105 shutdown_connections 2023-12-04T10:44:28.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.155+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/782697105 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c06e0b0 0x7f7d6c071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.155+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/782697105 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c151ca0 0x7f7d6c06db70 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.155+0000 7f7d6b59e640 1 -- 172.21.15.63:0/782697105 >> 172.21.15.63:0/782697105 conn(0x7f7d6c0b07f0 msgr2=0x7f7d6c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.155+0000 7f7d6b59e640 1 -- 172.21.15.63:0/782697105 shutdown_connections 2023-12-04T10:44:28.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.155+0000 7f7d6b59e640 1 -- 172.21.15.63:0/782697105 wait complete. 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.157+0000 7f7d6b59e640 1 Processor -- start 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.157+0000 7f7d6b59e640 1 -- start start 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c06e0b0 0x7f7d6c14f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d6c151ca0 0x7f7d6c0c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c0c9770 0x7f7d6c0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6b59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c9c00 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6b59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c7530 con 0x7f7d6c151ca0 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d6c0c6940 con 0x7f7d6c0c9770 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c06e0b0 0x7f7d6c14f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c06e0b0 0x7f7d6c14f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34592/0 (socket says 172.21.15.63:34592) 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.158+0000 7f7d6a59c640 1 -- 172.21.15.63:0/4113306284 learned_addr learned my addr 172.21.15.63:0/4113306284 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.159+0000 7f7d6a59c640 1 -- 172.21.15.63:0/4113306284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c0c9770 msgr2=0x7f7d6c0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.159+0000 7f7d6ad9d640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c0c9770 0x7f7d6c0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.159+0000 7f7d63fff640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d6c151ca0 0x7f7d6c0c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.159+0000 7f7d6a59c640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c0c9770 0x7f7d6c0b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.159+0000 7f7d6a59c640 1 -- 172.21.15.63:0/4113306284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d6c151ca0 msgr2=0x7f7d6c0c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.159+0000 7f7d6a59c640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d6c151ca0 0x7f7d6c0c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.159+0000 7f7d6a59c640 1 -- 172.21.15.63:0/4113306284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d5c0094d0 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.159+0000 7f7d6a59c640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c06e0b0 0x7f7d6c14f3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c000c00 tx=0x7f7d5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.160+0000 7f7d62ffd640 1 -- 172.21.15.63:0/4113306284 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0329a0 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.160+0000 7f7d62ffd640 1 -- 172.21.15.63:0/4113306284 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d5c032b20 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.160+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d6c0c6c00 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.160+0000 7f7d62ffd640 1 -- 172.21.15.63:0/4113306284 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d5c0453f0 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.160+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d6c0c71c0 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.161+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d6c0c7350 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.162+0000 7f7d62ffd640 1 -- 172.21.15.63:0/4113306284 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d5c04d3f0 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.163+0000 7f7d62ffd640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f7d4c06ae40 0x7f7d4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.163+0000 7f7d62ffd640 1 -- 172.21.15.63:0/4113306284 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d5c0ab940 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.163+0000 7f7d63fff640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f7d4c06ae40 0x7f7d4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.164+0000 7f7d63fff640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f7d4c06ae40 0x7f7d4c06d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0c6760 tx=0x7f7d54008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:28.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.169+0000 7f7d62ffd640 1 -- 172.21.15.63:0/4113306284 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d5c076660 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.394+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7d6c04e840 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.394+0000 7f7d62ffd640 1 -- 172.21.15.63:0/4113306284 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7d5c079c80 con 0x7f7d6c06e0b0 2023-12-04T10:44:28.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:28.396 INFO:teuthology.orchestra.run.smithi063.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-04T10:44:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f7d4c06ae40 msgr2=0x7f7d4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f7d4c06ae40 0x7f7d4c06d300 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c0c6760 tx=0x7f7d54008040 comp rx=0 tx=0).stop 2023-12-04T10:44:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c06e0b0 msgr2=0x7f7d6c14f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c06e0b0 0x7f7d6c14f3e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7d5c000c00 tx=0x7f7d5c0046c0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 shutdown_connections 2023-12-04T10:44:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f7d4c06ae40 0x7f7d4c06d300 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f7d6c0c9770 0x7f7d6c0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7d6c151ca0 0x7f7d6c0c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 --2- 172.21.15.63:0/4113306284 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7d6c06e0b0 0x7f7d6c14f3e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 >> 172.21.15.63:0/4113306284 conn(0x7f7d6c0b07f0 msgr2=0x7f7d6c151060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:28.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 shutdown_connections 2023-12-04T10:44:28.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.397+0000 7f7d6b59e640 1 -- 172.21.15.63:0/4113306284 wait complete. 2023-12-04T10:44:28.417 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-04T10:44:28.417 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:28.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.632+0000 7fb53bfff640 1 Processor -- start 2023-12-04T10:44:28.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.632+0000 7fb53bfff640 1 -- start start 2023-12-04T10:44:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.634+0000 7fb53bfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb53c160980 0x7fb53c0d01c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.634+0000 7fb53bfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 0x7fb53c0d1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.634+0000 7fb53bfff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb53c0d0fd0 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.634+0000 7fb53bfff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb53c0d3d10 con 0x7fb53c160980 2023-12-04T10:44:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.634+0000 7fb53bfff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0d3ff0 con 0x7fb53c160d60 2023-12-04T10:44:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.634+0000 7fb53affd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb53c160980 0x7fb53c0d01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.634+0000 7fb53affd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb53c160980 0x7fb53c0d01c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34598/0 (socket says 172.21.15.63:34598) 2023-12-04T10:44:28.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.634+0000 7fb53affd640 1 -- 172.21.15.63:0/940074060 learned_addr learned my addr 172.21.15.63:0/940074060 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:28.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.635+0000 7fb5327fc640 1 --2- 172.21.15.63:0/940074060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 0x7fb53c0d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.635+0000 7fb53affd640 1 -- 172.21.15.63:0/940074060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 msgr2=0x7fb53c0d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:28.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.635+0000 7fb53affd640 1 --2- 172.21.15.63:0/940074060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 0x7fb53c0d1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.635+0000 7fb53affd640 1 -- 172.21.15.63:0/940074060 >> v1:172.21.15.66:6789/0 conn(0x7fb53c0b1ff0 legacy=0x7fb53c0cdcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:28.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.635+0000 7fb53affd640 1 -- 172.21.15.63:0/940074060 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb53c0afd50 con 0x7fb53c160980 2023-12-04T10:44:28.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.635+0000 7fb5327fc640 1 --2- 172.21.15.63:0/940074060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 0x7fb53c0d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:28.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.636+0000 7fb53affd640 1 --2- 172.21.15.63:0/940074060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c160980 0x7fb53c0d01c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009e50 tx=0x7fb52c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467beb9ec9658636 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.636+0000 7fb53a7fc640 1 -- 172.21.15.63:0/940074060 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c02ca80 con 0x7fb53c160980 2023-12-04T10:44:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.636+0000 7fb53a7fc640 1 -- 172.21.15.63:0/940074060 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c02cbe0 con 0x7fb53c160980 2023-12-04T10:44:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.636+0000 7fb53a7fc640 1 -- 172.21.15.63:0/940074060 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c0343f0 con 0x7fb53c160980 2023-12-04T10:44:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.637+0000 7fb53bfff640 1 -- 172.21.15.63:0/940074060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c160980 msgr2=0x7fb53c0d01c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.637+0000 7fb53bfff640 1 --2- 172.21.15.63:0/940074060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c160980 0x7fb53c0d01c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009e50 tx=0x7fb52c02bee0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.637+0000 7fb53bfff640 1 -- 172.21.15.63:0/940074060 shutdown_connections 2023-12-04T10:44:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.637+0000 7fb53bfff640 1 --2- 172.21.15.63:0/940074060 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 0x7fb53c0d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.637+0000 7fb53bfff640 1 --2- 172.21.15.63:0/940074060 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c160980 0x7fb53c0d01c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.637+0000 7fb53bfff640 1 -- 172.21.15.63:0/940074060 >> 172.21.15.63:0/940074060 conn(0x7fb53c0d3150 msgr2=0x7fb53c0d3560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.637+0000 7fb53bfff640 1 -- 172.21.15.63:0/940074060 shutdown_connections 2023-12-04T10:44:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.637+0000 7fb53bfff640 1 -- 172.21.15.63:0/940074060 wait complete. 2023-12-04T10:44:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.638+0000 7fb53bfff640 1 Processor -- start 2023-12-04T10:44:28.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.639+0000 7fb53bfff640 1 -- start start 2023-12-04T10:44:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.639+0000 7fb53bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c0b1ff0 0x7fb53c152770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53bfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb53c160980 0x7fb53c0b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53bfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 0x7fb53c0d1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53bfff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0ccf30 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53bfff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0cc1a0 con 0x7fb53c160980 2023-12-04T10:44:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53bfff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb53c0cbec0 con 0x7fb53c160d60 2023-12-04T10:44:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c0b1ff0 0x7fb53c152770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c0b1ff0 0x7fb53c152770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34612/0 (socket says 172.21.15.63:34612) 2023-12-04T10:44:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53affd640 1 -- 172.21.15.63:0/462710553 learned_addr learned my addr 172.21.15.63:0/462710553 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53affd640 1 -- 172.21.15.63:0/462710553 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 msgr2=0x7fb53c0d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53affd640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 0x7fb53c0d1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb5327fc640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb53c160980 0x7fb53c0b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53affd640 1 -- 172.21.15.63:0/462710553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb53c160980 msgr2=0x7fb53c0b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53affd640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb53c160980 0x7fb53c0b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.640+0000 7fb53affd640 1 -- 172.21.15.63:0/462710553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb52c009b30 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.641+0000 7fb53affd640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c0b1ff0 0x7fb53c152770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009e50 tx=0x7fb52c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:28.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.641+0000 7fb533fff640 1 -- 172.21.15.63:0/462710553 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c03e450 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.641+0000 7fb533fff640 1 -- 172.21.15.63:0/462710553 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb52c03e5f0 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.641+0000 7fb533fff640 1 -- 172.21.15.63:0/462710553 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb52c03e9a0 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.641+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb53c0c71f0 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.641+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb53c0c77b0 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.642+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb53c067900 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.643+0000 7fb533fff640 1 -- 172.21.15.63:0/462710553 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb52c02cd50 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.644+0000 7fb533fff640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb51c06ae40 0x7fb51c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:28.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.644+0000 7fb533fff640 1 -- 172.21.15.63:0/462710553 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb52c0ac520 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.644+0000 7fb5327fc640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb51c06ae40 0x7fb51c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:28.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.645+0000 7fb5327fc640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb51c06ae40 0x7fb51c06d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0cd7a0 tx=0x7fb524008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:28.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.650+0000 7fb533fff640 1 -- 172.21.15.63:0/462710553 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb52c0772e0 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.850+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb53c04e840 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.851+0000 7fb533fff640 1 -- 172.21.15.63:0/462710553 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fb52c07a900 con 0x7fb53c0b1ff0 2023-12-04T10:44:28.854 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:28.854 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.854+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb51c06ae40 msgr2=0x7fb51c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.854+0000 7fb53bfff640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb51c06ae40 0x7fb51c06d300 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0cd7a0 tx=0x7fb524008040 comp rx=0 tx=0).stop 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.854+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c0b1ff0 msgr2=0x7fb53c152770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.854+0000 7fb53bfff640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c0b1ff0 0x7fb53c152770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb52c009e50 tx=0x7fb52c004a40 comp rx=0 tx=0).stop 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.855+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 shutdown_connections 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.855+0000 7fb53bfff640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb51c06ae40 0x7fb51c06d300 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.855+0000 7fb53bfff640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb53c160d60 0x7fb53c0d1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.855+0000 7fb53bfff640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb53c160980 0x7fb53c0b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.855+0000 7fb53bfff640 1 --2- 172.21.15.63:0/462710553 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb53c0b1ff0 0x7fb53c152770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:28.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.855+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 >> 172.21.15.63:0/462710553 conn(0x7fb53c0d3150 msgr2=0x7fb53c15fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:28.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.855+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 shutdown_connections 2023-12-04T10:44:28.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:28.855+0000 7fb53bfff640 1 -- 172.21.15.63:0/462710553 wait complete. 2023-12-04T10:44:28.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:28.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:29.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.095+0000 7ff4eaf51640 1 Processor -- start 2023-12-04T10:44:29.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.095+0000 7ff4eaf51640 1 -- start start 2023-12-04T10:44:29.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.097+0000 7ff4eaf51640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff4e4144a00 0x7ff4e40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.097+0000 7ff4eaf51640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4e40701b0 0x7ff4e40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.097+0000 7ff4eaf51640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4e40b2370 con 0x7ff4e40ca290 2023-12-04T10:44:29.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.097+0000 7ff4eaf51640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e4070b00 con 0x7ff4e40701b0 2023-12-04T10:44:29.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.097+0000 7ff4eaf51640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4e40cae80 con 0x7ff4e4144a00 2023-12-04T10:44:29.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.097+0000 7ff4dbfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4e40701b0 0x7ff4e40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.098+0000 7ff4dbfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff4e40701b0 0x7ff4e40705c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34628/0 (socket says 172.21.15.63:34628) 2023-12-04T10:44:29.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.098+0000 7ff4dbfff640 1 -- 172.21.15.63:0/201833224 learned_addr learned my addr 172.21.15.63:0/201833224 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:29.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.098+0000 7ff4e8ced640 1 --2- 172.21.15.63:0/201833224 >> v2:172.21.15.66:3300/0 conn(0x7ff4e4144a00 0x7ff4e40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.098+0000 7ff4dbfff640 1 -- 172.21.15.63:0/201833224 >> v2:172.21.15.66:3300/0 conn(0x7ff4e4144a00 msgr2=0x7ff4e40b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:29.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.098+0000 7ff4dbfff640 1 --2- 172.21.15.63:0/201833224 >> v2:172.21.15.66:3300/0 conn(0x7ff4e4144a00 0x7ff4e40b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.098+0000 7ff4dbfff640 1 -- 172.21.15.63:0/201833224 >> v1:172.21.15.66:6789/0 conn(0x7ff4e40ca290 legacy=0x7ff4e40ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:29.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.098+0000 7ff4dbfff640 1 -- 172.21.15.63:0/201833224 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4e406c460 con 0x7ff4e40701b0 2023-12-04T10:44:29.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.099+0000 7ff4dbfff640 1 --2- 172.21.15.63:0/201833224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e40701b0 0x7ff4e40705c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009870 tx=0x7ff4d402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd8d09b5f6f4109 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:29.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.100+0000 7ff4db7fe640 1 -- 172.21.15.63:0/201833224 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d40317e0 con 0x7ff4e40701b0 2023-12-04T10:44:29.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.100+0000 7ff4db7fe640 1 -- 172.21.15.63:0/201833224 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4d4031940 con 0x7ff4e40701b0 2023-12-04T10:44:29.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.100+0000 7ff4db7fe640 1 -- 172.21.15.63:0/201833224 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4d4031cd0 con 0x7ff4e40701b0 2023-12-04T10:44:29.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.100+0000 7ff4eaf51640 1 -- 172.21.15.63:0/201833224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e40701b0 msgr2=0x7ff4e40705c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.100+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/201833224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e40701b0 0x7ff4e40705c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff4d4009870 tx=0x7ff4d402b880 comp rx=0 tx=0).stop 2023-12-04T10:44:29.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.101+0000 7ff4eaf51640 1 -- 172.21.15.63:0/201833224 shutdown_connections 2023-12-04T10:44:29.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.101+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/201833224 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e40701b0 0x7ff4e40705c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.101+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/201833224 >> v2:172.21.15.66:3300/0 conn(0x7ff4e4144a00 0x7ff4e40b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.101+0000 7ff4eaf51640 1 -- 172.21.15.63:0/201833224 >> 172.21.15.63:0/201833224 conn(0x7ff4e40cee80 msgr2=0x7ff4e40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:29.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.101+0000 7ff4eaf51640 1 -- 172.21.15.63:0/201833224 shutdown_connections 2023-12-04T10:44:29.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.101+0000 7ff4eaf51640 1 -- 172.21.15.63:0/201833224 wait complete. 2023-12-04T10:44:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.102+0000 7ff4eaf51640 1 Processor -- start 2023-12-04T10:44:29.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.103+0000 7ff4eaf51640 1 -- start start 2023-12-04T10:44:29.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.103+0000 7ff4eaf51640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4e40701b0 0x7ff4e4159320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.103+0000 7ff4eaf51640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4e40ca290 0x7ff4e41f4390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.103+0000 7ff4eaf51640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e4144a00 0x7ff4e4155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.103+0000 7ff4eaf51640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e41f5310 con 0x7ff4e4144a00 2023-12-04T10:44:29.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.103+0000 7ff4eaf51640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e41f4a70 con 0x7ff4e40ca290 2023-12-04T10:44:29.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.103+0000 7ff4eaf51640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4e41f4d50 con 0x7ff4e40701b0 2023-12-04T10:44:29.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e94ee640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e4144a00 0x7ff4e4155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e94ee640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e4144a00 0x7ff4e4155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34632/0 (socket says 172.21.15.63:34632) 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e94ee640 1 -- 172.21.15.63:0/917647954 learned_addr learned my addr 172.21.15.63:0/917647954 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4dbfff640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4e40ca290 0x7ff4e41f4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e8ced640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4e40701b0 0x7ff4e4159320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e94ee640 1 -- 172.21.15.63:0/917647954 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4e40701b0 msgr2=0x7ff4e4159320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e94ee640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4e40701b0 0x7ff4e4159320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e94ee640 1 -- 172.21.15.63:0/917647954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4e40ca290 msgr2=0x7ff4e41f4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e94ee640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4e40ca290 0x7ff4e41f4390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.104+0000 7ff4e94ee640 1 -- 172.21.15.63:0/917647954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d40094d0 con 0x7ff4e4144a00 2023-12-04T10:44:29.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.105+0000 7ff4e94ee640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e4144a00 0x7ff4e4155b70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c410 tx=0x7ff4dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:29.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.105+0000 7ff4d97fa640 1 -- 172.21.15.63:0/917647954 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc011790 con 0x7ff4e4144a00 2023-12-04T10:44:29.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.105+0000 7ff4d97fa640 1 -- 172.21.15.63:0/917647954 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4dc0118f0 con 0x7ff4e4144a00 2023-12-04T10:44:29.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.105+0000 7ff4d97fa640 1 -- 172.21.15.63:0/917647954 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc011ce0 con 0x7ff4e4144a00 2023-12-04T10:44:29.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.105+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4e41f5030 con 0x7ff4e4144a00 2023-12-04T10:44:29.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.105+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4e41560b0 con 0x7ff4e4144a00 2023-12-04T10:44:29.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.106+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4e413f710 con 0x7ff4e4144a00 2023-12-04T10:44:29.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.107+0000 7ff4d97fa640 1 -- 172.21.15.63:0/917647954 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff4dc01c460 con 0x7ff4e4144a00 2023-12-04T10:44:29.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.108+0000 7ff4d97fa640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff4d006ae40 0x7ff4d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.108+0000 7ff4d97fa640 1 -- 172.21.15.63:0/917647954 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff4dc0894a0 con 0x7ff4e4144a00 2023-12-04T10:44:29.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.109+0000 7ff4e8ced640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff4d006ae40 0x7ff4d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.109+0000 7ff4e8ced640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff4d006ae40 0x7ff4d006d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00099c0 tx=0x7ff4e0003990 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:29.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.113+0000 7ff4d97fa640 1 -- 172.21.15.63:0/917647954 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff4dc0542d0 con 0x7ff4e4144a00 2023-12-04T10:44:29.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.312+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff4e4068710 con 0x7ff4e4144a00 2023-12-04T10:44:29.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.313+0000 7ff4d97fa640 1 -- 172.21.15.63:0/917647954 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff4dc0578f0 con 0x7ff4e4144a00 2023-12-04T10:44:29.315 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:29.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff4d006ae40 msgr2=0x7ff4d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff4d006ae40 0x7ff4d006d300 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff4e00099c0 tx=0x7ff4e0003990 comp rx=0 tx=0).stop 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e4144a00 msgr2=0x7ff4e4155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e4144a00 0x7ff4e4155b70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c410 tx=0x7ff4dc00c8d0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 shutdown_connections 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff4d006ae40 0x7ff4d006d300 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff4e4144a00 0x7ff4e4155b70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff4e40ca290 0x7ff4e41f4390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 --2- 172.21.15.63:0/917647954 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff4e40701b0 0x7ff4e4159320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 >> 172.21.15.63:0/917647954 conn(0x7ff4e40cee80 msgr2=0x7ff4e415b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 shutdown_connections 2023-12-04T10:44:29.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.316+0000 7ff4eaf51640 1 -- 172.21.15.63:0/917647954 wait complete. 2023-12-04T10:44:29.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:29.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.562+0000 7f06da1c9640 1 Processor -- start 2023-12-04T10:44:29.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.563+0000 7f06da1c9640 1 -- start start 2023-12-04T10:44:29.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.564+0000 7f06da1c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 0x7f06d4165f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.564+0000 7f06da1c9640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40cb800 con 0x7f06d4143ca0 2023-12-04T10:44:29.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.564+0000 7f06da1c9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40cbae0 con 0x7f06d4144370 2023-12-04T10:44:29.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.564+0000 7f06da1c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40cbdc0 con 0x7f06d406c520 2023-12-04T10:44:29.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06d91c7640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f06d4143ca0 0x7f06d40b2e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43826/0 (socket says 172.21.15.63:43826) 2023-12-04T10:44:29.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06d91c7640 1 -- 172.21.15.63:0/3804286606 learned_addr learned my addr 172.21.15.63:0/3804286606 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:29.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 814544062 0 0) 0x7f06d40cb800 con 0x7f06d4143ca0 2023-12-04T10:44:29.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06c0003520 con 0x7f06d4143ca0 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06d99c8640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 0x7f06d4165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1683935280 0 0) 0x7f06c0003520 con 0x7f06d4143ca0 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 msgr2=0x7f06d4165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06cbfff640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 0x7f06d4165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 >> v1:172.21.15.66:6789/0 conn(0x7f06d4144370 legacy=0x7f06d406be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40b2610 con 0x7f06d4143ca0 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.565+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f06d0001670 con 0x7f06d4143ca0 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 >> v1:172.21.15.63:6789/0 conn(0x7f06d4143ca0 legacy=0x7f06d40b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06cbfff640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06c0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06cbfff640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06c00047c0 0x7f06c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06cbfff640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 0x7f06c0005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40cbdc0 con 0x7f06c00039a0 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c000bb40 con 0x7f06c00047c0 2023-12-04T10:44:29.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c000bd00 con 0x7f06d406c520 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06d91c7640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06c0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06d99c8640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 0x7f06c0005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06d89c6640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06c00047c0 0x7f06c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06d91c7640 1 -- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 msgr2=0x7f06c0005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.566+0000 7f06d91c7640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 0x7f06c0005210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.567+0000 7f06d91c7640 1 -- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06c00047c0 msgr2=0x7f06c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.567+0000 7f06d91c7640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06c00047c0 0x7f06c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.567+0000 7f06d91c7640 1 -- 172.21.15.63:0/3804286606 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c0003520 con 0x7f06c00039a0 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.567+0000 7f06d89c6640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06c00047c0 0x7f06c0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:29.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.567+0000 7f06d99c8640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d406c520 0x7f06c0005210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:29.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.568+0000 7f06d91c7640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06c0003dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c0e0 tx=0x7f06c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c36f0a56507f796 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:29.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.568+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0005ad0 con 0x7f06c00039a0 2023-12-04T10:44:29.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.568+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0005c30 con 0x7f06c00039a0 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.568+0000 7f06cbfff640 1 -- 172.21.15.63:0/3804286606 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d002c7f0 con 0x7f06c00039a0 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.569+0000 7f06da1c9640 1 -- 172.21.15.63:0/3804286606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 msgr2=0x7f06c0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.569+0000 7f06da1c9640 1 --2- 172.21.15.63:0/3804286606 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06c0003dc0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c0e0 tx=0x7f06c00057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.569+0000 7f06d99c8640 1 -- 172.21.15.63:0/3804286606 reap_dead start 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.569+0000 7f06da1c9640 1 -- 172.21.15.63:0/3804286606 shutdown_connections 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.569+0000 7f06da1c9640 1 -- 172.21.15.63:0/3804286606 >> 172.21.15.63:0/3804286606 conn(0x7f06d40b0860 msgr2=0x7f06d40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.569+0000 7f06da1c9640 1 -- 172.21.15.63:0/3804286606 shutdown_connections 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.569+0000 7f06da1c9640 1 -- 172.21.15.63:0/3804286606 wait complete. 2023-12-04T10:44:29.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.571+0000 7f06da1c9640 1 Processor -- start 2023-12-04T10:44:29.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.571+0000 7f06da1c9640 1 -- start start 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06da1c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06d415a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06da1c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d413eda0 0x7f06d415d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06da1c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d415dd80 0x7f06d4140260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06da1c9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d413de60 con 0x7f06c00039a0 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06da1c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d415e200 con 0x7f06d413eda0 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06da1c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d413e070 con 0x7f06d415dd80 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06d91c7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06d415a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06d91c7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06d415a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34656/0 (socket says 172.21.15.63:34656) 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06d91c7640 1 -- 172.21.15.63:0/772325683 learned_addr learned my addr 172.21.15.63:0/772325683 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06d89c6640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d413eda0 0x7f06d415d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.572+0000 7f06d99c8640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d415dd80 0x7f06d4140260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06d91c7640 1 -- 172.21.15.63:0/772325683 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d415dd80 msgr2=0x7f06d4140260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06d91c7640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d415dd80 0x7f06d4140260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06d91c7640 1 -- 172.21.15.63:0/772325683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d413eda0 msgr2=0x7f06d415d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06d91c7640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d413eda0 0x7f06d415d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06d91c7640 1 -- 172.21.15.63:0/772325683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d413e910 con 0x7f06c00039a0 2023-12-04T10:44:29.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06d91c7640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06d415a9d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c0e0 tx=0x7f06d0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:29.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06c9ffb640 1 -- 172.21.15.63:0/772325683 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d003c040 con 0x7f06c00039a0 2023-12-04T10:44:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06c9ffb640 1 -- 172.21.15.63:0/772325683 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0007270 con 0x7f06c00039a0 2023-12-04T10:44:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d4140e70 con 0x7f06c00039a0 2023-12-04T10:44:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.573+0000 7f06c9ffb640 1 -- 172.21.15.63:0/772325683 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d00075e0 con 0x7f06c00039a0 2023-12-04T10:44:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.574+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d413e5a0 con 0x7f06c00039a0 2023-12-04T10:44:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.575+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d4163f10 con 0x7f06c00039a0 2023-12-04T10:44:29.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.576+0000 7f06c9ffb640 1 -- 172.21.15.63:0/772325683 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f06d0032070 con 0x7f06c00039a0 2023-12-04T10:44:29.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.577+0000 7f06c9ffb640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f06b806ae40 0x7f06b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:29.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.577+0000 7f06c9ffb640 1 -- 172.21.15.63:0/772325683 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f06d00ab0c0 con 0x7f06c00039a0 2023-12-04T10:44:29.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.577+0000 7f06d89c6640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f06b806ae40 0x7f06b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:29.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.578+0000 7f06d89c6640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f06b806ae40 0x7f06b806d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06c4007fd0 tx=0x7f06c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:29.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.581+0000 7f06c9ffb640 1 -- 172.21.15.63:0/772325683 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f06d0075e70 con 0x7f06c00039a0 2023-12-04T10:44:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.780+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f06d4163f10 con 0x7f06c00039a0 2023-12-04T10:44:29.782 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.780+0000 7f06c9ffb640 1 -- 172.21.15.63:0/772325683 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f06d0079490 con 0x7f06c00039a0 2023-12-04T10:44:29.783 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:29.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f06b806ae40 msgr2=0x7f06b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f06b806ae40 0x7f06b806d300 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f06c4007fd0 tx=0x7f06c4009040 comp rx=0 tx=0).stop 2023-12-04T10:44:29.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 msgr2=0x7f06d415a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06d415a9d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c0e0 tx=0x7f06d0001930 comp rx=0 tx=0).stop 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 shutdown_connections 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f06b806ae40 0x7f06b806d300 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f06d415dd80 0x7f06d4140260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f06d413eda0 0x7f06d415d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 --2- 172.21.15.63:0/772325683 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f06c00039a0 0x7f06d415a9d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.783+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 >> 172.21.15.63:0/772325683 conn(0x7f06d40b0860 msgr2=0x7f06d40afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.784+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 shutdown_connections 2023-12-04T10:44:29.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:29.784+0000 7f06da1c9640 1 -- 172.21.15.63:0/772325683 wait complete. 2023-12-04T10:44:29.805 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:30.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.035+0000 7fa93b59e640 1 Processor -- start 2023-12-04T10:44:30.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.036+0000 7fa93b59e640 1 -- start start 2023-12-04T10:44:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.037+0000 7fa93b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa93c153be0 0x7fa93c15a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.037+0000 7fa93b59e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa93c06cb50 0x7fa93c15d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.037+0000 7fa93b59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa93c15bcd0 con 0x7fa93c06c6a0 2023-12-04T10:44:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.037+0000 7fa93b59e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93c0b2af0 con 0x7fa93c06cb50 2023-12-04T10:44:30.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.037+0000 7fa93b59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa93c15aac0 con 0x7fa93c153be0 2023-12-04T10:44:30.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.038+0000 7fa93ad9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa93c06cb50 0x7fa93c15d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.038+0000 7fa93ad9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa93c06cb50 0x7fa93c15d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34662/0 (socket says 172.21.15.63:34662) 2023-12-04T10:44:30.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.038+0000 7fa93ad9d640 1 -- 172.21.15.63:0/1777789659 learned_addr learned my addr 172.21.15.63:0/1777789659 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:30.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.038+0000 7fa93a59c640 1 --2- 172.21.15.63:0/1777789659 >> v2:172.21.15.66:3300/0 conn(0x7fa93c153be0 0x7fa93c15a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.038+0000 7fa93ad9d640 1 -- 172.21.15.63:0/1777789659 >> v2:172.21.15.66:3300/0 conn(0x7fa93c153be0 msgr2=0x7fa93c15a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:30.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.038+0000 7fa93ad9d640 1 --2- 172.21.15.63:0/1777789659 >> v2:172.21.15.66:3300/0 conn(0x7fa93c153be0 0x7fa93c15a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.038+0000 7fa93ad9d640 1 -- 172.21.15.63:0/1777789659 >> v1:172.21.15.66:6789/0 conn(0x7fa93c06c6a0 legacy=0x7fa93c15d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:30.041 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.038+0000 7fa93ad9d640 1 -- 172.21.15.63:0/1777789659 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa93c06cfe0 con 0x7fa93c06cb50 2023-12-04T10:44:30.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.040+0000 7fa93ad9d640 1 --2- 172.21.15.63:0/1777789659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06cb50 0x7fa93c15d800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0b18e0 tx=0x7fa93402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d709cfe82e5f9b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.040+0000 7fa939d9b640 1 -- 172.21.15.63:0/1777789659 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa93402ca80 con 0x7fa93c06cb50 2023-12-04T10:44:30.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.040+0000 7fa939d9b640 1 -- 172.21.15.63:0/1777789659 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa93402cbe0 con 0x7fa93c06cb50 2023-12-04T10:44:30.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.040+0000 7fa939d9b640 1 -- 172.21.15.63:0/1777789659 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9340343f0 con 0x7fa93c06cb50 2023-12-04T10:44:30.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.041+0000 7fa93b59e640 1 -- 172.21.15.63:0/1777789659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06cb50 msgr2=0x7fa93c15d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.041+0000 7fa93b59e640 1 --2- 172.21.15.63:0/1777789659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06cb50 0x7fa93c15d800 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa93c0b18e0 tx=0x7fa93402bee0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.041+0000 7fa93b59e640 1 -- 172.21.15.63:0/1777789659 shutdown_connections 2023-12-04T10:44:30.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.041+0000 7fa93b59e640 1 --2- 172.21.15.63:0/1777789659 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06cb50 0x7fa93c15d800 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.041+0000 7fa93b59e640 1 --2- 172.21.15.63:0/1777789659 >> v2:172.21.15.66:3300/0 conn(0x7fa93c153be0 0x7fa93c15a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.041+0000 7fa93b59e640 1 -- 172.21.15.63:0/1777789659 >> 172.21.15.63:0/1777789659 conn(0x7fa93c0b0860 msgr2=0x7fa93c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:30.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.041+0000 7fa93b59e640 1 -- 172.21.15.63:0/1777789659 shutdown_connections 2023-12-04T10:44:30.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.041+0000 7fa93b59e640 1 -- 172.21.15.63:0/1777789659 wait complete. 2023-12-04T10:44:30.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.043+0000 7fa93b59e640 1 Processor -- start 2023-12-04T10:44:30.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.043+0000 7fa93b59e640 1 -- start start 2023-12-04T10:44:30.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.044+0000 7fa93b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06c6a0 0x7fa93c148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.046 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.044+0000 7fa93b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa93c06cb50 0x7fa93c167f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.044+0000 7fa93b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa93c153be0 0x7fa93c0ac640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.044+0000 7fa93b59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0a98c0 con 0x7fa93c06c6a0 2023-12-04T10:44:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.044+0000 7fa93b59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c148e50 con 0x7fa93c153be0 2023-12-04T10:44:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.044+0000 7fa93b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93c0a9300 con 0x7fa93c06cb50 2023-12-04T10:44:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06c6a0 0x7fa93c148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06c6a0 0x7fa93c148910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34666/0 (socket says 172.21.15.63:34666) 2023-12-04T10:44:30.047 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 -- 172.21.15.63:0/3232432644 learned_addr learned my addr 172.21.15.63:0/3232432644 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 -- 172.21.15.63:0/3232432644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa93c06cb50 msgr2=0x7fa93c167f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa93c06cb50 0x7fa93c167f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 -- 172.21.15.63:0/3232432644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa93c153be0 msgr2=0x7fa93c0ac640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93ad9d640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa93c153be0 0x7fa93c0ac640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa93c153be0 0x7fa93c0ac640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 -- 172.21.15.63:0/3232432644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa934009b30 con 0x7fa93c06c6a0 2023-12-04T10:44:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.045+0000 7fa93a59c640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06c6a0 0x7fa93c148910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00c7f0 tx=0x7fa92c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.046+0000 7fa932ffd640 1 -- 172.21.15.63:0/3232432644 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c004220 con 0x7fa93c06c6a0 2023-12-04T10:44:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.046+0000 7fa932ffd640 1 -- 172.21.15.63:0/3232432644 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92c0043a0 con 0x7fa93c06c6a0 2023-12-04T10:44:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.046+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa93c0a95e0 con 0x7fa93c06c6a0 2023-12-04T10:44:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.046+0000 7fa932ffd640 1 -- 172.21.15.63:0/3232432644 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92c007860 con 0x7fa93c06c6a0 2023-12-04T10:44:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.046+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa93c0aa0c0 con 0x7fa93c06c6a0 2023-12-04T10:44:30.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.047+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa93c04e840 con 0x7fa93c06c6a0 2023-12-04T10:44:30.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.048+0000 7fa932ffd640 1 -- 172.21.15.63:0/3232432644 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa92c007bd0 con 0x7fa93c06c6a0 2023-12-04T10:44:30.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.050+0000 7fa932ffd640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa91c06ae40 0x7fa91c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.050+0000 7fa932ffd640 1 -- 172.21.15.63:0/3232432644 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa92c089970 con 0x7fa93c06c6a0 2023-12-04T10:44:30.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.050+0000 7fa933fff640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa91c06ae40 0x7fa91c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.052 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.051+0000 7fa933fff640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa91c06ae40 0x7fa91c06d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa93c153130 tx=0x7fa924006b90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.055+0000 7fa932ffd640 1 -- 172.21.15.63:0/3232432644 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa92c054690 con 0x7fa93c06c6a0 2023-12-04T10:44:30.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.252+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa93c06d670 con 0x7fa93c06c6a0 2023-12-04T10:44:30.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.253+0000 7fa932ffd640 1 -- 172.21.15.63:0/3232432644 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa92c01e0a0 con 0x7fa93c06c6a0 2023-12-04T10:44:30.255 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:44:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.255+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa91c06ae40 msgr2=0x7fa91c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.255+0000 7fa93b59e640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa91c06ae40 0x7fa91c06d300 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa93c153130 tx=0x7fa924006b90 comp rx=0 tx=0).stop 2023-12-04T10:44:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.255+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06c6a0 msgr2=0x7fa93c148910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.255+0000 7fa93b59e640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06c6a0 0x7fa93c148910 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa92c00c7f0 tx=0x7fa92c00ccb0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.256+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 shutdown_connections 2023-12-04T10:44:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.256+0000 7fa93b59e640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa91c06ae40 0x7fa91c06d300 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.256+0000 7fa93b59e640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa93c06cb50 0x7fa93c167f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.256+0000 7fa93b59e640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa93c153be0 0x7fa93c0ac640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.256+0000 7fa93b59e640 1 --2- 172.21.15.63:0/3232432644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa93c06c6a0 0x7fa93c148910 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.256+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 >> 172.21.15.63:0/3232432644 conn(0x7fa93c0b0860 msgr2=0x7fa93c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.256+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 shutdown_connections 2023-12-04T10:44:30.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.256+0000 7fa93b59e640 1 -- 172.21.15.63:0/3232432644 wait complete. 2023-12-04T10:44:30.278 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:44:30.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.504+0000 7f4c3cba5640 1 Processor -- start 2023-12-04T10:44:30.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.504+0000 7f4c3cba5640 1 -- start start 2023-12-04T10:44:30.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c3cba5640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f4c380701b0 0x7f4c380705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c3cba5640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c380ca290 0x7f4c380ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c3cba5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c38070b00 con 0x7f4c38144a00 2023-12-04T10:44:30.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c3cba5640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c380cabe0 con 0x7f4c380ca290 2023-12-04T10:44:30.508 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c3cba5640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c380cae80 con 0x7f4c380701b0 2023-12-04T10:44:30.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c36d9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c380ca290 0x7f4c380ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c36d9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f4c380ca290 0x7f4c380ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34678/0 (socket says 172.21.15.63:34678) 2023-12-04T10:44:30.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c36d9d640 1 -- 172.21.15.63:0/2768621207 learned_addr learned my addr 172.21.15.63:0/2768621207 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:30.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.506+0000 7f4c2dd9b640 1 --2- 172.21.15.63:0/2768621207 >> v2:172.21.15.66:3300/0 conn(0x7f4c380701b0 0x7f4c380705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.507+0000 7f4c36d9d640 1 -- 172.21.15.63:0/2768621207 >> v2:172.21.15.66:3300/0 conn(0x7f4c380701b0 msgr2=0x7f4c380705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:30.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.507+0000 7f4c36d9d640 1 --2- 172.21.15.63:0/2768621207 >> v2:172.21.15.66:3300/0 conn(0x7f4c380701b0 0x7f4c380705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.507+0000 7f4c36d9d640 1 -- 172.21.15.63:0/2768621207 >> v1:172.21.15.66:6789/0 conn(0x7f4c38144a00 legacy=0x7f4c380b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.509 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.507+0000 7f4c36d9d640 1 -- 172.21.15.63:0/2768621207 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3806c460 con 0x7f4c380ca290 2023-12-04T10:44:30.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.508+0000 7f4c36d9d640 1 --2- 172.21.15.63:0/2768621207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380ca290 0x7f4c380ca6a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4c380cb3d0 tx=0x7f4c3002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5df298164c25dbe server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.508+0000 7f4c35d9b640 1 -- 172.21.15.63:0/2768621207 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3002cb20 con 0x7f4c380ca290 2023-12-04T10:44:30.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.508+0000 7f4c35d9b640 1 -- 172.21.15.63:0/2768621207 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3002cc80 con 0x7f4c380ca290 2023-12-04T10:44:30.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.508+0000 7f4c35d9b640 1 -- 172.21.15.63:0/2768621207 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c300343f0 con 0x7f4c380ca290 2023-12-04T10:44:30.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.509+0000 7f4c3cba5640 1 -- 172.21.15.63:0/2768621207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380ca290 msgr2=0x7f4c380ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.509+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/2768621207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380ca290 0x7f4c380ca6a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f4c380cb3d0 tx=0x7f4c3002bf80 comp rx=0 tx=0).stop 2023-12-04T10:44:30.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.509+0000 7f4c3cba5640 1 -- 172.21.15.63:0/2768621207 shutdown_connections 2023-12-04T10:44:30.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.509+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/2768621207 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380ca290 0x7f4c380ca6a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.509+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/2768621207 >> v2:172.21.15.66:3300/0 conn(0x7f4c380701b0 0x7f4c380705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.509+0000 7f4c3cba5640 1 -- 172.21.15.63:0/2768621207 >> 172.21.15.63:0/2768621207 conn(0x7f4c380cee80 msgr2=0x7f4c380cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:30.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.509+0000 7f4c3cba5640 1 -- 172.21.15.63:0/2768621207 shutdown_connections 2023-12-04T10:44:30.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.509+0000 7f4c3cba5640 1 -- 172.21.15.63:0/2768621207 wait complete. 2023-12-04T10:44:30.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.511+0000 7f4c3cba5640 1 Processor -- start 2023-12-04T10:44:30.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.511+0000 7f4c3cba5640 1 -- start start 2023-12-04T10:44:30.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3cba5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380701b0 0x7f4c3813b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3cba5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c380ca290 0x7f4c381e0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3cba5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c38144a00 0x7f4c381e14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3cba5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3813dce0 con 0x7f4c380701b0 2023-12-04T10:44:30.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3cba5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c381e0950 con 0x7f4c380ca290 2023-12-04T10:44:30.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3cba5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c380ce040 con 0x7f4c38144a00 2023-12-04T10:44:30.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380701b0 0x7f4c3813b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380701b0 0x7f4c3813b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34688/0 (socket says 172.21.15.63:34688) 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.512+0000 7f4c3659c640 1 -- 172.21.15.63:0/3521929321 learned_addr learned my addr 172.21.15.63:0/3521929321 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.513+0000 7f4c3659c640 1 -- 172.21.15.63:0/3521929321 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c38144a00 msgr2=0x7f4c381e14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.513+0000 7f4c3659c640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c38144a00 0x7f4c381e14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.513+0000 7f4c3659c640 1 -- 172.21.15.63:0/3521929321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c380ca290 msgr2=0x7f4c381e0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.513+0000 7f4c3659c640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c380ca290 0x7f4c381e0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.513+0000 7f4c3659c640 1 -- 172.21.15.63:0/3521929321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c30009b30 con 0x7f4c380701b0 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.513+0000 7f4c3659c640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380701b0 0x7f4c3813b970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800c400 tx=0x7f4c2800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.513+0000 7f4c2f7fe640 1 -- 172.21.15.63:0/3521929321 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c280052d0 con 0x7f4c380701b0 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.514+0000 7f4c2f7fe640 1 -- 172.21.15.63:0/3521929321 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c28005430 con 0x7f4c380701b0 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.514+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c380ce320 con 0x7f4c380701b0 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.514+0000 7f4c2f7fe640 1 -- 172.21.15.63:0/3521929321 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c28003830 con 0x7f4c380701b0 2023-12-04T10:44:30.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.514+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c3813d900 con 0x7f4c380701b0 2023-12-04T10:44:30.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.515+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c3813de20 con 0x7f4c380701b0 2023-12-04T10:44:30.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.516+0000 7f4c2f7fe640 1 -- 172.21.15.63:0/3521929321 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4c28003990 con 0x7f4c380701b0 2023-12-04T10:44:30.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.517+0000 7f4c2f7fe640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4c1806ae40 0x7f4c1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.517+0000 7f4c2f7fe640 1 -- 172.21.15.63:0/3521929321 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4c28088e20 con 0x7f4c380701b0 2023-12-04T10:44:30.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.517+0000 7f4c2dd9b640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4c1806ae40 0x7f4c1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.518+0000 7f4c2dd9b640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4c1806ae40 0x7f4c1806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4c20006a90 tx=0x7f4c20006a20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.521+0000 7f4c2f7fe640 1 -- 172.21.15.63:0/3521929321 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4c28053bd0 con 0x7f4c380701b0 2023-12-04T10:44:30.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.714+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f4c38068710 con 0x7f4c380701b0 2023-12-04T10:44:30.716 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.714+0000 7f4c2f7fe640 1 -- 172.21.15.63:0/3521929321 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f4c280170a0 con 0x7f4c380701b0 2023-12-04T10:44:30.716 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4c1806ae40 msgr2=0x7f4c1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4c1806ae40 0x7f4c1806d300 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4c20006a90 tx=0x7f4c20006a20 comp rx=0 tx=0).stop 2023-12-04T10:44:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380701b0 msgr2=0x7f4c3813b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380701b0 0x7f4c3813b970 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f4c2800c400 tx=0x7f4c2800c8c0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 shutdown_connections 2023-12-04T10:44:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f4c1806ae40 0x7f4c1806d300 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f4c38144a00 0x7f4c381e14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f4c380ca290 0x7f4c381e0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 --2- 172.21.15.63:0/3521929321 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f4c380701b0 0x7f4c3813b970 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 >> 172.21.15.63:0/3521929321 conn(0x7f4c380cee80 msgr2=0x7f4c380c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:30.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 shutdown_connections 2023-12-04T10:44:30.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.717+0000 7f4c3cba5640 1 -- 172.21.15.63:0/3521929321 wait complete. 2023-12-04T10:44:30.740 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:44:30.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.954+0000 7ff8bf675640 1 Processor -- start 2023-12-04T10:44:30.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.954+0000 7ff8bf675640 1 -- start start 2023-12-04T10:44:30.957 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.956+0000 7ff8bf675640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b80ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.956+0000 7ff8bf675640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff8b80ce210 0x7ff8b806c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.956+0000 7ff8bf675640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b80ca930 con 0x7ff8b80724e0 2023-12-04T10:44:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.956+0000 7ff8bf675640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b80cb5b0 con 0x7ff8b80ce210 2023-12-04T10:44:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.956+0000 7ff8bf675640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80cac10 con 0x7ff8b8143b60 2023-12-04T10:44:30.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.956+0000 7ff8bdc12640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff8b80ce210 0x7ff8b806c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.956+0000 7ff8bd411640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b80ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.957+0000 7ff8bcc10640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7ff8b80724e0 0x7ff8b80cdb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:52748/0 (socket says 172.21.15.63:52748) 2023-12-04T10:44:30.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.957+0000 7ff8bcc10640 1 -- 172.21.15.63:0/1501824202 learned_addr learned my addr 172.21.15.63:0/1501824202 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:30.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.957+0000 7ff8affff640 1 -- 172.21.15.63:0/1501824202 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2218994009 0 0) 0x7ff8b80ca930 con 0x7ff8b80724e0 2023-12-04T10:44:30.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.957+0000 7ff8affff640 1 -- 172.21.15.63:0/1501824202 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8a4003520 con 0x7ff8b80724e0 2023-12-04T10:44:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.958+0000 7ff8bd411640 1 -- 172.21.15.63:0/1501824202 >> v2:172.21.15.66:3300/0 conn(0x7ff8b80ce210 msgr2=0x7ff8b806c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.958+0000 7ff8bd411640 1 --2- 172.21.15.63:0/1501824202 >> v2:172.21.15.66:3300/0 conn(0x7ff8b80ce210 0x7ff8b806c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.958+0000 7ff8bd411640 1 -- 172.21.15.63:0/1501824202 >> v1:172.21.15.66:6789/0 conn(0x7ff8b80724e0 legacy=0x7ff8b80cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.958+0000 7ff8bd411640 1 -- 172.21.15.63:0/1501824202 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b80caef0 con 0x7ff8b8143b60 2023-12-04T10:44:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.959+0000 7ff8bd411640 1 --2- 172.21.15.63:0/1501824202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b80ca330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009d90 tx=0x7ff8b402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f16d8b1d57de18cf server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8affff640 1 -- 172.21.15.63:0/1501824202 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b402cc50 con 0x7ff8b8143b60 2023-12-04T10:44:30.961 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8affff640 1 -- 172.21.15.63:0/1501824202 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b402cdb0 con 0x7ff8b8143b60 2023-12-04T10:44:30.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8affff640 1 -- 172.21.15.63:0/1501824202 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4034660 con 0x7ff8b8143b60 2023-12-04T10:44:30.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8bf675640 1 -- 172.21.15.63:0/1501824202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 msgr2=0x7ff8b80ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8bf675640 1 --2- 172.21.15.63:0/1501824202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b80ca330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009d90 tx=0x7ff8b402bea0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8bf675640 1 -- 172.21.15.63:0/1501824202 shutdown_connections 2023-12-04T10:44:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8bf675640 1 --2- 172.21.15.63:0/1501824202 >> v2:172.21.15.66:3300/0 conn(0x7ff8b80ce210 0x7ff8b806c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8bf675640 1 --2- 172.21.15.63:0/1501824202 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b80ca330 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8bf675640 1 -- 172.21.15.63:0/1501824202 >> 172.21.15.63:0/1501824202 conn(0x7ff8b80cee80 msgr2=0x7ff8b80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.960+0000 7ff8bf675640 1 -- 172.21.15.63:0/1501824202 shutdown_connections 2023-12-04T10:44:30.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.961+0000 7ff8bf675640 1 -- 172.21.15.63:0/1501824202 wait complete. 2023-12-04T10:44:30.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.963+0000 7ff8bf675640 1 Processor -- start 2023-12-04T10:44:30.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.963+0000 7ff8bf675640 1 -- start start 2023-12-04T10:44:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.964+0000 7ff8bf675640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b80ce210 0x7ff8b81f2430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.964+0000 7ff8bf675640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b81352c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.964+0000 7ff8bf675640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b8133230 0x7ff8b8135800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.964+0000 7ff8bf675640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b815c6a0 con 0x7ff8b80ce210 2023-12-04T10:44:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.964+0000 7ff8bf675640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b80b4440 con 0x7ff8b8133230 2023-12-04T10:44:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.964+0000 7ff8bf675640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b815bfe0 con 0x7ff8b8143b60 2023-12-04T10:44:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bd411640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b80ce210 0x7ff8b81f2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bd411640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b80ce210 0x7ff8b81f2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34700/0 (socket says 172.21.15.63:34700) 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bd411640 1 -- 172.21.15.63:0/3218813277 learned_addr learned my addr 172.21.15.63:0/3218813277 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bcc10640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b81352c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bd411640 1 -- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 msgr2=0x7ff8b81352c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bd411640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b81352c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bd411640 1 -- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b8133230 msgr2=0x7ff8b8135800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bdc12640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b8133230 0x7ff8b8135800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bd411640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b8133230 0x7ff8b8135800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bd411640 1 -- 172.21.15.63:0/3218813277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b4009a70 con 0x7ff8b80ce210 2023-12-04T10:44:30.968 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.965+0000 7ff8bcc10640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b81352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.966+0000 7ff8bd411640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b80ce210 0x7ff8b81f2430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009d90 tx=0x7ff8b4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.966+0000 7ff8adffb640 1 -- 172.21.15.63:0/3218813277 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4040650 con 0x7ff8b80ce210 2023-12-04T10:44:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.966+0000 7ff8adffb640 1 -- 172.21.15.63:0/3218813277 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b40407b0 con 0x7ff8b80ce210 2023-12-04T10:44:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.966+0000 7ff8adffb640 1 -- 172.21.15.63:0/3218813277 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b4040b60 con 0x7ff8b80ce210 2023-12-04T10:44:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.966+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b815c2c0 con 0x7ff8b80ce210 2023-12-04T10:44:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.966+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b81f2970 con 0x7ff8b80ce210 2023-12-04T10:44:30.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.967+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b80cea20 con 0x7ff8b80ce210 2023-12-04T10:44:30.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.968+0000 7ff8adffb640 1 -- 172.21.15.63:0/3218813277 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff8b4040cc0 con 0x7ff8b80ce210 2023-12-04T10:44:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.969+0000 7ff8adffb640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff89c06ae40 0x7ff89c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.969+0000 7ff8adffb640 1 -- 172.21.15.63:0/3218813277 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff8b40ac610 con 0x7ff8b80ce210 2023-12-04T10:44:30.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.970+0000 7ff8bcc10640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff89c06ae40 0x7ff89c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:30.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.971+0000 7ff8bcc10640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff89c06ae40 0x7ff89c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8133100 tx=0x7ff8a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:30.976 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:30.974+0000 7ff8adffb640 1 -- 172.21.15.63:0/3218813277 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff8b4077490 con 0x7ff8b80ce210 2023-12-04T10:44:31.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.207+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8b8068710 con 0x7ff8b80ce210 2023-12-04T10:44:31.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.208+0000 7ff8adffb640 1 -- 172.21.15.63:0/3218813277 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7ff8b4009450 con 0x7ff8b80ce210 2023-12-04T10:44:31.211 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:31.211 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:44:21.556693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T10:44:31.211 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2023-12-04T10:44:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff89c06ae40 msgr2=0x7ff89c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff89c06ae40 0x7ff89c06d300 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff8b8133100 tx=0x7ff8a8009040 comp rx=0 tx=0).stop 2023-12-04T10:44:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b80ce210 msgr2=0x7ff8b81f2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b80ce210 0x7ff8b81f2430 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff8b4009d90 tx=0x7ff8b4004a40 comp rx=0 tx=0).stop 2023-12-04T10:44:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 shutdown_connections 2023-12-04T10:44:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff89c06ae40 0x7ff89c06d300 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff8b8143b60 0x7ff8b81352c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff8b8133230 0x7ff8b8135800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 --2- 172.21.15.63:0/3218813277 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff8b80ce210 0x7ff8b81f2430 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 >> 172.21.15.63:0/3218813277 conn(0x7ff8b80cee80 msgr2=0x7ff8b806c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 shutdown_connections 2023-12-04T10:44:31.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.211+0000 7ff8bf675640 1 -- 172.21.15.63:0/3218813277 wait complete. 2023-12-04T10:44:31.232 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.461+0000 7f6102928640 1 Processor -- start 2023-12-04T10:44:31.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.461+0000 7f6102928640 1 -- start start 2023-12-04T10:44:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.462+0000 7f6102928640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60fc15b470 0x7f60fc0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.462+0000 7f6102928640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f60fc06c0f0 0x7f60fc0cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.462+0000 7f6102928640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60fc0cc7f0 con 0x7f60fc151ca0 2023-12-04T10:44:31.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.462+0000 7f6102928640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60fc06e280 con 0x7f60fc06c0f0 2023-12-04T10:44:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.462+0000 7f6102928640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0cca40 con 0x7f60fc15b470 2023-12-04T10:44:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.463+0000 7f6101926640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f60fc151ca0 0x7f60fc06db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43836/0 (socket says 172.21.15.63:43836) 2023-12-04T10:44:31.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.463+0000 7f6101926640 1 -- 172.21.15.63:0/3441684807 learned_addr learned my addr 172.21.15.63:0/3441684807 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.463+0000 7f6102127640 1 --2- 172.21.15.63:0/3441684807 >> v2:172.21.15.66:3300/0 conn(0x7f60fc06c0f0 0x7f60fc0cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.463+0000 7f6101125640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60fc15b470 0x7f60fc0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.463+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3945236209 0 0) 0x7f60fc0cc7f0 con 0x7f60fc151ca0 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.463+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60ec003520 con 0x7f60fc151ca0 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2801632200 0 0) 0x7f60ec003520 con 0x7f60fc151ca0 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60fc15b470 msgr2=0x7f60fc0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60fc15b470 0x7f60fc0cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 >> v2:172.21.15.66:3300/0 conn(0x7f60fc06c0f0 msgr2=0x7f60fc0cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 --2- 172.21.15.63:0/3441684807 >> v2:172.21.15.66:3300/0 conn(0x7f60fc06c0f0 0x7f60fc0cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0ccd20 con 0x7f60fc151ca0 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f60f00019f0 con 0x7f60fc151ca0 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 >> v1:172.21.15.63:6789/0 conn(0x7f60fc151ca0 legacy=0x7f60fc06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec003970 0x7f60ec003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ec0047c0 0x7f60ec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec005180 0x7f60ec00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc06e280 con 0x7f60ec0047c0 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0cca40 con 0x7f60ec005180 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ec00c0a0 con 0x7f60ec003970 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6101125640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60fc15b470 0x7f60fc0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6102127640 1 --2- 172.21.15.63:0/3441684807 >> v2:172.21.15.66:3300/0 conn(0x7f60fc06c0f0 0x7f60fc0cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:31.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6101125640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ec0047c0 0x7f60ec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6101926640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec003970 0x7f60ec003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6102127640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec005180 0x7f60ec00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6101125640 1 -- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec003970 msgr2=0x7f60ec003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.464+0000 7f6101125640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec003970 0x7f60ec003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.465+0000 7f6101125640 1 -- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec005180 msgr2=0x7f60ec00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.465+0000 7f6101125640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60ec005180 0x7f60ec00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.465+0000 7f6101125640 1 -- 172.21.15.63:0/3441684807 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ec003520 con 0x7f60ec0047c0 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.465+0000 7f6101926640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec003970 0x7f60ec003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.466+0000 7f6101125640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ec0047c0 0x7f60ec004c40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f60e8006fd0 tx=0x7f60ec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e2a7cd2d62964c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.466+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8033600 con 0x7f60ec0047c0 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.466+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e802f050 con 0x7f60ec0047c0 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.466+0000 7f6100924640 1 -- 172.21.15.63:0/3441684807 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e8033980 con 0x7f60ec0047c0 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.466+0000 7f6102928640 1 -- 172.21.15.63:0/3441684807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ec0047c0 msgr2=0x7f60ec004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.466+0000 7f6102928640 1 --2- 172.21.15.63:0/3441684807 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60ec0047c0 0x7f60ec004c40 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f60e8006fd0 tx=0x7f60ec0057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.467+0000 7f6102127640 1 -- 172.21.15.63:0/3441684807 reap_dead start 2023-12-04T10:44:31.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.467+0000 7f6102928640 1 -- 172.21.15.63:0/3441684807 shutdown_connections 2023-12-04T10:44:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.467+0000 7f6102928640 1 -- 172.21.15.63:0/3441684807 >> 172.21.15.63:0/3441684807 conn(0x7f60fc0b07f0 msgr2=0x7f60fc0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.467+0000 7f6102928640 1 -- 172.21.15.63:0/3441684807 shutdown_connections 2023-12-04T10:44:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.467+0000 7f6102928640 1 -- 172.21.15.63:0/3441684807 wait complete. 2023-12-04T10:44:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.469+0000 7f6102928640 1 Processor -- start 2023-12-04T10:44:31.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.469+0000 7f6102928640 1 -- start start 2023-12-04T10:44:31.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102928640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 0x7f60fc0cb7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102928640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60fc150470 0x7f60fc0cab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102928640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60fc14f750 0x7f60fc14fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102928640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0c55c0 con 0x7f60fc14f750 2023-12-04T10:44:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102928640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc150140 con 0x7f60fc150470 2023-12-04T10:44:31.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102928640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60fc0c49b0 con 0x7f60ec0047c0 2023-12-04T10:44:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102127640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60fc14f750 0x7f60fc14fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102127640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60fc14f750 0x7f60fc14fc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34732/0 (socket says 172.21.15.63:34732) 2023-12-04T10:44:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6102127640 1 -- 172.21.15.63:0/2475846608 learned_addr learned my addr 172.21.15.63:0/2475846608 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6101125640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60fc150470 0x7f60fc0cab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.470+0000 7f6101926640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 0x7f60fc0cb7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f6102127640 1 -- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 msgr2=0x7f60fc0cb7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f6102127640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 0x7f60fc0cb7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f6102127640 1 -- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60fc150470 msgr2=0x7f60fc0cab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f6102127640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60fc150470 0x7f60fc0cab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f6102127640 1 -- 172.21.15.63:0/2475846608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60fc0c4c90 con 0x7f60fc14f750 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f6101926640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 0x7f60fc0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f6102127640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60fc14f750 0x7f60fc14fc00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006fd0 tx=0x7f60f400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f60fa7fc640 1 -- 172.21.15.63:0/2475846608 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4014680 con 0x7f60fc14f750 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f60fa7fc640 1 -- 172.21.15.63:0/2475846608 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60f400c030 con 0x7f60fc14f750 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f60fa7fc640 1 -- 172.21.15.63:0/2475846608 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60f4014a40 con 0x7f60fc14f750 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.471+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60fc0c4f70 con 0x7f60fc14f750 2023-12-04T10:44:31.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.472+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60fc0cbd20 con 0x7f60fc14f750 2023-12-04T10:44:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.473+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60fc0c5730 con 0x7f60fc14f750 2023-12-04T10:44:31.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.474+0000 7f60fa7fc640 1 -- 172.21.15.63:0/2475846608 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60f4014ba0 con 0x7f60fc14f750 2023-12-04T10:44:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.474+0000 7f60fa7fc640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f60e006ae70 0x7f60e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.476 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.475+0000 7f60fa7fc640 1 -- 172.21.15.63:0/2475846608 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60f4089730 con 0x7f60fc14f750 2023-12-04T10:44:31.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.475+0000 7f6101926640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f60e006ae70 0x7f60e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.477 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.475+0000 7f6101926640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f60e006ae70 0x7f60e006d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000f80 tx=0x7f60f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:31.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.479+0000 7f60fa7fc640 1 -- 172.21.15.63:0/2475846608 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60f40544f0 con 0x7f60fc14f750 2023-12-04T10:44:31.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.674+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60fc0cbeb0 con 0x7f60fc14f750 2023-12-04T10:44:31.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.676+0000 7f60fa7fc640 1 -- 172.21.15.63:0/2475846608 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7f60f4057b10 con 0x7f60fc14f750 2023-12-04T10:44:31.678 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:31.678 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.678+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f60e006ae70 msgr2=0x7f60e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.678+0000 7f6102928640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f60e006ae70 0x7f60e006d330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60f0000f80 tx=0x7f60f0009040 comp rx=0 tx=0).stop 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.678+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60fc14f750 msgr2=0x7f60fc14fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.678+0000 7f6102928640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60fc14f750 0x7f60fc14fc00 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f60f4006fd0 tx=0x7f60f400f670 comp rx=0 tx=0).stop 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.679+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 shutdown_connections 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.679+0000 7f6102928640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f60e006ae70 0x7f60e006d330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.679+0000 7f6102928640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f60fc14f750 0x7f60fc14fc00 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.679+0000 7f6102928640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60fc150470 0x7f60fc0cab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.679+0000 7f6102928640 1 --2- 172.21.15.63:0/2475846608 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f60ec0047c0 0x7f60fc0cb7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.679+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 >> 172.21.15.63:0/2475846608 conn(0x7f60fc0b07f0 msgr2=0x7f60fc070f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:31.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.679+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 shutdown_connections 2023-12-04T10:44:31.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.679+0000 7f6102928640 1 -- 172.21.15.63:0/2475846608 wait complete. 2023-12-04T10:44:31.701 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:31.702 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:31.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.919+0000 7fde4359e640 1 Processor -- start 2023-12-04T10:44:31.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.919+0000 7fde4359e640 1 -- start start 2023-12-04T10:44:31.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.921+0000 7fde4359e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde44143950 0x7fde4406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.921+0000 7fde4359e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde4415b280 con 0x7fde440b3790 2023-12-04T10:44:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.921+0000 7fde4359e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde440b26f0 con 0x7fde4406dcf0 2023-12-04T10:44:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.921+0000 7fde4359e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde440b29d0 con 0x7fde44143950 2023-12-04T10:44:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.921+0000 7fde3bfff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fde440b3790 0x7fde4415a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43838/0 (socket says 172.21.15.63:43838) 2023-12-04T10:44:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.921+0000 7fde4259c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fde44143950 0x7fde4406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.921+0000 7fde3bfff640 1 -- 172.21.15.63:0/1571170994 learned_addr learned my addr 172.21.15.63:0/1571170994 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.922+0000 7fde41d9b640 1 -- 172.21.15.63:0/1571170994 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786038174 0 0) 0x7fde4415b280 con 0x7fde440b3790 2023-12-04T10:44:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.922+0000 7fde41d9b640 1 -- 172.21.15.63:0/1571170994 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde30005730 con 0x7fde440b3790 2023-12-04T10:44:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.922+0000 7fde4259c640 1 -- 172.21.15.63:0/1571170994 >> v1:172.21.15.66:6789/0 conn(0x7fde4406dcf0 legacy=0x7fde44070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.922+0000 7fde4259c640 1 -- 172.21.15.63:0/1571170994 >> v1:172.21.15.63:6789/0 conn(0x7fde440b3790 legacy=0x7fde4415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.924 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.922+0000 7fde4259c640 1 -- 172.21.15.63:0/1571170994 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde440b2cb0 con 0x7fde44143950 2023-12-04T10:44:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.923+0000 7fde4259c640 1 --2- 172.21.15.63:0/1571170994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44143950 0x7fde4406d7b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fde340097a0 tx=0x7fde3402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdd951b795c8b90 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.924+0000 7fde41d9b640 1 -- 172.21.15.63:0/1571170994 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34030610 con 0x7fde44143950 2023-12-04T10:44:31.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.924+0000 7fde41d9b640 1 -- 172.21.15.63:0/1571170994 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde34030770 con 0x7fde44143950 2023-12-04T10:44:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.924+0000 7fde41d9b640 1 -- 172.21.15.63:0/1571170994 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde34030b00 con 0x7fde44143950 2023-12-04T10:44:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.924+0000 7fde4359e640 1 -- 172.21.15.63:0/1571170994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44143950 msgr2=0x7fde4406d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.924+0000 7fde4359e640 1 --2- 172.21.15.63:0/1571170994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44143950 0x7fde4406d7b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fde340097a0 tx=0x7fde3402b960 comp rx=0 tx=0).stop 2023-12-04T10:44:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.924+0000 7fde4359e640 1 -- 172.21.15.63:0/1571170994 shutdown_connections 2023-12-04T10:44:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.924+0000 7fde4359e640 1 --2- 172.21.15.63:0/1571170994 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde44143950 0x7fde4406d7b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.924+0000 7fde4359e640 1 -- 172.21.15.63:0/1571170994 >> 172.21.15.63:0/1571170994 conn(0x7fde440b0860 msgr2=0x7fde440b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.925+0000 7fde4359e640 1 -- 172.21.15.63:0/1571170994 shutdown_connections 2023-12-04T10:44:31.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.925+0000 7fde4359e640 1 -- 172.21.15.63:0/1571170994 wait complete. 2023-12-04T10:44:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.926+0000 7fde4359e640 1 Processor -- start 2023-12-04T10:44:31.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.926+0000 7fde4359e640 1 -- start start 2023-12-04T10:44:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.927+0000 7fde4359e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde4406dcf0 0x7fde44159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.927+0000 7fde4359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde44143950 0x7fde4415d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.927+0000 7fde4359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde4415dea0 0x7fde440afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.927+0000 7fde4359e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4413ff20 con 0x7fde4415dea0 2023-12-04T10:44:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.927+0000 7fde4359e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde44140190 con 0x7fde44143950 2023-12-04T10:44:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.927+0000 7fde4359e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde44140470 con 0x7fde4406dcf0 2023-12-04T10:44:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde4415dea0 0x7fde440afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde4415dea0 0x7fde440afcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34740/0 (socket says 172.21.15.63:34740) 2023-12-04T10:44:31.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 -- 172.21.15.63:0/835919387 learned_addr learned my addr 172.21.15.63:0/835919387 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde3bfff640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde44143950 0x7fde4415d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde4259c640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde4406dcf0 0x7fde44159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 -- 172.21.15.63:0/835919387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde4406dcf0 msgr2=0x7fde44159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde4406dcf0 0x7fde44159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 -- 172.21.15.63:0/835919387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde44143950 msgr2=0x7fde4415d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde44143950 0x7fde4415d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 -- 172.21.15.63:0/835919387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde34009400 con 0x7fde4415dea0 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.928+0000 7fde42d9d640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde4415dea0 0x7fde440afcf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c730 tx=0x7fde3c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.929+0000 7fde3affd640 1 -- 172.21.15.63:0/835919387 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c003b70 con 0x7fde4415dea0 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.929+0000 7fde3affd640 1 -- 172.21.15.63:0/835919387 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c003cd0 con 0x7fde4415dea0 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.929+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde44140750 con 0x7fde4415dea0 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.929+0000 7fde3affd640 1 -- 172.21.15.63:0/835919387 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c00aa90 con 0x7fde4415dea0 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.929+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde44159c90 con 0x7fde4415dea0 2023-12-04T10:44:31.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.930+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde4404e840 con 0x7fde4415dea0 2023-12-04T10:44:31.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.931+0000 7fde3affd640 1 -- 172.21.15.63:0/835919387 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fde3c00abf0 con 0x7fde4415dea0 2023-12-04T10:44:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.932+0000 7fde3affd640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fde2406ae40 0x7fde2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.932+0000 7fde3affd640 1 -- 172.21.15.63:0/835919387 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fde3c0897c0 con 0x7fde4415dea0 2023-12-04T10:44:31.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.932+0000 7fde4259c640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fde2406ae40 0x7fde2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:31.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.933+0000 7fde4259c640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fde2406ae40 0x7fde2406d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fde34036000 tx=0x7fde3403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:31.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:31.936+0000 7fde3affd640 1 -- 172.21.15.63:0/835919387 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fde3c0544e0 con 0x7fde4415dea0 2023-12-04T10:44:32.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.130+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fde44140940 con 0x7fde4415dea0 2023-12-04T10:44:32.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.131+0000 7fde3affd640 1 -- 172.21.15.63:0/835919387 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fde3c057b00 con 0x7fde4415dea0 2023-12-04T10:44:32.133 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:32.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fde2406ae40 msgr2=0x7fde2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fde2406ae40 0x7fde2406d300 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fde34036000 tx=0x7fde3403b040 comp rx=0 tx=0).stop 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde4415dea0 msgr2=0x7fde440afcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde4415dea0 0x7fde440afcf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fde3c00c730 tx=0x7fde3c00cbf0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 shutdown_connections 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fde2406ae40 0x7fde2406d300 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fde4415dea0 0x7fde440afcf0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fde44143950 0x7fde4415d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 --2- 172.21.15.63:0/835919387 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fde4406dcf0 0x7fde44159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 >> 172.21.15.63:0/835919387 conn(0x7fde440b0860 msgr2=0x7fde4406c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.134+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 shutdown_connections 2023-12-04T10:44:32.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.135+0000 7fde4359e640 1 -- 172.21.15.63:0/835919387 wait complete. 2023-12-04T10:44:32.154 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.380+0000 7f2439a67640 1 Processor -- start 2023-12-04T10:44:32.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.381+0000 7f2439a67640 1 -- start start 2023-12-04T10:44:32.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.382+0000 7f2439a67640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d200 0x7f24340cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.382+0000 7f2439a67640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f243415d5e0 0x7f24340cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.382+0000 7f2439a67640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24340b6f70 con 0x7f24340ce7c0 2023-12-04T10:44:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.383+0000 7f2439a67640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24340d0e60 con 0x7f243415d5e0 2023-12-04T10:44:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.383+0000 7f2439a67640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340d1140 con 0x7f243415d200 2023-12-04T10:44:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.383+0000 7f2438a65640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d200 0x7f24340cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.383+0000 7f2433fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f243415d5e0 0x7f24340cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.383+0000 7f2438a65640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d200 0x7f24340cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:48992/0 (socket says 172.21.15.63:48992) 2023-12-04T10:44:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.383+0000 7f2438a65640 1 -- 172.21.15.63:0/4081646656 learned_addr learned my addr 172.21.15.63:0/4081646656 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:32.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.383+0000 7f2433fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f243415d5e0 0x7f24340cffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:55080/0 (socket says 172.21.15.63:55080) 2023-12-04T10:44:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.384+0000 7f2438a65640 1 -- 172.21.15.63:0/4081646656 >> v2:172.21.15.66:3300/0 conn(0x7f243415d5e0 msgr2=0x7f24340cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.384+0000 7f2438a65640 1 --2- 172.21.15.63:0/4081646656 >> v2:172.21.15.66:3300/0 conn(0x7f243415d5e0 0x7f24340cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.384+0000 7f2438a65640 1 -- 172.21.15.63:0/4081646656 >> v1:172.21.15.66:6789/0 conn(0x7f24340ce7c0 legacy=0x7f2434160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.384+0000 7f2438a65640 1 -- 172.21.15.63:0/4081646656 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24340d1420 con 0x7f243415d200 2023-12-04T10:44:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.385+0000 7f2438a65640 1 --2- 172.21.15.63:0/4081646656 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d200 0x7f24340cfa70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f241c009870 tx=0x7f241c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92cb1b76ddc63784 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.386+0000 7f24337fe640 1 -- 172.21.15.63:0/4081646656 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c030840 con 0x7f243415d200 2023-12-04T10:44:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.386+0000 7f24337fe640 1 -- 172.21.15.63:0/4081646656 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c0309a0 con 0x7f243415d200 2023-12-04T10:44:32.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.386+0000 7f24337fe640 1 -- 172.21.15.63:0/4081646656 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c030d30 con 0x7f243415d200 2023-12-04T10:44:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.387+0000 7f2439a67640 1 -- 172.21.15.63:0/4081646656 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d200 msgr2=0x7f24340cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.387+0000 7f2439a67640 1 --2- 172.21.15.63:0/4081646656 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d200 0x7f24340cfa70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f241c009870 tx=0x7f241c02b980 comp rx=0 tx=0).stop 2023-12-04T10:44:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.387+0000 7f2439a67640 1 -- 172.21.15.63:0/4081646656 shutdown_connections 2023-12-04T10:44:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.387+0000 7f2439a67640 1 --2- 172.21.15.63:0/4081646656 >> v2:172.21.15.66:3300/0 conn(0x7f243415d5e0 0x7f24340cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.387+0000 7f2439a67640 1 --2- 172.21.15.63:0/4081646656 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d200 0x7f24340cfa70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.387+0000 7f2439a67640 1 -- 172.21.15.63:0/4081646656 >> 172.21.15.63:0/4081646656 conn(0x7f243409c3e0 msgr2=0x7f24340d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.387+0000 7f2439a67640 1 -- 172.21.15.63:0/4081646656 shutdown_connections 2023-12-04T10:44:32.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.387+0000 7f2439a67640 1 -- 172.21.15.63:0/4081646656 wait complete. 2023-12-04T10:44:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.389+0000 7f2439a67640 1 Processor -- start 2023-12-04T10:44:32.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.389+0000 7f2439a67640 1 -- start start 2023-12-04T10:44:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2439a67640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24340ce7c0 0x7f2434159270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2439a67640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f243415d200 0x7f24340cc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2439a67640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d5e0 0x7f24341589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2439a67640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24341597b0 con 0x7f243415d200 2023-12-04T10:44:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2439a67640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24340cd020 con 0x7f24340ce7c0 2023-12-04T10:44:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2439a67640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24340ca310 con 0x7f243415d5e0 2023-12-04T10:44:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2433fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f243415d200 0x7f24340cc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2433fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f243415d200 0x7f24340cc7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34748/0 (socket says 172.21.15.63:34748) 2023-12-04T10:44:32.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.390+0000 7f2433fff640 1 -- 172.21.15.63:0/2179020397 learned_addr learned my addr 172.21.15.63:0/2179020397 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2439266640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d5e0 0x7f24341589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2438a65640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24340ce7c0 0x7f2434159270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2433fff640 1 -- 172.21.15.63:0/2179020397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d5e0 msgr2=0x7f24341589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2433fff640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d5e0 0x7f24341589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2433fff640 1 -- 172.21.15.63:0/2179020397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24340ce7c0 msgr2=0x7f2434159270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2433fff640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24340ce7c0 0x7f2434159270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2433fff640 1 -- 172.21.15.63:0/2179020397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0094d0 con 0x7f243415d200 2023-12-04T10:44:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2433fff640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f243415d200 0x7f24340cc7d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f242400e840 tx=0x7f242400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f24317fa640 1 -- 172.21.15.63:0/2179020397 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24240094f0 con 0x7f243415d200 2023-12-04T10:44:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f24317fa640 1 -- 172.21.15.63:0/2179020397 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242400c940 con 0x7f243415d200 2023-12-04T10:44:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f24317fa640 1 -- 172.21.15.63:0/2179020397 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242400ccd0 con 0x7f243415d200 2023-12-04T10:44:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.391+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24340d2080 con 0x7f243415d200 2023-12-04T10:44:32.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.392+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24340ca890 con 0x7f243415d200 2023-12-04T10:44:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.393+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f243404e840 con 0x7f243415d200 2023-12-04T10:44:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.394+0000 7f24317fa640 1 -- 172.21.15.63:0/2179020397 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2424013470 con 0x7f243415d200 2023-12-04T10:44:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.395+0000 7f24317fa640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f241406ae40 0x7f241406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.395+0000 7f24317fa640 1 -- 172.21.15.63:0/2179020397 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2424089a10 con 0x7f243415d200 2023-12-04T10:44:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.395+0000 7f2438a65640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f241406ae40 0x7f241406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.396+0000 7f2438a65640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f241406ae40 0x7f241406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f241c036000 tx=0x7f241c008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:32.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.399+0000 7f24317fa640 1 -- 172.21.15.63:0/2179020397 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24240547c0 con 0x7f243415d200 2023-12-04T10:44:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.594+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f24340d0750 con 0x7f243415d200 2023-12-04T10:44:32.596 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.595+0000 7f24317fa640 1 -- 172.21.15.63:0/2179020397 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2424057de0 con 0x7f243415d200 2023-12-04T10:44:32.597 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.597+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f241406ae40 msgr2=0x7f241406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.597+0000 7f2439a67640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f241406ae40 0x7f241406d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f241c036000 tx=0x7f241c008030 comp rx=0 tx=0).stop 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.597+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f243415d200 msgr2=0x7f24340cc7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.597+0000 7f2439a67640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f243415d200 0x7f24340cc7d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f242400e840 tx=0x7f242400ed00 comp rx=0 tx=0).stop 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.598+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 shutdown_connections 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.598+0000 7f2439a67640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f241406ae40 0x7f241406d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.598+0000 7f2439a67640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f243415d5e0 0x7f24341589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.598+0000 7f2439a67640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f243415d200 0x7f24340cc7d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.598+0000 7f2439a67640 1 --2- 172.21.15.63:0/2179020397 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f24340ce7c0 0x7f2434159270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.598+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 >> 172.21.15.63:0/2179020397 conn(0x7f243409c3e0 msgr2=0x7f243406af40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.598+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 shutdown_connections 2023-12-04T10:44:32.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.598+0000 7f2439a67640 1 -- 172.21.15.63:0/2179020397 wait complete. 2023-12-04T10:44:32.620 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.845+0000 7ff04f547640 1 Processor -- start 2023-12-04T10:44:32.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.845+0000 7ff04f547640 1 -- start start 2023-12-04T10:44:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.847+0000 7ff04f547640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff04806a940 0x7ff04806c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.847+0000 7ff04f547640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff0480c9c80 0x7ff0480ca0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.847+0000 7ff04f547640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0480ca610 con 0x7ff0480ce530 2023-12-04T10:44:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.847+0000 7ff04f547640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04806ce80 con 0x7ff04806a940 2023-12-04T10:44:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.847+0000 7ff04f547640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0480cd4b0 con 0x7ff0480c9c80 2023-12-04T10:44:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.847+0000 7ff04e545640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff04806a940 0x7ff04806c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.847+0000 7ff04e545640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff04806a940 0x7ff04806c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34762/0 (socket says 172.21.15.63:34762) 2023-12-04T10:44:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.847+0000 7ff04e545640 1 -- 172.21.15.63:0/1074454890 learned_addr learned my addr 172.21.15.63:0/1074454890 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.848+0000 7ff04dd44640 1 --2- 172.21.15.63:0/1074454890 >> v2:172.21.15.66:3300/0 conn(0x7ff0480c9c80 0x7ff0480ca0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.848+0000 7ff04e545640 1 -- 172.21.15.63:0/1074454890 >> v2:172.21.15.66:3300/0 conn(0x7ff0480c9c80 msgr2=0x7ff0480ca0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.848+0000 7ff04e545640 1 --2- 172.21.15.63:0/1074454890 >> v2:172.21.15.66:3300/0 conn(0x7ff0480c9c80 0x7ff0480ca0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.848+0000 7ff04e545640 1 -- 172.21.15.63:0/1074454890 >> v1:172.21.15.66:6789/0 conn(0x7ff0480ce530 legacy=0x7ff0480ce940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.848+0000 7ff04e545640 1 -- 172.21.15.63:0/1074454890 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0480cd790 con 0x7ff04806a940 2023-12-04T10:44:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.848+0000 7ff04dd44640 1 --2- 172.21.15.63:0/1074454890 >> v2:172.21.15.66:3300/0 conn(0x7ff0480c9c80 0x7ff0480ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.849+0000 7ff04e545640 1 --2- 172.21.15.63:0/1074454890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff04806a940 0x7ff04806c940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff04806f220 tx=0x7ff04402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d83bf1ff2e50c5d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.849+0000 7ff04d543640 1 -- 172.21.15.63:0/1074454890 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044030860 con 0x7ff04806a940 2023-12-04T10:44:32.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04d543640 1 -- 172.21.15.63:0/1074454890 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0440309c0 con 0x7ff04806a940 2023-12-04T10:44:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04d543640 1 -- 172.21.15.63:0/1074454890 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff044030d50 con 0x7ff04806a940 2023-12-04T10:44:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04f547640 1 -- 172.21.15.63:0/1074454890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff04806a940 msgr2=0x7ff04806c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04f547640 1 --2- 172.21.15.63:0/1074454890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff04806a940 0x7ff04806c940 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff04806f220 tx=0x7ff04402b9a0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04f547640 1 -- 172.21.15.63:0/1074454890 shutdown_connections 2023-12-04T10:44:32.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04f547640 1 --2- 172.21.15.63:0/1074454890 >> v2:172.21.15.66:3300/0 conn(0x7ff0480c9c80 0x7ff0480ca0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04f547640 1 --2- 172.21.15.63:0/1074454890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff04806a940 0x7ff04806c940 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04f547640 1 -- 172.21.15.63:0/1074454890 >> 172.21.15.63:0/1074454890 conn(0x7ff0480cc0b0 msgr2=0x7ff0480cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04f547640 1 -- 172.21.15.63:0/1074454890 shutdown_connections 2023-12-04T10:44:32.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.850+0000 7ff04f547640 1 -- 172.21.15.63:0/1074454890 wait complete. 2023-12-04T10:44:32.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.852+0000 7ff04f547640 1 Processor -- start 2023-12-04T10:44:32.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.852+0000 7ff04f547640 1 -- start start 2023-12-04T10:44:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.853+0000 7ff04f547640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff04806a940 0x7ff0481517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.853+0000 7ff04f547640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0480c9c80 0x7ff0481602a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.853+0000 7ff04f547640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0480ce530 0x7ff0480c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.853+0000 7ff04f547640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04815f140 con 0x7ff0480ce530 2023-12-04T10:44:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.853+0000 7ff04f547640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0480aef90 con 0x7ff0480c9c80 2023-12-04T10:44:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.853+0000 7ff04f547640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff048151d00 con 0x7ff04806a940 2023-12-04T10:44:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04ed46640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0480ce530 0x7ff0480c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04ed46640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0480ce530 0x7ff0480c6700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34764/0 (socket says 172.21.15.63:34764) 2023-12-04T10:44:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04ed46640 1 -- 172.21.15.63:0/1870446349 learned_addr learned my addr 172.21.15.63:0/1870446349 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04dd44640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0480c9c80 0x7ff0481602a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04e545640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff04806a940 0x7ff0481517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04ed46640 1 -- 172.21.15.63:0/1870446349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff04806a940 msgr2=0x7ff0481517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04ed46640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff04806a940 0x7ff0481517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04ed46640 1 -- 172.21.15.63:0/1870446349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0480c9c80 msgr2=0x7ff0481602a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04ed46640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0480c9c80 0x7ff0481602a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:32.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.854+0000 7ff04ed46640 1 -- 172.21.15.63:0/1870446349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0440094d0 con 0x7ff0480ce530 2023-12-04T10:44:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.855+0000 7ff04ed46640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0480ce530 0x7ff0480c6700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff04000b9a0 tx=0x7ff04000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.855+0000 7ff03effd640 1 -- 172.21.15.63:0/1870446349 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04000cba0 con 0x7ff0480ce530 2023-12-04T10:44:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.855+0000 7ff03effd640 1 -- 172.21.15.63:0/1870446349 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04000cd00 con 0x7ff0480ce530 2023-12-04T10:44:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.855+0000 7ff03effd640 1 -- 172.21.15.63:0/1870446349 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff040014680 con 0x7ff0480ce530 2023-12-04T10:44:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.855+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0480c3d50 con 0x7ff0480ce530 2023-12-04T10:44:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.855+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff04815ed60 con 0x7ff0480ce530 2023-12-04T10:44:32.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.856+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04804e840 con 0x7ff0480ce530 2023-12-04T10:44:32.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.857+0000 7ff03effd640 1 -- 172.21.15.63:0/1870446349 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff04001d3b0 con 0x7ff0480ce530 2023-12-04T10:44:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.858+0000 7ff03effd640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff02c06ae40 0x7ff02c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.858+0000 7ff03effd640 1 -- 172.21.15.63:0/1870446349 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff0400896f0 con 0x7ff0480ce530 2023-12-04T10:44:32.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.858+0000 7ff04e545640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff02c06ae40 0x7ff02c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:32.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.859+0000 7ff04e545640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff02c06ae40 0x7ff02c06d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff044036000 tx=0x7ff044008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:32.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:32.863+0000 7ff03effd640 1 -- 172.21.15.63:0/1870446349 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff0400544a0 con 0x7ff0480ce530 2023-12-04T10:44:33.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.063+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0480b0bd0 con 0x7ff0480ce530 2023-12-04T10:44:33.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.064+0000 7ff03effd640 1 -- 172.21.15.63:0/1870446349 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff040057ac0 con 0x7ff0480ce530 2023-12-04T10:44:33.066 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.066+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff02c06ae40 msgr2=0x7ff02c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.066+0000 7ff04f547640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff02c06ae40 0x7ff02c06d300 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff044036000 tx=0x7ff044008030 comp rx=0 tx=0).stop 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.066+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0480ce530 msgr2=0x7ff0480c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.066+0000 7ff04f547640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0480ce530 0x7ff0480c6700 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7ff04000b9a0 tx=0x7ff04000be60 comp rx=0 tx=0).stop 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.067+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 shutdown_connections 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.067+0000 7ff04f547640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff02c06ae40 0x7ff02c06d300 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.067+0000 7ff04f547640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff0480ce530 0x7ff0480c6700 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.067+0000 7ff04f547640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff0480c9c80 0x7ff0481602a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.067+0000 7ff04f547640 1 --2- 172.21.15.63:0/1870446349 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff04806a940 0x7ff0481517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.067+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 >> 172.21.15.63:0/1870446349 conn(0x7ff0480cc0b0 msgr2=0x7ff048161380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.067+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 shutdown_connections 2023-12-04T10:44:33.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.067+0000 7ff04f547640 1 -- 172.21.15.63:0/1870446349 wait complete. 2023-12-04T10:44:33.090 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:44:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.318+0000 7fefca327640 1 Processor -- start 2023-12-04T10:44:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.319+0000 7fefca327640 1 -- start start 2023-12-04T10:44:33.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.320+0000 7fefca327640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fefc415d200 0x7fefc40cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.320+0000 7fefca327640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d5e0 0x7fefc40cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.320+0000 7fefca327640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefc40b6f70 con 0x7fefc40ce7c0 2023-12-04T10:44:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.320+0000 7fefca327640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefc40d0e60 con 0x7fefc415d200 2023-12-04T10:44:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.320+0000 7fefca327640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc40d1140 con 0x7fefc415d5e0 2023-12-04T10:44:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc9325640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fefc415d200 0x7fefc40cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc9b26640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fefc40ce7c0 0x7fefc4160ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43850/0 (socket says 172.21.15.63:43850) 2023-12-04T10:44:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc9b26640 1 -- 172.21.15.63:0/1485680563 learned_addr learned my addr 172.21.15.63:0/1485680563 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc8b24640 1 --2- 172.21.15.63:0/1485680563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d5e0 0x7fefc40cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc9325640 1 -- 172.21.15.63:0/1485680563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d5e0 msgr2=0x7fefc40cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc9325640 1 --2- 172.21.15.63:0/1485680563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d5e0 0x7fefc40cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc9325640 1 -- 172.21.15.63:0/1485680563 >> v1:172.21.15.63:6789/0 conn(0x7fefc40ce7c0 legacy=0x7fefc4160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc9325640 1 -- 172.21.15.63:0/1485680563 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefc40d1420 con 0x7fefc415d200 2023-12-04T10:44:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.321+0000 7fefc8b24640 1 --2- 172.21.15.63:0/1485680563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d5e0 0x7fefc40cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:33.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.323+0000 7fefc9325640 1 --2- 172.21.15.63:0/1485680563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d200 0x7fefc40cfa70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009d90 tx=0x7fefb802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92808b7ea08c6fe2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.323+0000 7fefc3fff640 1 -- 172.21.15.63:0/1485680563 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb802cc50 con 0x7fefc415d200 2023-12-04T10:44:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.323+0000 7fefc3fff640 1 -- 172.21.15.63:0/1485680563 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb802cdb0 con 0x7fefc415d200 2023-12-04T10:44:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.323+0000 7fefc3fff640 1 -- 172.21.15.63:0/1485680563 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb8034660 con 0x7fefc415d200 2023-12-04T10:44:33.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.324+0000 7fefca327640 1 -- 172.21.15.63:0/1485680563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d200 msgr2=0x7fefc40cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.324+0000 7fefca327640 1 --2- 172.21.15.63:0/1485680563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d200 0x7fefc40cfa70 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009d90 tx=0x7fefb802bea0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.324+0000 7fefca327640 1 -- 172.21.15.63:0/1485680563 shutdown_connections 2023-12-04T10:44:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.324+0000 7fefca327640 1 --2- 172.21.15.63:0/1485680563 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d5e0 0x7fefc40cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.324+0000 7fefca327640 1 --2- 172.21.15.63:0/1485680563 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d200 0x7fefc40cfa70 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.324+0000 7fefca327640 1 -- 172.21.15.63:0/1485680563 >> 172.21.15.63:0/1485680563 conn(0x7fefc409c3e0 msgr2=0x7fefc40d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.324+0000 7fefca327640 1 -- 172.21.15.63:0/1485680563 shutdown_connections 2023-12-04T10:44:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.324+0000 7fefca327640 1 -- 172.21.15.63:0/1485680563 wait complete. 2023-12-04T10:44:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.326+0000 7fefca327640 1 Processor -- start 2023-12-04T10:44:33.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.326+0000 7fefca327640 1 -- start start 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefca327640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefc40ce7c0 0x7fefc40c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefca327640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d200 0x7fefc40cd1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefca327640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d5e0 0x7fefc41f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefca327640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc40c6c20 con 0x7fefc415d5e0 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefca327640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefc41f3640 con 0x7fefc40ce7c0 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefca327640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefc41f3920 con 0x7fefc415d200 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefc9b26640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d5e0 0x7fefc41f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefc9b26640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d5e0 0x7fefc41f2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34780/0 (socket says 172.21.15.63:34780) 2023-12-04T10:44:33.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.327+0000 7fefc9b26640 1 -- 172.21.15.63:0/2614985252 learned_addr learned my addr 172.21.15.63:0/2614985252 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc9325640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefc40ce7c0 0x7fefc40c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc8b24640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d200 0x7fefc40cd1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc9b26640 1 -- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d200 msgr2=0x7fefc40cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc9b26640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d200 0x7fefc40cd1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc9b26640 1 -- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefc40ce7c0 msgr2=0x7fefc40c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc9b26640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefc40ce7c0 0x7fefc40c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc9b26640 1 -- 172.21.15.63:0/2614985252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb8009a70 con 0x7fefc415d5e0 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc9325640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefc40ce7c0 0x7fefc40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc9b26640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d5e0 0x7fefc41f2df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00c420 tx=0x7fefbc00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc1ffb640 1 -- 172.21.15.63:0/2614985252 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc005ce0 con 0x7fefc415d5e0 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc1ffb640 1 -- 172.21.15.63:0/2614985252 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefbc005e40 con 0x7fefc415d5e0 2023-12-04T10:44:33.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefc1ffb640 1 -- 172.21.15.63:0/2614985252 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefbc0072d0 con 0x7fefc415d5e0 2023-12-04T10:44:33.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.328+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefc40d2080 con 0x7fefc415d5e0 2023-12-04T10:44:33.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.329+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefc40c6ee0 con 0x7fefc415d5e0 2023-12-04T10:44:33.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.330+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefc406cba0 con 0x7fefc415d5e0 2023-12-04T10:44:33.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.331+0000 7fefc1ffb640 1 -- 172.21.15.63:0/2614985252 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fefbc0074f0 con 0x7fefc415d5e0 2023-12-04T10:44:33.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.332+0000 7fefc1ffb640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fefa806ae40 0x7fefa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.332+0000 7fefc1ffb640 1 -- 172.21.15.63:0/2614985252 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fefbc088d40 con 0x7fefc415d5e0 2023-12-04T10:44:33.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.332+0000 7fefc9325640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fefa806ae40 0x7fefa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.333+0000 7fefc9325640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fefa806ae40 0x7fefa806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fefb8036000 tx=0x7fefb8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:33.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.336+0000 7fefc1ffb640 1 -- 172.21.15.63:0/2614985252 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fefbc053bb0 con 0x7fefc415d5e0 2023-12-04T10:44:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.534+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fefc40cd890 con 0x7fefc415d5e0 2023-12-04T10:44:33.536 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.534+0000 7fefc1ffb640 1 -- 172.21.15.63:0/2614985252 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fefbc017020 con 0x7fefc415d5e0 2023-12-04T10:44:33.536 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fefa806ae40 msgr2=0x7fefa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fefa806ae40 0x7fefa806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fefb8036000 tx=0x7fefb8030000 comp rx=0 tx=0).stop 2023-12-04T10:44:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d5e0 msgr2=0x7fefc41f2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.539 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d5e0 0x7fefc41f2df0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fefbc00c420 tx=0x7fefbc00c8e0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 shutdown_connections 2023-12-04T10:44:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fefa806ae40 0x7fefa806d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fefc415d200 0x7fefc40cd1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fefc415d5e0 0x7fefc41f2df0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 --2- 172.21.15.63:0/2614985252 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fefc40ce7c0 0x7fefc40c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 >> 172.21.15.63:0/2614985252 conn(0x7fefc409c3e0 msgr2=0x7fefc40b71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 shutdown_connections 2023-12-04T10:44:33.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.537+0000 7fefca327640 1 -- 172.21.15.63:0/2614985252 wait complete. 2023-12-04T10:44:33.560 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:44:33.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.786+0000 7f15db0f1640 1 Processor -- start 2023-12-04T10:44:33.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.787+0000 7f15db0f1640 1 -- start start 2023-12-04T10:44:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.788+0000 7f15db0f1640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15d415b470 0x7f15d40cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.788+0000 7f15db0f1640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d40cc7f0 con 0x7f15d4151ca0 2023-12-04T10:44:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.788+0000 7f15db0f1640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15d406e280 con 0x7f15d406c0f0 2023-12-04T10:44:33.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.788+0000 7f15db0f1640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15d40cca40 con 0x7f15d415b470 2023-12-04T10:44:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.789+0000 7f15d98ee640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f15d415b470 0x7f15d40cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.789+0000 7f15da0ef640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f15d4151ca0 0x7f15d406db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43864/0 (socket says 172.21.15.63:43864) 2023-12-04T10:44:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.789+0000 7f15da0ef640 1 -- 172.21.15.63:0/1256133740 learned_addr learned my addr 172.21.15.63:0/1256133740 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.789+0000 7f15d98ee640 1 -- 172.21.15.63:0/1256133740 >> v1:172.21.15.66:6789/0 conn(0x7f15d406c0f0 legacy=0x7f15d4071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.789+0000 7f15d98ee640 1 -- 172.21.15.63:0/1256133740 >> v1:172.21.15.63:6789/0 conn(0x7f15d4151ca0 legacy=0x7f15d406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.789+0000 7f15d98ee640 1 -- 172.21.15.63:0/1256133740 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15d40ccd20 con 0x7f15d415b470 2023-12-04T10:44:33.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.790+0000 7f15d98ee640 1 --2- 172.21.15.63:0/1256133740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d415b470 0x7f15d40cb570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f15c40097a0 tx=0x7f15c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da11f52f39ab9e68 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:33.792 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.791+0000 7f15d90ed640 1 -- 172.21.15.63:0/1256133740 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c402e070 con 0x7f15d415b470 2023-12-04T10:44:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.791+0000 7f15d90ed640 1 -- 172.21.15.63:0/1256133740 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c40315a0 con 0x7f15d415b470 2023-12-04T10:44:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.791+0000 7f15d90ed640 1 -- 172.21.15.63:0/1256133740 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c4031930 con 0x7f15d415b470 2023-12-04T10:44:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.791+0000 7f15db0f1640 1 -- 172.21.15.63:0/1256133740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d415b470 msgr2=0x7f15d40cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.793 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.791+0000 7f15db0f1640 1 --2- 172.21.15.63:0/1256133740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d415b470 0x7f15d40cb570 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f15c40097a0 tx=0x7f15c402b840 comp rx=0 tx=0).stop 2023-12-04T10:44:33.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.792+0000 7f15db0f1640 1 -- 172.21.15.63:0/1256133740 shutdown_connections 2023-12-04T10:44:33.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.792+0000 7f15db0f1640 1 --2- 172.21.15.63:0/1256133740 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d415b470 0x7f15d40cb570 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.792+0000 7f15db0f1640 1 -- 172.21.15.63:0/1256133740 >> 172.21.15.63:0/1256133740 conn(0x7f15d40b07f0 msgr2=0x7f15d40b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:33.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.792+0000 7f15db0f1640 1 -- 172.21.15.63:0/1256133740 shutdown_connections 2023-12-04T10:44:33.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.792+0000 7f15db0f1640 1 -- 172.21.15.63:0/1256133740 wait complete. 2023-12-04T10:44:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.793+0000 7f15db0f1640 1 Processor -- start 2023-12-04T10:44:33.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.794+0000 7f15db0f1640 1 -- start start 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15db0f1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d406c0f0 0x7f15d414d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15db0f1640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15d4151ca0 0x7f15d41f09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15db0f1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d4152500 0x7f15d41f0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15db0f1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40c78b0 con 0x7f15d406c0f0 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15db0f1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15d40c7210 con 0x7f15d4152500 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15db0f1640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15d41f1570 con 0x7f15d4151ca0 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15da0ef640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d406c0f0 0x7f15d414d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15da0ef640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d406c0f0 0x7f15d414d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:34796/0 (socket says 172.21.15.63:34796) 2023-12-04T10:44:33.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15da0ef640 1 -- 172.21.15.63:0/93447424 learned_addr learned my addr 172.21.15.63:0/93447424 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:33.798 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15da0ef640 1 -- 172.21.15.63:0/93447424 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15d4151ca0 msgr2=0x7f15d41f09b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15da0ef640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15d4151ca0 0x7f15d41f09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15da0ef640 1 -- 172.21.15.63:0/93447424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d4152500 msgr2=0x7f15d41f0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15da0ef640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d4152500 0x7f15d41f0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.795+0000 7f15da0ef640 1 -- 172.21.15.63:0/93447424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c4009400 con 0x7f15d406c0f0 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.796+0000 7f15da0ef640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d406c0f0 0x7f15d414d030 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f15d000cbc0 tx=0x7f15d000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.796+0000 7f15caffd640 1 -- 172.21.15.63:0/93447424 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d000aca0 con 0x7f15d406c0f0 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.796+0000 7f15caffd640 1 -- 172.21.15.63:0/93447424 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15d000ae00 con 0x7f15d406c0f0 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.796+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15d41f1850 con 0x7f15d406c0f0 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.796+0000 7f15caffd640 1 -- 172.21.15.63:0/93447424 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15d0012600 con 0x7f15d406c0f0 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.796+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15d41f4230 con 0x7f15d406c0f0 2023-12-04T10:44:33.799 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.797+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15d40c79f0 con 0x7f15d406c0f0 2023-12-04T10:44:33.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.798+0000 7f15caffd640 1 -- 172.21.15.63:0/93447424 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f15d0007070 con 0x7f15d406c0f0 2023-12-04T10:44:33.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.799+0000 7f15caffd640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f15b806ae40 0x7f15b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:33.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.799+0000 7f15caffd640 1 -- 172.21.15.63:0/93447424 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f15d0089750 con 0x7f15d406c0f0 2023-12-04T10:44:33.801 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.799+0000 7f15d98ee640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f15b806ae40 0x7f15b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:33.802 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.800+0000 7f15d98ee640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f15b806ae40 0x7f15b806d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15c4036000 tx=0x7f15c4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:33.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:33.803+0000 7f15caffd640 1 -- 172.21.15.63:0/93447424 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f15d40c79f0 con 0x7f15d406c0f0 2023-12-04T10:44:34.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.036+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15d40c79f0 con 0x7f15d406c0f0 2023-12-04T10:44:34.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.038+0000 7f15caffd640 1 -- 172.21.15.63:0/93447424 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f15d40c79f0 con 0x7f15d406c0f0 2023-12-04T10:44:34.040 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:34.040 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:44:21.556693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T10:44:34.040 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.040+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f15b806ae40 msgr2=0x7f15b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.040+0000 7f15db0f1640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f15b806ae40 0x7f15b806d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f15c4036000 tx=0x7f15c4030000 comp rx=0 tx=0).stop 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.040+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d406c0f0 msgr2=0x7f15d414d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.040+0000 7f15db0f1640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d406c0f0 0x7f15d414d030 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f15d000cbc0 tx=0x7f15d000a060 comp rx=0 tx=0).stop 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.041+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 shutdown_connections 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.041+0000 7f15db0f1640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f15b806ae40 0x7f15b806d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.041+0000 7f15db0f1640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15d4151ca0 0x7f15d41f09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.041+0000 7f15db0f1640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f15d4152500 0x7f15d41f0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.041+0000 7f15db0f1640 1 --2- 172.21.15.63:0/93447424 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15d406c0f0 0x7f15d414d030 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.043 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.041+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 >> 172.21.15.63:0/93447424 conn(0x7f15d40b07f0 msgr2=0x7f15d4071d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.041+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 shutdown_connections 2023-12-04T10:44:34.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.041+0000 7f15db0f1640 1 -- 172.21.15.63:0/93447424 wait complete. 2023-12-04T10:44:34.062 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.277+0000 7fe53281e640 1 Processor -- start 2023-12-04T10:44:34.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.278+0000 7fe53281e640 1 -- start start 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.279+0000 7fe53281e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c1572f0 0x7fe52c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.279+0000 7fe53281e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe52c072270 0x7fe52c06ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.279+0000 7fe53281e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe52c06d690 con 0x7fe52c06d230 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.279+0000 7fe53281e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe52c15a9a0 con 0x7fe52c072270 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.279+0000 7fe53281e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c159db0 con 0x7fe52c1572f0 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.279+0000 7fe52b7fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe52c072270 0x7fe52c06ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.280+0000 7fe52b7fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe52c072270 0x7fe52c06ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37882/0 (socket says 172.21.15.63:37882) 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.280+0000 7fe52b7fe640 1 -- 172.21.15.63:0/229652392 learned_addr learned my addr 172.21.15.63:0/229652392 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.280+0000 7fe52bfff640 1 --2- 172.21.15.63:0/229652392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c1572f0 0x7fe52c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.280+0000 7fe52b7fe640 1 -- 172.21.15.63:0/229652392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c1572f0 msgr2=0x7fe52c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:34.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.280+0000 7fe52b7fe640 1 --2- 172.21.15.63:0/229652392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c1572f0 0x7fe52c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.280+0000 7fe52b7fe640 1 -- 172.21.15.63:0/229652392 >> v1:172.21.15.66:6789/0 conn(0x7fe52c06d230 legacy=0x7fe52c15d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.280+0000 7fe52b7fe640 1 -- 172.21.15.63:0/229652392 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe52c15a070 con 0x7fe52c072270 2023-12-04T10:44:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.281+0000 7fe52b7fe640 1 --2- 172.21.15.63:0/229652392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c072270 0x7fe52c06ccf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe520009870 tx=0x7fe52002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f14600719079feee server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.281+0000 7fe52affd640 1 -- 172.21.15.63:0/229652392 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5200317c0 con 0x7fe52c072270 2023-12-04T10:44:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.281+0000 7fe52affd640 1 -- 172.21.15.63:0/229652392 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe520031920 con 0x7fe52c072270 2023-12-04T10:44:34.283 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.281+0000 7fe52affd640 1 -- 172.21.15.63:0/229652392 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe520031cb0 con 0x7fe52c072270 2023-12-04T10:44:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.282+0000 7fe53281e640 1 -- 172.21.15.63:0/229652392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c072270 msgr2=0x7fe52c06ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.282+0000 7fe53281e640 1 --2- 172.21.15.63:0/229652392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c072270 0x7fe52c06ccf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe520009870 tx=0x7fe52002b860 comp rx=0 tx=0).stop 2023-12-04T10:44:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.282+0000 7fe53281e640 1 -- 172.21.15.63:0/229652392 shutdown_connections 2023-12-04T10:44:34.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.282+0000 7fe53281e640 1 --2- 172.21.15.63:0/229652392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c072270 0x7fe52c06ccf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.282+0000 7fe53281e640 1 --2- 172.21.15.63:0/229652392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c1572f0 0x7fe52c06db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.282+0000 7fe53281e640 1 -- 172.21.15.63:0/229652392 >> 172.21.15.63:0/229652392 conn(0x7fe52c0cee80 msgr2=0x7fe52c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.282+0000 7fe53281e640 1 -- 172.21.15.63:0/229652392 shutdown_connections 2023-12-04T10:44:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.282+0000 7fe53281e640 1 -- 172.21.15.63:0/229652392 wait complete. 2023-12-04T10:44:34.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.284+0000 7fe53281e640 1 Processor -- start 2023-12-04T10:44:34.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.284+0000 7fe53281e640 1 -- start start 2023-12-04T10:44:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe53281e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c06d230 0x7fe52c0cb900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe53281e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c072270 0x7fe52c0b2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe53281e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe52c1572f0 0x7fe52c0af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe53281e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0b4ae0 con 0x7fe52c06d230 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe53281e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0b2b50 con 0x7fe52c1572f0 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe53281e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe52c0b4520 con 0x7fe52c072270 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c06d230 0x7fe52c0cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe52bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c06d230 0x7fe52c0cb900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37890/0 (socket says 172.21.15.63:37890) 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.285+0000 7fe52bfff640 1 -- 172.21.15.63:0/1690285174 learned_addr learned my addr 172.21.15.63:0/1690285174 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe52bfff640 1 -- 172.21.15.63:0/1690285174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c072270 msgr2=0x7fe52c0b2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe52bfff640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c072270 0x7fe52c0b2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe52bfff640 1 -- 172.21.15.63:0/1690285174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe52c1572f0 msgr2=0x7fe52c0af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe52bfff640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe52c1572f0 0x7fe52c0af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe52bfff640 1 -- 172.21.15.63:0/1690285174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5200094d0 con 0x7fe52c06d230 2023-12-04T10:44:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe52bfff640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c06d230 0x7fe52c0cb900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00d6d0 tx=0x7fe51c00db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe528ff9640 1 -- 172.21.15.63:0/1690285174 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c007900 con 0x7fe52c06d230 2023-12-04T10:44:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe528ff9640 1 -- 172.21.15.63:0/1690285174 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe51c007a60 con 0x7fe52c06d230 2023-12-04T10:44:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe528ff9640 1 -- 172.21.15.63:0/1690285174 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe51c007df0 con 0x7fe52c06d230 2023-12-04T10:44:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.286+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe52c0b4800 con 0x7fe52c06d230 2023-12-04T10:44:34.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.287+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe52c0b41d0 con 0x7fe52c06d230 2023-12-04T10:44:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.288+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe52c066a30 con 0x7fe52c06d230 2023-12-04T10:44:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.289+0000 7fe528ff9640 1 -- 172.21.15.63:0/1690285174 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe51c011670 con 0x7fe52c06d230 2023-12-04T10:44:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.290+0000 7fe528ff9640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe51806ae40 0x7fe51806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.290+0000 7fe528ff9640 1 -- 172.21.15.63:0/1690285174 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe51c089db0 con 0x7fe52c06d230 2023-12-04T10:44:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.290+0000 7fe52b7fe640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe51806ae40 0x7fe51806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:34.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.291+0000 7fe52b7fe640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe51806ae40 0x7fe51806d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe520036000 tx=0x7fe520030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:34.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.294+0000 7fe528ff9640 1 -- 172.21.15.63:0/1690285174 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe52c066a30 con 0x7fe52c06d230 2023-12-04T10:44:34.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.491+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe52c066a30 con 0x7fe52c06d230 2023-12-04T10:44:34.495 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.492+0000 7fe528ff9640 1 -- 172.21.15.63:0/1690285174 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18274 (secure 0 0 0) 0x7fe52c066a30 con 0x7fe52c06d230 2023-12-04T10:44:34.495 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:34.495 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":27,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:43:58.511055+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe51806ae40 msgr2=0x7fe51806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe51806ae40 0x7fe51806d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe520036000 tx=0x7fe520030000 comp rx=0 tx=0).stop 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c06d230 msgr2=0x7fe52c0cb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c06d230 0x7fe52c0cb900 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00d6d0 tx=0x7fe51c00db90 comp rx=0 tx=0).stop 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 shutdown_connections 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe51806ae40 0x7fe51806d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe52c072270 0x7fe52c0b2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe52c1572f0 0x7fe52c0af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 --2- 172.21.15.63:0/1690285174 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe52c06d230 0x7fe52c0cb900 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.495+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 >> 172.21.15.63:0/1690285174 conn(0x7fe52c0cee80 msgr2=0x7fe52c15bc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.496+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 shutdown_connections 2023-12-04T10:44:34.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.496+0000 7fe53281e640 1 -- 172.21.15.63:0/1690285174 wait complete. 2023-12-04T10:44:34.518 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:44:34.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.745+0000 7fedd4f05640 1 Processor -- start 2023-12-04T10:44:34.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.745+0000 7fedd4f05640 1 -- start start 2023-12-04T10:44:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.747+0000 7fedd4f05640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fedd00ce240 0x7fedd00ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.747+0000 7fedd4f05640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd00cebd0 con 0x7fedd0071f00 2023-12-04T10:44:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.747+0000 7fedd4f05640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedd00ca820 con 0x7fedd015d500 2023-12-04T10:44:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.747+0000 7fedd4f05640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedd00cbcb0 con 0x7fedd00ce240 2023-12-04T10:44:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.748+0000 7fedcdd9b640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fedd0071f00 0x7fedd00cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37814/0 (socket says 172.21.15.63:37814) 2023-12-04T10:44:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.748+0000 7fedcdd9b640 1 -- 172.21.15.63:0/2616912884 learned_addr learned my addr 172.21.15.63:0/2616912884 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:34.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.748+0000 7fedced9d640 1 --2- 172.21.15.63:0/2616912884 >> v2:172.21.15.66:3300/0 conn(0x7fedd00ce240 0x7fedd00ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:34.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.749+0000 7fedcd59a640 1 -- 172.21.15.63:0/2616912884 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3554752286 0 0) 0x7fedc4001110 con 0x7fedd0071f00 2023-12-04T10:44:34.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.749+0000 7fedcd59a640 1 -- 172.21.15.63:0/2616912884 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb8003520 con 0x7fedd0071f00 2023-12-04T10:44:34.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.749+0000 7fedced9d640 1 -- 172.21.15.63:0/2616912884 >> v1:172.21.15.66:6789/0 conn(0x7fedd015d500 legacy=0x7fedd006a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.749+0000 7fedced9d640 1 -- 172.21.15.63:0/2616912884 >> v1:172.21.15.63:6789/0 conn(0x7fedd0071f00 legacy=0x7fedd00cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.749+0000 7fedced9d640 1 -- 172.21.15.63:0/2616912884 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedd015d8e0 con 0x7fedd00ce240 2023-12-04T10:44:34.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.750+0000 7fedced9d640 1 --2- 172.21.15.63:0/2616912884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedd00ce240 0x7fedd00ce690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009d90 tx=0x7fedc802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6426772122160183 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:34.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.756+0000 7fedcd59a640 1 -- 172.21.15.63:0/2616912884 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc802cc60 con 0x7fedd00ce240 2023-12-04T10:44:34.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.756+0000 7fedcd59a640 1 -- 172.21.15.63:0/2616912884 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc802cdc0 con 0x7fedd00ce240 2023-12-04T10:44:34.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.756+0000 7fedcd59a640 1 -- 172.21.15.63:0/2616912884 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc8034640 con 0x7fedd00ce240 2023-12-04T10:44:34.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.756+0000 7fedd4f05640 1 -- 172.21.15.63:0/2616912884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedd00ce240 msgr2=0x7fedd00ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.756+0000 7fedd4f05640 1 --2- 172.21.15.63:0/2616912884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedd00ce240 0x7fedd00ce690 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fedc8009d90 tx=0x7fedc802beb0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.757+0000 7fedd4f05640 1 -- 172.21.15.63:0/2616912884 shutdown_connections 2023-12-04T10:44:34.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.757+0000 7fedd4f05640 1 --2- 172.21.15.63:0/2616912884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedd00ce240 0x7fedd00ce690 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.757+0000 7fedd4f05640 1 -- 172.21.15.63:0/2616912884 >> 172.21.15.63:0/2616912884 conn(0x7fedd00b1bb0 msgr2=0x7fedd00b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:34.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.757+0000 7fedd4f05640 1 -- 172.21.15.63:0/2616912884 shutdown_connections 2023-12-04T10:44:34.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.757+0000 7fedd4f05640 1 -- 172.21.15.63:0/2616912884 wait complete. 2023-12-04T10:44:34.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.759+0000 7fedd4f05640 1 Processor -- start 2023-12-04T10:44:34.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.759+0000 7fedd4f05640 1 -- start start 2023-12-04T10:44:34.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedd4f05640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd0071f00 0x7fedd01f6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedd4f05640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedd00ce240 0x7fedd0150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedd4f05640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedd015d500 0x7fedd015f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedd4f05640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd0140480 con 0x7fedd0071f00 2023-12-04T10:44:34.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedd4f05640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedd01f73a0 con 0x7fedd00ce240 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedd4f05640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedd015e3a0 con 0x7fedd015d500 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedce59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd0071f00 0x7fedd01f6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedce59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd0071f00 0x7fedd01f6e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37900/0 (socket says 172.21.15.63:37900) 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedce59c640 1 -- 172.21.15.63:0/3825674389 learned_addr learned my addr 172.21.15.63:0/3825674389 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedce59c640 1 -- 172.21.15.63:0/3825674389 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedd015d500 msgr2=0x7fedd015f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedce59c640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedd015d500 0x7fedd015f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedce59c640 1 -- 172.21.15.63:0/3825674389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedd00ce240 msgr2=0x7fedd0150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedce59c640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedd00ce240 0x7fedd0150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:34.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.760+0000 7fedce59c640 1 -- 172.21.15.63:0/3825674389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc8009a70 con 0x7fedd0071f00 2023-12-04T10:44:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.761+0000 7fedce59c640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd0071f00 0x7fedd01f6e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fedc000c450 tx=0x7fedc000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.761+0000 7fedbeffd640 1 -- 172.21.15.63:0/3825674389 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc00052d0 con 0x7fedd0071f00 2023-12-04T10:44:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.761+0000 7fedbeffd640 1 -- 172.21.15.63:0/3825674389 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedc0005430 con 0x7fedd0071f00 2023-12-04T10:44:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.761+0000 7fedbeffd640 1 -- 172.21.15.63:0/3825674389 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedc0012870 con 0x7fedd0071f00 2023-12-04T10:44:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.761+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedd01514d0 con 0x7fedd0071f00 2023-12-04T10:44:34.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.761+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedd015e0c0 con 0x7fedd0071f00 2023-12-04T10:44:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.762+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedd0068710 con 0x7fedd0071f00 2023-12-04T10:44:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.763+0000 7fedbeffd640 1 -- 172.21.15.63:0/3825674389 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fedc00129d0 con 0x7fedd0071f00 2023-12-04T10:44:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.764+0000 7fedbeffd640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fedb006ae40 0x7fedb006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.765+0000 7fedbeffd640 1 -- 172.21.15.63:0/3825674389 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fedc00894e0 con 0x7fedd0071f00 2023-12-04T10:44:34.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.765+0000 7fedcdd9b640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fedb006ae40 0x7fedb006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:34.768 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.765+0000 7fedcdd9b640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fedb006ae40 0x7fedb006d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fedc4005880 tx=0x7fedc4001150 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:34.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:34.769+0000 7fedbeffd640 1 -- 172.21.15.63:0/3825674389 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fedc0054200 con 0x7fedd0071f00 2023-12-04T10:44:35.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.002+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedd006af80 con 0x7fedd0071f00 2023-12-04T10:44:35.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.003+0000 7fedbeffd640 1 -- 172.21.15.63:0/3825674389 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fedc0057820 con 0x7fedd0071f00 2023-12-04T10:44:35.005 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:35.006 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:44:21.556693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T10:44:35.006 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2023-12-04T10:44:35.008 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fedb006ae40 msgr2=0x7fedb006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fedb006ae40 0x7fedb006d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fedc4005880 tx=0x7fedc4001150 comp rx=0 tx=0).stop 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd0071f00 msgr2=0x7fedd01f6e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd0071f00 0x7fedd01f6e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fedc000c450 tx=0x7fedc000c910 comp rx=0 tx=0).stop 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 shutdown_connections 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fedb006ae40 0x7fedb006d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fedd015d500 0x7fedd015f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fedd00ce240 0x7fedd0150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 --2- 172.21.15.63:0/3825674389 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fedd0071f00 0x7fedd01f6e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.006+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 >> 172.21.15.63:0/3825674389 conn(0x7fedd00b1bb0 msgr2=0x7fedd00c5410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.007+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 shutdown_connections 2023-12-04T10:44:35.009 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.007+0000 7fedd4f05640 1 -- 172.21.15.63:0/3825674389 wait complete. 2023-12-04T10:44:35.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-04T10:43:52.705328+0000', 'modified': '2023-12-04T10:44:21.556693+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.66:6834/4278603848', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.66:6832', 'nonce': 4278603848}, {'type': 'v1', 'addr': '172.21.15.66:6834', 'nonce': 4278603848}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-04T10:44:35.431 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-04T10:44:35.431 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-04T10:44:35.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.664+0000 7fd577fff640 1 Processor -- start 2023-12-04T10:44:35.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.664+0000 7fd577fff640 1 -- start start 2023-12-04T10:44:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.665+0000 7fd577fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd578151ca0 0x7fd57806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.665+0000 7fd577fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd57806e0b0 0x7fd578071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.665+0000 7fd577fff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5780cc7f0 con 0x7fd57815b470 2023-12-04T10:44:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.665+0000 7fd577fff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5780cca40 con 0x7fd57806e0b0 2023-12-04T10:44:35.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.665+0000 7fd577fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780ccd20 con 0x7fd578151ca0 2023-12-04T10:44:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.666+0000 7fd5777fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd57806e0b0 0x7fd578071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.666+0000 7fd576ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd578151ca0 0x7fd57806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.666+0000 7fd5777fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd57806e0b0 0x7fd578071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:54946/0 (socket says 172.21.15.63:54946) 2023-12-04T10:44:35.668 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.666+0000 7fd5777fe640 1 -- 172.21.15.63:0/3912120510 learned_addr learned my addr 172.21.15.63:0/3912120510 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.667+0000 7fd5777fe640 1 -- 172.21.15.63:0/3912120510 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd578151ca0 msgr2=0x7fd57806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.667+0000 7fd5777fe640 1 --2- 172.21.15.63:0/3912120510 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd578151ca0 0x7fd57806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.667+0000 7fd5777fe640 1 -- 172.21.15.63:0/3912120510 >> v1:172.21.15.66:6789/0 conn(0x7fd57815b470 legacy=0x7fd5780cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.667+0000 7fd5777fe640 1 -- 172.21.15.63:0/3912120510 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5780cd000 con 0x7fd57806e0b0 2023-12-04T10:44:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.667+0000 7fd575ffb640 1 -- 172.21.15.63:0/3912120510 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945673646 0 0) 0x7fd5780cc7f0 con 0x7fd57815b470 2023-12-04T10:44:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.667+0000 7fd576ffd640 1 --2- 172.21.15.63:0/3912120510 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd578151ca0 0x7fd57806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:44:35.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.668+0000 7fd5777fe640 1 --2- 172.21.15.63:0/3912120510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 0x7fd578071740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd570009e50 tx=0x7fd57002bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d796c97afab39c2f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:35.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.669+0000 7fd575ffb640 1 -- 172.21.15.63:0/3912120510 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57002ca80 con 0x7fd57806e0b0 2023-12-04T10:44:35.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.669+0000 7fd575ffb640 1 -- 172.21.15.63:0/3912120510 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57002cbe0 con 0x7fd57806e0b0 2023-12-04T10:44:35.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.669+0000 7fd575ffb640 1 -- 172.21.15.63:0/3912120510 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700343f0 con 0x7fd57806e0b0 2023-12-04T10:44:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.670+0000 7fd577fff640 1 -- 172.21.15.63:0/3912120510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 msgr2=0x7fd578071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.670+0000 7fd577fff640 1 --2- 172.21.15.63:0/3912120510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 0x7fd578071740 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd570009e50 tx=0x7fd57002bee0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.670+0000 7fd577fff640 1 -- 172.21.15.63:0/3912120510 shutdown_connections 2023-12-04T10:44:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.670+0000 7fd577fff640 1 --2- 172.21.15.63:0/3912120510 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 0x7fd578071740 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.670+0000 7fd577fff640 1 --2- 172.21.15.63:0/3912120510 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd578151ca0 0x7fd57806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.670+0000 7fd577fff640 1 -- 172.21.15.63:0/3912120510 >> 172.21.15.63:0/3912120510 conn(0x7fd5780b07f0 msgr2=0x7fd5780b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.670+0000 7fd577fff640 1 -- 172.21.15.63:0/3912120510 shutdown_connections 2023-12-04T10:44:35.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.670+0000 7fd577fff640 1 -- 172.21.15.63:0/3912120510 wait complete. 2023-12-04T10:44:35.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.672+0000 7fd577fff640 1 Processor -- start 2023-12-04T10:44:35.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.672+0000 7fd577fff640 1 -- start start 2023-12-04T10:44:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd577fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 0x7fd5780c87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd577fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd578151ca0 0x7fd57814aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd577fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5780c71f0 0x7fd5780b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd577fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780c8350 con 0x7fd578151ca0 2023-12-04T10:44:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd577fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780c7740 con 0x7fd57806e0b0 2023-12-04T10:44:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd577fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5780c7a20 con 0x7fd5780c71f0 2023-12-04T10:44:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd5767fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd578151ca0 0x7fd57814aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd5767fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd578151ca0 0x7fd57814aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37908/0 (socket says 172.21.15.63:37908) 2023-12-04T10:44:35.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd5767fc640 1 -- 172.21.15.63:0/290147489 learned_addr learned my addr 172.21.15.63:0/290147489 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:35.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd576ffd640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 0x7fd5780c87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.673+0000 7fd5777fe640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5780c71f0 0x7fd5780b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.674+0000 7fd5767fc640 1 -- 172.21.15.63:0/290147489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5780c71f0 msgr2=0x7fd5780b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.674+0000 7fd5767fc640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5780c71f0 0x7fd5780b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.674+0000 7fd5767fc640 1 -- 172.21.15.63:0/290147489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 msgr2=0x7fd5780c87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.674+0000 7fd5767fc640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 0x7fd5780c87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.674+0000 7fd5767fc640 1 -- 172.21.15.63:0/290147489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd568009400 con 0x7fd578151ca0 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.674+0000 7fd5767fc640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd578151ca0 0x7fd57814aff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c410 tx=0x7fd56000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.674+0000 7fd56ffff640 1 -- 172.21.15.63:0/290147489 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5600035f0 con 0x7fd578151ca0 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.675+0000 7fd56ffff640 1 -- 172.21.15.63:0/290147489 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560003770 con 0x7fd578151ca0 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.675+0000 7fd577fff640 1 -- 172.21.15.63:0/290147489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd570009b30 con 0x7fd578151ca0 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.675+0000 7fd56ffff640 1 -- 172.21.15.63:0/290147489 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd560003b20 con 0x7fd578151ca0 2023-12-04T10:44:35.677 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.675+0000 7fd577fff640 1 -- 172.21.15.63:0/290147489 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5780c7fe0 con 0x7fd578151ca0 2023-12-04T10:44:35.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.677+0000 7fd56ffff640 1 -- 172.21.15.63:0/290147489 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd560003c80 con 0x7fd578151ca0 2023-12-04T10:44:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.678+0000 7fd56ffff640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd55806ae70 0x7fd55806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.678+0000 7fd56ffff640 1 -- 172.21.15.63:0/290147489 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd560088f40 con 0x7fd578151ca0 2023-12-04T10:44:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.678+0000 7fd576ffd640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd55806ae70 0x7fd55806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.679+0000 7fd580604740 1 Processor -- start 2023-12-04T10:44:35.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.679+0000 7fd580604740 1 -- start start 2023-12-04T10:44:35.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.679+0000 7fd576ffd640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd55806ae70 0x7fd55806d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd568009cd0 tx=0x7fd568009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd580604740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d4c070 0x560af7d4c450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd580604740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d46d70 0x560af7d4b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd580604740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d8f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd580604740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af7caa880 con 0x560af7d46d70 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd580604740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af7cb9ae0 con 0x560af7d4c070 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd580604740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x560af7cb71d0 con 0x560af7d4b7b0 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5767fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d46d70 0x560af7d4b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5767fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d46d70 0x560af7d4b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37924/0 (socket says 172.21.15.63:37924) 2023-12-04T10:44:35.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5767fc640 1 -- 172.21.15.63:0/2683852527 learned_addr learned my addr 172.21.15.63:0/2683852527 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5777fe640 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d8f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5767fc640 1 -- 172.21.15.63:0/2683852527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 msgr2=0x560af7d8f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5767fc640 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d8f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd576ffd640 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d4c070 0x560af7d4c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5767fc640 1 -- 172.21.15.63:0/2683852527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d4c070 msgr2=0x560af7d4c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5767fc640 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d4c070 0x560af7d4c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.680+0000 7fd5767fc640 1 -- 172.21.15.63:0/2683852527 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560af7c7a860 con 0x560af7d46d70 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.681+0000 7fd5767fc640 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d46d70 0x560af7d4b270 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5600010c0 tx=0x7fd5600578d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7376c42ea6ba3f9f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.681+0000 7fd56d7fa640 1 -- 172.21.15.63:0/2683852527 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56005fc20 con 0x560af7d46d70 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.681+0000 7fd56d7fa640 1 -- 172.21.15.63:0/2683852527 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd56006f170 con 0x560af7d46d70 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.681+0000 7fd56d7fa640 1 -- 172.21.15.63:0/2683852527 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5600540e0 con 0x560af7d46d70 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 -- 172.21.15.63:0/2683852527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d46d70 msgr2=0x560af7d4b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.684 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d46d70 0x560af7d4b270 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd5600010c0 tx=0x7fd5600578d0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 -- 172.21.15.63:0/2683852527 shutdown_connections 2023-12-04T10:44:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d8f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d46d70 0x560af7d4b270 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 --2- 172.21.15.63:0/2683852527 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d4c070 0x560af7d4c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 -- 172.21.15.63:0/2683852527 >> 172.21.15.63:0/2683852527 conn(0x560af7d0dc70 msgr2=0x560af7d91b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 -- 172.21.15.63:0/2683852527 shutdown_connections 2023-12-04T10:44:35.685 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 -- 172.21.15.63:0/2683852527 wait complete. 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.682+0000 7fd580604740 1 -- start start 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.683+0000 7fd580604740 1 Processor -- start 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd580604740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7d631e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd580604740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d71230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd580604740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4c070 0x560af7d71770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd580604740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af7cb2ac0 con 0x560af7d4c070 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd580604740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af7c4f2f0 con 0x560af7d46d70 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd580604740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x560af7c6cc70 con 0x560af7d4b7b0 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd580604740 10 client.0 _ll_register_callbacks cb 0x560af7c713b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T10:44:35.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd5777fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4c070 0x560af7d71770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd5777fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4c070 0x560af7d71770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37936/0 (socket says 172.21.15.63:37936) 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd5777fe640 1 -- 172.21.15.63:0/163489166 learned_addr learned my addr 172.21.15.63:0/163489166 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd5767fc640 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d71230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd576ffd640 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7d631e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd5777fe640 1 -- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 msgr2=0x560af7d71230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd5777fe640 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d71230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.684+0000 7fd5777fe640 1 -- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 msgr2=0x560af7d631e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.685+0000 7fd5777fe640 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7d631e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.685+0000 7fd5777fe640 1 -- 172.21.15.63:0/163489166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5780c7fe0 con 0x560af7d4c070 2023-12-04T10:44:35.688 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.685+0000 7fd5767fc640 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d71230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.685+0000 7fd5777fe640 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4c070 0x560af7d71770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd57002c4f0 tx=0x7fd570004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=326823be5c658792 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.685+0000 7fd5567fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2023-12-04T10:44:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.685+0000 7fd5567fc640 1 -- 172.21.15.63:0/163489166 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5700349d0 con 0x560af7d4c070 2023-12-04T10:44:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.685+0000 7fd580604740 1 -- 172.21.15.63:0/163489166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560af7cabaa0 con 0x560af7d4c070 2023-12-04T10:44:35.689 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.685+0000 7fd5567fc640 1 -- 172.21.15.63:0/163489166 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd570034b30 con 0x560af7d4c070 2023-12-04T10:44:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd5567fc640 1 -- 172.21.15.63:0/163489166 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd570034cf0 con 0x560af7d4c070 2023-12-04T10:44:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd580604740 10 client.4770 fetch_fsmap learned FSMap version 9 2023-12-04T10:44:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd580604740 1 -- 172.21.15.63:0/163489166 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x560af7cb1140 con 0x560af7d4c070 2023-12-04T10:44:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd5567fc640 1 -- 172.21.15.63:0/163489166 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560af7cabaa0 con 0x560af7d4c070 2023-12-04T10:44:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd5567fc640 1 -- 172.21.15.63:0/163489166 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fd57003c040 con 0x560af7d4c070 2023-12-04T10:44:35.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd580604740 10 client.4770 fetch_fsmap finished waiting for FSMap version 9 2023-12-04T10:44:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd580604740 10 client.4770 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-04T10:44:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd580604740 20 client.4770 populate_metadata read hostname 'smithi063' 2023-12-04T10:44:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd580604740 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x560af7d75650 0x560af7d98c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd580604740 4 client.4770 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-04T10:44:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.686+0000 7fd580604740 1 -- 172.21.15.63:0/163489166 --> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560af7cab7c0 con 0x560af7d75650 2023-12-04T10:44:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.687+0000 7fd576ffd640 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x560af7d75650 0x560af7d98c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.688+0000 7fd576ffd640 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x560af7d75650 0x560af7d98c30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3db75168a5dc5ce server_cookie=3097a0dba32752b in_seq=0 out_seq=0 2023-12-04T10:44:35.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.688+0000 7fd5567fc640 10 client.4770 ms_handle_connect on v2:172.21.15.66:6832/4278603848 2023-12-04T10:44:35.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd5567fc640 1 -- 172.21.15.63:0/163489166 <== mds.0 v2:172.21.15.66:6832/4278603848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x560af7cab7c0 con 0x560af7d75650 2023-12-04T10:44:35.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd5567fc640 10 client.4770 handle_command_reply: tid=0 2023-12-04T10:44:35.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 client.4770 shutdown 2023-12-04T10:44:35.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 -- 172.21.15.63:0/163489166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4c070 msgr2=0x560af7d71770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4c070 0x560af7d71770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd57002c4f0 tx=0x7fd570004ab0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 -- 172.21.15.63:0/163489166 shutdown_connections 2023-12-04T10:44:35.692 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x560af7d75650 0x560af7d98c30 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4b7b0 0x560af7d71230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4c070 0x560af7d71770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 --2- 172.21.15.63:0/163489166 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7d631e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd5567fc640 0 client.4770 ms_handle_reset on v2:172.21.15.66:6832/4278603848 2023-12-04T10:44:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 -- 172.21.15.63:0/163489166 >> 172.21.15.63:0/163489166 conn(0x560af7d0dc70 msgr2=0x560af7d45dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 -- 172.21.15.63:0/163489166 shutdown_connections 2023-12-04T10:44:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.690+0000 7fd580604740 1 -- 172.21.15.63:0/163489166 wait complete. 2023-12-04T10:44:35.693 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.691+0000 7fd580604740 20 client.4770 trim_cache size 0 max 16384 2023-12-04T10:44:35.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.708+0000 7fd580604740 1 Processor -- start 2023-12-04T10:44:35.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.708+0000 7fd580604740 1 -- start start 2023-12-04T10:44:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.709+0000 7fd580604740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7d71670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.709+0000 7fd580604740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.709+0000 7fd580604740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 0x560af7d91210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.709+0000 7fd580604740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af7a15f20 con 0x560af7d4b7b0 2023-12-04T10:44:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.709+0000 7fd580604740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af7cb49a0 con 0x560af7d46d70 2023-12-04T10:44:35.711 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.709+0000 7fd580604740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x560af7d4c4f0 con 0x560af7d4c070 2023-12-04T10:44:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37942/0 (socket says 172.21.15.63:37942) 2023-12-04T10:44:35.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 -- 172.21.15.63:0/2422271552 learned_addr learned my addr 172.21.15.63:0/2422271552 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 -- 172.21.15.63:0/2422271552 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 msgr2=0x560af7d91210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 --2- 172.21.15.63:0/2422271552 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 0x560af7d91210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 -- 172.21.15.63:0/2422271552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 msgr2=0x560af7d71670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd576ffd640 1 --2- 172.21.15.63:0/2422271552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7d71670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 --2- 172.21.15.63:0/2422271552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7d71670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 -- 172.21.15.63:0/2422271552 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560af7c4eb80 con 0x560af7d4b7b0 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.710+0000 7fd5767fc640 1 --2- 172.21.15.63:0/2422271552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5600050a0 tx=0x7fd560013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f3c8eb8649dfcc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd56dffb640 1 -- 172.21.15.63:0/2422271552 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56005fc20 con 0x560af7d4b7b0 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd56dffb640 1 -- 172.21.15.63:0/2422271552 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd560055b10 con 0x560af7d4b7b0 2023-12-04T10:44:35.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd56dffb640 1 -- 172.21.15.63:0/2422271552 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5600540e0 con 0x560af7d4b7b0 2023-12-04T10:44:35.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 -- 172.21.15.63:0/2422271552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 msgr2=0x560af7d90cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 --2- 172.21.15.63:0/2422271552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd5600050a0 tx=0x7fd560013000 comp rx=0 tx=0).stop 2023-12-04T10:44:35.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 -- 172.21.15.63:0/2422271552 shutdown_connections 2023-12-04T10:44:35.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 --2- 172.21.15.63:0/2422271552 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 0x560af7d91210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 --2- 172.21.15.63:0/2422271552 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 --2- 172.21.15.63:0/2422271552 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7d71670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 -- 172.21.15.63:0/2422271552 >> 172.21.15.63:0/2422271552 conn(0x560af7d0dc70 msgr2=0x560af7db4450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 -- 172.21.15.63:0/2422271552 shutdown_connections 2023-12-04T10:44:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.711+0000 7fd580604740 1 -- 172.21.15.63:0/2422271552 wait complete. 2023-12-04T10:44:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.712+0000 7fd580604740 1 -- start start 2023-12-04T10:44:35.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.712+0000 7fd580604740 1 Processor -- start 2023-12-04T10:44:35.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.713+0000 7fd580604740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7dfbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.713+0000 7fd580604740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.713+0000 7fd580604740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 0x560af7d91210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.713+0000 7fd580604740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af7dffc70 con 0x560af7d4b7b0 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.713+0000 7fd580604740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x560af7d94ca0 con 0x560af7d46d70 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.713+0000 7fd580604740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x560af7d94ee0 con 0x560af7d4c070 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.713+0000 7fd580604740 10 client.0 _ll_register_callbacks cb 0x7fd570009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37946/0 (socket says 172.21.15.63:37946) 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 -- 172.21.15.63:0/4111032477 learned_addr learned my addr 172.21.15.63:0/4111032477 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd576ffd640 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7dfbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5777fe640 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 0x560af7d91210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 -- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 msgr2=0x560af7d91210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 0x560af7d91210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 -- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 msgr2=0x560af7dfbc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7dfbc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 -- 172.21.15.63:0/4111032477 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560af7c7a860 con 0x560af7d4b7b0 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd576ffd640 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7dfbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5767fc640 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd560053e80 tx=0x7fd560000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357d395b0a8cdf78 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.714+0000 7fd5567fc640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd5567fc640 1 -- 172.21.15.63:0/4111032477 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd56005f9a0 con 0x560af7d4b7b0 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd5567fc640 1 -- 172.21.15.63:0/4111032477 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd5600537c0 con 0x560af7d4b7b0 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 1 -- 172.21.15.63:0/4111032477 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560af7d98330 con 0x560af7d4b7b0 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd5567fc640 1 -- 172.21.15.63:0/4111032477 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd560076250 con 0x560af7d4b7b0 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 10 client.4776 fetch_fsmap learned FSMap version 9 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 1 -- 172.21.15.63:0/4111032477 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) v3 -- 0x560af7c74170 con 0x560af7d4b7b0 2023-12-04T10:44:35.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd5567fc640 1 -- 172.21.15.63:0/4111032477 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560af7d98330 con 0x560af7d4b7b0 2023-12-04T10:44:35.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd5567fc640 1 -- 172.21.15.63:0/4111032477 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 9) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fd560053980 con 0x560af7d4b7b0 2023-12-04T10:44:35.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 10 client.4776 fetch_fsmap finished waiting for FSMap version 9 2023-12-04T10:44:35.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 10 client.4776 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-04T10:44:35.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 20 client.4776 populate_metadata read hostname 'smithi063' 2023-12-04T10:44:35.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x560af7dfc470 0x560af7dfc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:35.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 4 client.4776 mds_command: new command op to 4267 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-04T10:44:35.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.715+0000 7fd580604740 1 -- 172.21.15.63:0/4111032477 --> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7fd56006f170 con 0x560af7dfc470 2023-12-04T10:44:35.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.716+0000 7fd576ffd640 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x560af7dfc470 0x560af7dfc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:35.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.717+0000 7fd576ffd640 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x560af7dfc470 0x560af7dfc850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae71d7f7ae6ed42b server_cookie=f357550787c53669 in_seq=0 out_seq=0 2023-12-04T10:44:35.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.717+0000 7fd5567fc640 10 client.4776 ms_handle_connect on v2:172.21.15.66:6832/4278603848 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.717+0000 7fd5567fc640 1 -- 172.21.15.63:0/4111032477 <== mds.0 v2:172.21.15.66:6832/4278603848 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x7fd56006f170 con 0x560af7dfc470 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd5567fc640 10 client.4776 handle_command_reply: tid=0 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 client.4776 shutdown 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 -- 172.21.15.63:0/4111032477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 msgr2=0x560af7d90cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd560053e80 tx=0x7fd560000ed0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 -- 172.21.15.63:0/4111032477 shutdown_connections 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:6832/4278603848,v1:172.21.15.66:6834/4278603848] conn(0x560af7dfc470 0x560af7dfc850 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x560af7d4c070 0x560af7d91210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x560af7d4b7b0 0x560af7d90cd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 --2- 172.21.15.63:0/4111032477 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x560af7d46d70 0x560af7dfbc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd5567fc640 0 client.4776 ms_handle_reset on v2:172.21.15.66:6832/4278603848 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 -- 172.21.15.63:0/4111032477 >> 172.21.15.63:0/4111032477 conn(0x560af7d0dc70 msgr2=0x560af7d46500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 -- 172.21.15.63:0/4111032477 shutdown_connections 2023-12-04T10:44:35.722 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 1 -- 172.21.15.63:0/4111032477 wait complete. 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.718+0000 7fd580604740 20 client.4776 trim_cache size 0 max 16384 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "41e9b14e-2141-4ea1-b0af-8533c9689063", 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 4267, 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 42.022413544000003, 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 9, 2023-12-04T10:44:35.723 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 27, 2023-12-04T10:44:35.724 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 27, 2023-12-04T10:44:35.724 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 50.175203478999997 2023-12-04T10:44:35.724 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-04T10:44:35.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 -- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd55806ae70 msgr2=0x7fd55806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd55806ae70 0x7fd55806d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd568009cd0 tx=0x7fd568009190 comp rx=0 tx=0).stop 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 -- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd578151ca0 msgr2=0x7fd57814aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd578151ca0 0x7fd57814aff0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd56000c410 tx=0x7fd56000c8d0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 -- 172.21.15.63:0/290147489 shutdown_connections 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd55806ae70 0x7fd55806d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5780c71f0 0x7fd5780b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd578151ca0 0x7fd57814aff0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 --2- 172.21.15.63:0/290147489 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd57806e0b0 0x7fd5780c87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 -- 172.21.15.63:0/290147489 >> 172.21.15.63:0/290147489 conn(0x7fd5780b07f0 msgr2=0x7fd5780affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 -- 172.21.15.63:0/290147489 shutdown_connections 2023-12-04T10:44:35.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:35.719+0000 7fd577fff640 1 -- 172.21.15.63:0/290147489 wait complete. 2023-12-04T10:44:35.740 INFO:teuthology.run_tasks:Running task kclient... 2023-12-04T10:44:35.756 INFO:tasks.kclient:Mounting kernel clients... 2023-12-04T10:44:35.756 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-04T10:44:35.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:35.756 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-04T10:44:35.812 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-04T10:44:35.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:35.813 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-04T10:44:35.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:35.916 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2023-12-04T10:44:36.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:36.035 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-04T10:44:36.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:36.085 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link delete ceph-brx 2023-12-04T10:44:36.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T10:44:36.176 INFO:teuthology.orchestra.run.smithi063.stderr:Cannot find device "ceph-brx" 2023-12-04T10:44:36.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:36.177 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2023-12-04T10:44:36.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:36.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2023-12-04T10:44:36.358 INFO:teuthology.orchestra.run.smithi066.stderr:Cannot find device "ceph-brx" 2023-12-04T10:44:36.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T10:44:36.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:36.363 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2023-12-04T10:44:36.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:36.420 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link delete ceph-brx 2023-12-04T10:44:36.532 INFO:teuthology.orchestra.run.smithi066.stderr:Cannot find device "ceph-brx" 2023-12-04T10:44:36.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T10:44:36.536 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-12-04T10:44:36.537 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-04T10:44:36.537 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T10:44:36.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T10:44:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.770+0000 7f8521397640 1 Processor -- start 2023-12-04T10:44:36.772 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.770+0000 7f8521397640 1 -- start start 2023-12-04T10:44:36.773 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.772+0000 7f8521397640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c072270 0x7f851c06db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.772+0000 7f8521397640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c15a9a0 con 0x7f851c1572f0 2023-12-04T10:44:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.772+0000 7f8521397640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c159db0 con 0x7f851c06d400 2023-12-04T10:44:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.772+0000 7f8521397640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c15a070 con 0x7f851c072270 2023-12-04T10:44:36.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.772+0000 7f851affd640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f851c1572f0 0x7f851c06ccf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37826/0 (socket says 172.21.15.63:37826) 2023-12-04T10:44:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.772+0000 7f851affd640 1 -- 172.21.15.63:0/3672629566 learned_addr learned my addr 172.21.15.63:0/3672629566 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f851b7fe640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c072270 0x7f851c06db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1941844298 0 0) 0x7f851c15a9a0 con 0x7f851c1572f0 2023-12-04T10:44:36.775 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8504003520 con 0x7f851c1572f0 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1702084826 0 0) 0x7f8504003520 con 0x7f851c1572f0 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c072270 msgr2=0x7f851c06db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c072270 0x7f851c06db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 >> v1:172.21.15.66:6789/0 conn(0x7f851c06d400 legacy=0x7f851c070770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c15a350 con 0x7f851c1572f0 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f850c001670 con 0x7f851c1572f0 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 >> v1:172.21.15.63:6789/0 conn(0x7f851c1572f0 legacy=0x7f851c06ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c072270 0x7f85040039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:36.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8504003f70 0x7f85040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f8504005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c15a070 con 0x7f8504004d00 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f850400bb70 con 0x7f8504003f70 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.773+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850400bd30 con 0x7f851c072270 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.774+0000 7f851b7fe640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f8504005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.774+0000 7f851a7fc640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8504003f70 0x7f85040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.774+0000 7f851affd640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c072270 0x7f85040039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.774+0000 7f851b7fe640 1 -- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c072270 msgr2=0x7f85040039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.774+0000 7f851b7fe640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c072270 0x7f85040039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.774+0000 7f851b7fe640 1 -- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8504003f70 msgr2=0x7f85040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.774+0000 7f851b7fe640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8504003f70 0x7f85040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.774+0000 7f851b7fe640 1 -- 172.21.15.63:0/3672629566 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8504003520 con 0x7f8504004d00 2023-12-04T10:44:36.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.775+0000 7f851b7fe640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f8504005180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8514009fc0 tx=0x7f85040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a079e656441d48a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.775+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851402cc20 con 0x7f8504004d00 2023-12-04T10:44:36.779 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851400f040 con 0x7f8504004d00 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f8519ffb640 1 -- 172.21.15.63:0/3672629566 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8514034440 con 0x7f8504004d00 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f8521397640 1 -- 172.21.15.63:0/3672629566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 msgr2=0x7f8504005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f8521397640 1 --2- 172.21.15.63:0/3672629566 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f8504005180 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8514009fc0 tx=0x7f85040057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f851b7fe640 1 -- 172.21.15.63:0/3672629566 reap_dead start 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f8521397640 1 -- 172.21.15.63:0/3672629566 shutdown_connections 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f8521397640 1 -- 172.21.15.63:0/3672629566 >> 172.21.15.63:0/3672629566 conn(0x7f851c0cee80 msgr2=0x7f851c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f8521397640 1 -- 172.21.15.63:0/3672629566 shutdown_connections 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.776+0000 7f8521397640 1 -- 172.21.15.63:0/3672629566 wait complete. 2023-12-04T10:44:36.780 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.778+0000 7f8521397640 1 Processor -- start 2023-12-04T10:44:36.781 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.778+0000 7f8521397640 1 -- start start 2023-12-04T10:44:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.779+0000 7f8521397640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f851c1f26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.779+0000 7f8521397640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c0c81b0 0x7f851c0c8630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f8521397640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c1e1d70 0x7f851c1e2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f8521397640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0c8b70 con 0x7f8504004d00 2023-12-04T10:44:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f8521397640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c1e36b0 con 0x7f851c0c81b0 2023-12-04T10:44:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f8521397640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c1e2aa0 con 0x7f851c1e1d70 2023-12-04T10:44:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f851c1f26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:36.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f851c1f26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37970/0 (socket says 172.21.15.63:37970) 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851affd640 1 -- 172.21.15.63:0/3270332323 learned_addr learned my addr 172.21.15.63:0/3270332323 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851b7fe640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c1e1d70 0x7f851c1e2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851a7fc640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c0c81b0 0x7f851c0c8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851affd640 1 -- 172.21.15.63:0/3270332323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c1e1d70 msgr2=0x7f851c1e2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851affd640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c1e1d70 0x7f851c1e2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851affd640 1 -- 172.21.15.63:0/3270332323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c0c81b0 msgr2=0x7f851c0c8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851affd640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c0c81b0 0x7f851c0c8630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.780+0000 7f851affd640 1 -- 172.21.15.63:0/3270332323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c1e2d80 con 0x7f8504004d00 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.781+0000 7f851affd640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f851c1f26a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f850c00e7f0 tx=0x7f850c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.781+0000 7f85037fe640 1 -- 172.21.15.63:0/3270332323 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00eea0 con 0x7f8504004d00 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.781+0000 7f85037fe640 1 -- 172.21.15.63:0/3270332323 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c00c870 con 0x7f8504004d00 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.781+0000 7f85037fe640 1 -- 172.21.15.63:0/3270332323 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c00cc20 con 0x7f8504004d00 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.781+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c1e3060 con 0x7f8504004d00 2023-12-04T10:44:36.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.781+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c1f2be0 con 0x7f8504004d00 2023-12-04T10:44:36.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.782+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c068710 con 0x7f8504004d00 2023-12-04T10:44:36.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.783+0000 7f85037fe640 1 -- 172.21.15.63:0/3270332323 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f850c01d460 con 0x7f8504004d00 2023-12-04T10:44:36.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.784+0000 7f85037fe640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f850806ae60 0x7f850806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:36.786 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.784+0000 7f85037fe640 1 -- 172.21.15.63:0/3270332323 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f850c0898f0 con 0x7f8504004d00 2023-12-04T10:44:36.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.784+0000 7f851a7fc640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f850806ae60 0x7f850806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:36.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.785+0000 7f851a7fc640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f850806ae60 0x7f850806d320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8510007fd0 tx=0x7f8510009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:36.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:36.788+0000 7f85037fe640 1 -- 172.21.15.63:0/3270332323 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f850c0580a0 con 0x7f8504004d00 2023-12-04T10:44:37.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.020+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f851c157cd0 con 0x7f8504004d00 2023-12-04T10:44:37.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.021+0000 7f85037fe640 1 -- 172.21.15.63:0/3270332323 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f850c001580 con 0x7f8504004d00 2023-12-04T10:44:37.023 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.023+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f850806ae60 msgr2=0x7f850806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.023+0000 7f8521397640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f850806ae60 0x7f850806d320 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8510007fd0 tx=0x7f8510009040 comp rx=0 tx=0).stop 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.023+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 msgr2=0x7f851c1f26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.023+0000 7f8521397640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f851c1f26a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f850c00e7f0 tx=0x7f850c00ecb0 comp rx=0 tx=0).stop 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.024+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 shutdown_connections 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.024+0000 7f8521397640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f850806ae60 0x7f850806d320 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.024+0000 7f8521397640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f851c1e1d70 0x7f851c1e2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.024+0000 7f8521397640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f851c0c81b0 0x7f851c0c8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.024+0000 7f8521397640 1 --2- 172.21.15.63:0/3270332323 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8504004d00 0x7f851c1f26a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.024+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 >> 172.21.15.63:0/3270332323 conn(0x7f851c0cee80 msgr2=0x7f851c155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.024+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 shutdown_connections 2023-12-04T10:44:37.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:37.024+0000 7f8521397640 1 -- 172.21.15.63:0/3270332323 wait complete. 2023-12-04T10:44:37.043 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-04T10:44:37.044 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T10:44:37.044 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2023-12-04T10:44:37.044 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-04T10:44:37.044 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T10:44:37.044 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-04T10:44:37.044 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-04T10:44:37.044 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T10:44:37.044 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T10:44:37.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.044 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2023-12-04T10:44:37.089 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42278sec preferred_lft 42278sec 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2023-12-04T10:44:37.090 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:37.090 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-04T10:44:37.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.091 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:37.091 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:37.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add name ceph-brx type bridge 2023-12-04T10:44:37.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr flush dev ceph-brx 2023-12-04T10:44:37.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set ceph-brx up 2023-12-04T10:44:37.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-04T10:44:37.091 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:37.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.362 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T10:44:37.436 INFO:teuthology.orchestra.run.smithi063.stdout:1 2023-12-04T10:44:37.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.440 DEBUG:teuthology.orchestra.run.smithi063:> route 2023-12-04T10:44:37.484 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2023-12-04T10:44:37.484 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T10:44:37.484 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T10:44:37.484 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T10:44:37.484 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T10:44:37.484 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.484 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:37.485 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:37.485 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T10:44:37.485 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T10:44:37.485 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T10:44:37.485 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:37.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.689 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-04T10:44:37.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.730 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2023-12-04T10:44:37.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.825 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:37.825 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:37.825 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T10:44:37.825 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-04T10:44:37.825 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:37.958 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-04T10:44:37.959 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:37.959 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:37.959 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:37.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-04T10:44:37.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-04T10:44:37.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-04T10:44:37.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-04T10:44:37.959 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-04T10:44:37.959 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:38.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:38.193 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:38.193 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:38.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2023-12-04T10:44:38.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.0 master ceph-brx 2023-12-04T10:44:38.193 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:38.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:38.352 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T10:44:38.398 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-04T10:44:38.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:38.398 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T10:44:38.491 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-04T10:44:38.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:38.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:38.619 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:38.619 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:44:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:44:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.66:3300,172.21.15.66:3301" 2023-12-04T10:44:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 0@41e9b14e-2141-4ea1-b0af-8533c9689063.cephfs=/ 2023-12-04T10:44:39.051 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.63:3300/172.21.15.66:3300/172.21.15.66:3301" will pass to kernel 2023-12-04T10:44:39.055 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-04T10:44:39.055 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2023-12-04T10:44:39.055 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-04T10:44:39.055 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2023-12-04T10:44:39.055 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-04T10:44:39.059 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T10:44:39.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:39.059 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-04T10:44:39.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:39.155 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:39.217 INFO:teuthology.orchestra.run.smithi063.stdout:client4606 2023-12-04T10:44:39.218 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:44:39.218 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:44:39.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:39.275 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:39.334 INFO:teuthology.orchestra.run.smithi063.stdout:client4606 2023-12-04T10:44:39.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:39.335 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:39.396 INFO:teuthology.orchestra.run.smithi063.stdout:client4606 2023-12-04T10:44:39.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:39.397 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/41e9b14e-2141-4ea1-b0af-8533c9689063.client4606/status') 2023-12-04T10:44:39.497 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4606 (3)172.21.15.63:0/3354583297 2023-12-04T10:44:39.497 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2023-12-04T10:44:39.497 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2023-12-04T10:44:39.497 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2023-12-04T10:44:39.497 INFO:teuthology.orchestra.run.smithi063.stderr:70 bytes copied, 8.046e-05 s, 870 kB/s 2023-12-04T10:44:39.501 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-12-04T10:44:39.501 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-04T10:44:39.501 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-04T10:44:39.501 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T10:44:39.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.724+0000 7f32ff15a640 1 Processor -- start 2023-12-04T10:44:39.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.724+0000 7f32ff15a640 1 -- start start 2023-12-04T10:44:39.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.725+0000 7f32ff15a640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f32f8144a00 0x7f32f80b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:39.727 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.725+0000 7f32ff15a640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f32f80ca290 0x7f32f80ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:39.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.726+0000 7f32ff15a640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f80b2370 con 0x7f32f80701b0 2023-12-04T10:44:39.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.726+0000 7f32ff15a640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f80cabe0 con 0x7f32f80ca290 2023-12-04T10:44:39.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.726+0000 7f32ff15a640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f80cae80 con 0x7f32f8144a00 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.726+0000 7f32f7fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f32f80701b0 0x7f32f80705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37840/0 (socket says 172.21.15.63:37840) 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.726+0000 7f32f7fff640 1 -- 172.21.15.63:0/2138866674 learned_addr learned my addr 172.21.15.63:0/2138866674 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.726+0000 7f32fd6f7640 1 --2- 172.21.15.63:0/2138866674 >> v2:172.21.15.63:3300/0 conn(0x7f32f80ca290 0x7f32f80ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.726+0000 7f32fcef6640 1 --2- 172.21.15.63:0/2138866674 >> v2:172.21.15.66:3300/0 conn(0x7f32f8144a00 0x7f32f80b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.727+0000 7f32f77fe640 1 -- 172.21.15.63:0/2138866674 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032773465 0 0) 0x7f32f80b2370 con 0x7f32f80701b0 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.727+0000 7f32f77fe640 1 -- 172.21.15.63:0/2138866674 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32e8003520 con 0x7f32f80701b0 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.727+0000 7f32fd6f7640 1 -- 172.21.15.63:0/2138866674 >> v2:172.21.15.66:3300/0 conn(0x7f32f8144a00 msgr2=0x7f32f80b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.727+0000 7f32fd6f7640 1 --2- 172.21.15.63:0/2138866674 >> v2:172.21.15.66:3300/0 conn(0x7f32f8144a00 0x7f32f80b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.727+0000 7f32fd6f7640 1 -- 172.21.15.63:0/2138866674 >> v1:172.21.15.63:6789/0 conn(0x7f32f80701b0 legacy=0x7f32f80705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:39.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.727+0000 7f32fd6f7640 1 -- 172.21.15.63:0/2138866674 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f806c460 con 0x7f32f80ca290 2023-12-04T10:44:39.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.728+0000 7f32fd6f7640 1 --2- 172.21.15.63:0/2138866674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80ca290 0x7f32f80ca6a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f32f8074670 tx=0x7f32f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e82ac85b03069b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:39.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.728+0000 7f32f77fe640 1 -- 172.21.15.63:0/2138866674 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f002cc80 con 0x7f32f80ca290 2023-12-04T10:44:39.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.728+0000 7f32f77fe640 1 -- 172.21.15.63:0/2138866674 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f002cde0 con 0x7f32f80ca290 2023-12-04T10:44:39.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.728+0000 7f32f77fe640 1 -- 172.21.15.63:0/2138866674 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f0034660 con 0x7f32f80ca290 2023-12-04T10:44:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.729+0000 7f32ff15a640 1 -- 172.21.15.63:0/2138866674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80ca290 msgr2=0x7f32f80ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.729+0000 7f32ff15a640 1 --2- 172.21.15.63:0/2138866674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80ca290 0x7f32f80ca6a0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f32f8074670 tx=0x7f32f002bed0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.729+0000 7f32ff15a640 1 -- 172.21.15.63:0/2138866674 shutdown_connections 2023-12-04T10:44:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.729+0000 7f32ff15a640 1 --2- 172.21.15.63:0/2138866674 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80ca290 0x7f32f80ca6a0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.729+0000 7f32ff15a640 1 --2- 172.21.15.63:0/2138866674 >> v2:172.21.15.66:3300/0 conn(0x7f32f8144a00 0x7f32f80b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.729+0000 7f32ff15a640 1 -- 172.21.15.63:0/2138866674 >> 172.21.15.63:0/2138866674 conn(0x7f32f80cee80 msgr2=0x7f32f80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.729+0000 7f32ff15a640 1 -- 172.21.15.63:0/2138866674 shutdown_connections 2023-12-04T10:44:39.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.729+0000 7f32ff15a640 1 -- 172.21.15.63:0/2138866674 wait complete. 2023-12-04T10:44:39.735 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.731+0000 7f32ff15a640 1 Processor -- start 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.731+0000 7f32ff15a640 1 -- start start 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32ff15a640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80701b0 0x7f32f815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32ff15a640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32f80ca290 0x7f32f80cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32ff15a640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32f8144a00 0x7f32f815a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32ff15a640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f81e49b0 con 0x7f32f80701b0 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32ff15a640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80ce5c0 con 0x7f32f8144a00 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32ff15a640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f80ce8a0 con 0x7f32f80ca290 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32fcef6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80701b0 0x7f32f815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32fcef6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80701b0 0x7f32f815b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37996/0 (socket says 172.21.15.63:37996) 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32fcef6640 1 -- 172.21.15.63:0/12690055 learned_addr learned my addr 172.21.15.63:0/12690055 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32fcef6640 1 -- 172.21.15.63:0/12690055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32f80ca290 msgr2=0x7f32f80cdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32fcef6640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32f80ca290 0x7f32f80cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32fcef6640 1 -- 172.21.15.63:0/12690055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32f8144a00 msgr2=0x7f32f815a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:39.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32fcef6640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32f8144a00 0x7f32f815a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.732+0000 7f32fcef6640 1 -- 172.21.15.63:0/12690055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f0009a70 con 0x7f32f80701b0 2023-12-04T10:44:39.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.733+0000 7f32fcef6640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80701b0 0x7f32f815b010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00e870 tx=0x7f32ec00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:39.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.733+0000 7f32f57fa640 1 -- 172.21.15.63:0/12690055 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec0094f0 con 0x7f32f80701b0 2023-12-04T10:44:39.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.733+0000 7f32f57fa640 1 -- 172.21.15.63:0/12690055 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32ec00c940 con 0x7f32f80701b0 2023-12-04T10:44:39.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.733+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f81e4c00 con 0x7f32f80701b0 2023-12-04T10:44:39.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.733+0000 7f32f57fa640 1 -- 172.21.15.63:0/12690055 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32ec00ccf0 con 0x7f32f80701b0 2023-12-04T10:44:39.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.733+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f80ce2b0 con 0x7f32f80701b0 2023-12-04T10:44:39.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.734+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f8068710 con 0x7f32f80701b0 2023-12-04T10:44:39.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.735+0000 7f32f57fa640 1 -- 172.21.15.63:0/12690055 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f32ec013470 con 0x7f32f80701b0 2023-12-04T10:44:39.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.736+0000 7f32f57fa640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f32dc06ae40 0x7f32dc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:39.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.736+0000 7f32f57fa640 1 -- 172.21.15.63:0/12690055 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f32ec089af0 con 0x7f32f80701b0 2023-12-04T10:44:39.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.736+0000 7f32f7fff640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f32dc06ae40 0x7f32dc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:39.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.737+0000 7f32f7fff640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f32dc06ae40 0x7f32dc06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f32e4001610 tx=0x7f32e4007930 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:39.742 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.741+0000 7f32f57fa640 1 -- 172.21.15.63:0/12690055 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32ec0547e0 con 0x7f32f80701b0 2023-12-04T10:44:39.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.984+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f32f806e2a0 con 0x7f32f80701b0 2023-12-04T10:44:39.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.984+0000 7f32f57fa640 1 -- 172.21.15.63:0/12690055 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f32ec021070 con 0x7f32f80701b0 2023-12-04T10:44:39.987 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-04T10:44:39.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f32dc06ae40 msgr2=0x7f32dc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:39.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f32dc06ae40 0x7f32dc06d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f32e4001610 tx=0x7f32e4007930 comp rx=0 tx=0).stop 2023-12-04T10:44:39.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80701b0 msgr2=0x7f32f815b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:39.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80701b0 0x7f32f815b010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f32ec00e870 tx=0x7f32ec00ed30 comp rx=0 tx=0).stop 2023-12-04T10:44:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 shutdown_connections 2023-12-04T10:44:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f32dc06ae40 0x7f32dc06d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f32f80ca290 0x7f32f80cdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f32f8144a00 0x7f32f815a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 --2- 172.21.15.63:0/12690055 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32f80701b0 0x7f32f815b010 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 >> 172.21.15.63:0/12690055 conn(0x7f32f80cee80 msgr2=0x7f32f80b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 shutdown_connections 2023-12-04T10:44:39.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:39.987+0000 7f32ff15a640 1 -- 172.21.15.63:0/12690055 wait complete. 2023-12-04T10:44:40.009 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-04T10:44:40.009 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T10:44:40.010 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2023-12-04T10:44:40.010 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-04T10:44:40.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-04T10:44:40.010 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-04T10:44:40.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-04T10:44:40.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T10:44:40.010 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-04T10:44:40.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.010 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2023-12-04T10:44:40.061 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:40.061 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-04T10:44:40.062 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42275sec preferred_lft 42275sec 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 16:f2:2d:81:20:26 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::45d:65ff:fefe:3e23/64 scope link 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 16:f2:2d:81:20:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::14f2:2dff:fe81:2026/64 scope link 2023-12-04T10:44:40.063 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.064 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T10:44:40.156 INFO:teuthology.orchestra.run.smithi063.stdout:1 2023-12-04T10:44:40.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.161 DEBUG:teuthology.orchestra.run.smithi063:> route 2023-12-04T10:44:40.220 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2023-12-04T10:44:40.220 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T10:44:40.220 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T10:44:40.220 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T10:44:40.220 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T10:44:40.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.221 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:40.221 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:40.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T10:44:40.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T10:44:40.221 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T10:44:40.221 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:40.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.410 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-04T10:44:40.463 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T10:44:40.464 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.464 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list-id 2023-12-04T10:44:40.510 INFO:teuthology.orchestra.run.smithi063.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-04T10:44:40.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.512 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:40.512 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:40.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-04T10:44:40.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-04T10:44:40.512 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:40.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-04T10:44:40.813 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:40.813 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:40.813 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:40.813 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.813 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:40.813 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.814 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T10:44:40.814 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 9a:5d:a3:b3:27:ca brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-04T10:44:40.814 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-04T10:44:40.814 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.814 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::985d:a3ff:feb3:27ca/64 scope link 2023-12-04T10:44:40.814 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-04T10:44:40.921 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:40.921 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 9a:5d:a3:b3:27:ca brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.922 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::985d:a3ff:feb3:27ca/64 scope link 2023-12-04T10:44:40.923 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:40.927 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-04T10:44:40.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:40.927 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:40.927 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:40.928 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-04T10:44:40.928 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-04T10:44:40.928 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-04T10:44:40.928 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-04T10:44:40.928 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-04T10:44:40.928 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:41.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:41.213 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:44:41.213 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:44:41.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.1 up 2023-12-04T10:44:41.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set dev brx.1 master ceph-brx 2023-12-04T10:44:41.213 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:44:41.389 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:41.390 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-04T10:44:41.439 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-04T10:44:41.439 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:41.439 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-04T10:44:41.487 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-12-04T10:44:41.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:41.487 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:41.622 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:41.623 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:44:41.660 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:41.660 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:44:41.660 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.66:3300,172.21.15.66:3301" 2023-12-04T10:44:41.660 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 2@41e9b14e-2141-4ea1-b0af-8533c9689063.cephfs=/ 2023-12-04T10:44:41.660 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.63:3300/172.21.15.66:3300/172.21.15.66:3301" will pass to kernel 2023-12-04T10:44:41.664 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-12-04T10:44:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2023-12-04T10:44:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-04T10:44:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2023-12-04T10:44:41.664 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-04T10:44:41.670 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T10:44:41.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:41.670 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-04T10:44:41.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:41.772 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:41.834 INFO:teuthology.orchestra.run.smithi063.stdout:client4612 2023-12-04T10:44:41.834 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:44:41.835 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:44:41.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:41.894 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:41.960 INFO:teuthology.orchestra.run.smithi063.stdout:client4612 2023-12-04T10:44:41.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:41.960 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:42.025 INFO:teuthology.orchestra.run.smithi063.stdout:client4612 2023-12-04T10:44:42.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:42.026 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/41e9b14e-2141-4ea1-b0af-8533c9689063.client4612/status') 2023-12-04T10:44:42.124 INFO:teuthology.orchestra.run.smithi063.stdout:instance: client.4612 (3)172.21.15.63:0/2513852214 2023-12-04T10:44:42.125 INFO:teuthology.orchestra.run.smithi063.stdout:blocklisted: false 2023-12-04T10:44:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records in 2023-12-04T10:44:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:0+1 records out 2023-12-04T10:44:42.125 INFO:teuthology.orchestra.run.smithi063.stderr:70 bytes copied, 7.5587e-05 s, 926 kB/s 2023-12-04T10:44:42.128 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-12-04T10:44:42.128 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-04T10:44:42.128 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T10:44:42.128 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T10:44:42.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.353+0000 7f6d7f025640 1 Processor -- start 2023-12-04T10:44:42.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.353+0000 7f6d7f025640 1 -- start start 2023-12-04T10:44:42.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.355+0000 7f6d7f025640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6d780d16b0 0x7f6d780d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.355+0000 7f6d7f025640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d780d3cd0 0x7f6d780b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.355+0000 7f6d7f025640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d780d1fd0 con 0x7f6d7815d710 2023-12-04T10:44:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.355+0000 7f6d7f025640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d780cef40 con 0x7f6d780d16b0 2023-12-04T10:44:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.355+0000 7f6d7f025640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780b25c0 con 0x7f6d780d3cd0 2023-12-04T10:44:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.355+0000 7f6d7e824640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d780d3cd0 0x7f6d780b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:42.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.356+0000 7f6d7e824640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d780d3cd0 0x7f6d780b3380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:37702/0 (socket says 172.21.15.63:37702) 2023-12-04T10:44:42.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.356+0000 7f6d7e824640 1 -- 172.21.15.63:0/2917280049 learned_addr learned my addr 172.21.15.63:0/2917280049 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:42.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.356+0000 7f6d7e023640 1 --2- 172.21.15.63:0/2917280049 >> v2:172.21.15.66:3300/0 conn(0x7f6d780d16b0 0x7f6d780d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:42.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.356+0000 7f6d7e824640 1 -- 172.21.15.63:0/2917280049 >> v2:172.21.15.66:3300/0 conn(0x7f6d780d16b0 msgr2=0x7f6d780d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:42.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.356+0000 7f6d7e824640 1 --2- 172.21.15.63:0/2917280049 >> v2:172.21.15.66:3300/0 conn(0x7f6d780d16b0 0x7f6d780d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.356+0000 7f6d7e824640 1 -- 172.21.15.63:0/2917280049 >> v1:172.21.15.66:6789/0 conn(0x7f6d7815d710 legacy=0x7f6d780ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:42.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.356+0000 7f6d7e824640 1 -- 172.21.15.63:0/2917280049 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d780b28a0 con 0x7f6d780d3cd0 2023-12-04T10:44:42.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.358+0000 7f6d7e824640 1 --2- 172.21.15.63:0/2917280049 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d780d3cd0 0x7f6d780b3380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009e50 tx=0x7f6d7002bec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59d40d63fa276da5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:42.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.358+0000 7f6d7d021640 1 -- 172.21.15.63:0/2917280049 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7002ca60 con 0x7f6d780d3cd0 2023-12-04T10:44:42.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.358+0000 7f6d7d021640 1 -- 172.21.15.63:0/2917280049 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7002cbc0 con 0x7f6d780d3cd0 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.358+0000 7f6d7d021640 1 -- 172.21.15.63:0/2917280049 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d700343f0 con 0x7f6d780d3cd0 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.359+0000 7f6d7f025640 1 -- 172.21.15.63:0/2917280049 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d780d3cd0 msgr2=0x7f6d780b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.359+0000 7f6d7f025640 1 --2- 172.21.15.63:0/2917280049 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d780d3cd0 0x7f6d780b3380 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6d70009e50 tx=0x7f6d7002bec0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.359+0000 7f6d7f025640 1 -- 172.21.15.63:0/2917280049 shutdown_connections 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.359+0000 7f6d7f025640 1 --2- 172.21.15.63:0/2917280049 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d780d3cd0 0x7f6d780b3380 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.359+0000 7f6d7f025640 1 --2- 172.21.15.63:0/2917280049 >> v2:172.21.15.66:3300/0 conn(0x7f6d780d16b0 0x7f6d780d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.359+0000 7f6d7f025640 1 -- 172.21.15.63:0/2917280049 >> 172.21.15.63:0/2917280049 conn(0x7f6d780d30d0 msgr2=0x7f6d780d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.359+0000 7f6d7f025640 1 -- 172.21.15.63:0/2917280049 shutdown_connections 2023-12-04T10:44:42.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.359+0000 7f6d7f025640 1 -- 172.21.15.63:0/2917280049 wait complete. 2023-12-04T10:44:42.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.361+0000 7f6d7f025640 1 Processor -- start 2023-12-04T10:44:42.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.361+0000 7f6d7f025640 1 -- start start 2023-12-04T10:44:42.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.362+0000 7f6d7f025640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d780d16b0 0x7f6d78159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:42.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.362+0000 7f6d7f025640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d780d3cd0 0x7f6d780c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:42.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.362+0000 7f6d7f025640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d7815d710 0x7f6d780b8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.362+0000 7f6d7f025640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c7a50 con 0x7f6d780d16b0 2023-12-04T10:44:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.362+0000 7f6d7f025640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780cb1f0 con 0x7f6d780d3cd0 2023-12-04T10:44:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.362+0000 7f6d7f025640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d780c7490 con 0x7f6d7815d710 2023-12-04T10:44:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d780d16b0 0x7f6d78159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d780d16b0 0x7f6d78159860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:38012/0 (socket says 172.21.15.63:38012) 2023-12-04T10:44:42.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 -- 172.21.15.63:0/575745022 learned_addr learned my addr 172.21.15.63:0/575745022 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:42.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7d822640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d780d3cd0 0x7f6d780c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e824640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d7815d710 0x7f6d780b8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 -- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d7815d710 msgr2=0x7f6d780b8190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d7815d710 0x7f6d780b8190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 -- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d780d3cd0 msgr2=0x7f6d780c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d780d3cd0 0x7f6d780c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 -- 172.21.15.63:0/575745022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d70009b30 con 0x7f6d780d16b0 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e824640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d7815d710 0x7f6d780b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.363+0000 7f6d7e023640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d780d16b0 0x7f6d78159860 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400e9b0 tx=0x7f6d7400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.364+0000 7f6d6effd640 1 -- 172.21.15.63:0/575745022 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d74009670 con 0x7f6d780d16b0 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.364+0000 7f6d6effd640 1 -- 172.21.15.63:0/575745022 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d7400c9a0 con 0x7f6d780d16b0 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.364+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d780c7770 con 0x7f6d780d16b0 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.364+0000 7f6d6effd640 1 -- 172.21.15.63:0/575745022 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d7400cd50 con 0x7f6d780d16b0 2023-12-04T10:44:42.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.364+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d780cb6e0 con 0x7f6d780d16b0 2023-12-04T10:44:42.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.365+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d7804e840 con 0x7f6d780d16b0 2023-12-04T10:44:42.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.366+0000 7f6d6effd640 1 -- 172.21.15.63:0/575745022 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d74013470 con 0x7f6d780d16b0 2023-12-04T10:44:42.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.368+0000 7f6d6effd640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d5c06ae40 0x7f6d5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:42.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.368+0000 7f6d6effd640 1 -- 172.21.15.63:0/575745022 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d74089d20 con 0x7f6d780d16b0 2023-12-04T10:44:42.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.368+0000 7f6d7d822640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d5c06ae40 0x7f6d5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:42.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.369+0000 7f6d7d822640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d5c06ae40 0x7f6d5c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d68007fd0 tx=0x7f6d68009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:42.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.373+0000 7f6d6effd640 1 -- 172.21.15.63:0/575745022 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d74054970 con 0x7f6d780d16b0 2023-12-04T10:44:42.607 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.605+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6d78159dd0 con 0x7f6d780d16b0 2023-12-04T10:44:42.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.606+0000 7f6d6effd640 1 -- 172.21.15.63:0/575745022 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f6d74021070 con 0x7f6d780d16b0 2023-12-04T10:44:42.608 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.608+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d5c06ae40 msgr2=0x7f6d5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.608+0000 7f6d7f025640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d5c06ae40 0x7f6d5c06d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6d68007fd0 tx=0x7f6d68009040 comp rx=0 tx=0).stop 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.608+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d780d16b0 msgr2=0x7f6d78159860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.608+0000 7f6d7f025640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d780d16b0 0x7f6d78159860 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400e9b0 tx=0x7f6d7400ee70 comp rx=0 tx=0).stop 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.609+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 shutdown_connections 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.609+0000 7f6d7f025640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d5c06ae40 0x7f6d5c06d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.609+0000 7f6d7f025640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d7815d710 0x7f6d780b8190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.609+0000 7f6d7f025640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d780d3cd0 0x7f6d780c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.609+0000 7f6d7f025640 1 --2- 172.21.15.63:0/575745022 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d780d16b0 0x7f6d78159860 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.609+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 >> 172.21.15.63:0/575745022 conn(0x7f6d780d30d0 msgr2=0x7f6d780cfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:42.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.609+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 shutdown_connections 2023-12-04T10:44:42.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:42.609+0000 7f6d7f025640 1 -- 172.21.15.63:0/575745022 wait complete. 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T10:44:42.629 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-04T10:44:42.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:42.630 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:42.695 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2023-12-04T10:44:42.696 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:42.696 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:42.696 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T10:44:42.696 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:42.696 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-04T10:44:42.696 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42320sec preferred_lft 42320sec 2023-12-04T10:44:42.696 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2023-12-04T10:44:42.696 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:42.697 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-04T10:44:42.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:42.697 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:42.697 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:42.697 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add name ceph-brx type bridge 2023-12-04T10:44:42.697 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr flush dev ceph-brx 2023-12-04T10:44:42.697 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set ceph-brx up 2023-12-04T10:44:42.698 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-04T10:44:42.698 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:43.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:43.195 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T10:44:43.354 INFO:teuthology.orchestra.run.smithi066.stdout:1 2023-12-04T10:44:43.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:43.358 DEBUG:teuthology.orchestra.run.smithi066:> route 2023-12-04T10:44:43.429 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2023-12-04T10:44:43.430 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T10:44:43.430 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T10:44:43.430 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T10:44:43.430 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T10:44:43.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:43.431 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:43.431 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:43.431 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T10:44:43.431 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T10:44:43.431 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T10:44:43.431 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:44.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:44.193 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2023-12-04T10:44:44.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:44.256 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2023-12-04T10:44:44.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:44.313 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:44.313 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:44.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T10:44:44.313 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-04T10:44:44.313 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:44.477 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-04T10:44:44.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:44.477 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:44.477 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:44.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-04T10:44:44.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-04T10:44:44.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-04T10:44:44.477 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-04T10:44:44.478 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-04T10:44:44.478 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:44.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:44.797 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:44.797 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:44.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.0 up 2023-12-04T10:44:44.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.0 master ceph-brx 2023-12-04T10:44:44.797 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:44.848 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:44:44.857 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:44:44.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:44.981 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-04T10:44:45.077 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-04T10:44:45.078 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:45.078 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-04T10:44:45.132 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-12-04T10:44:45.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:45.133 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:45.302 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:45.302 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:44:45.817 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:45.817 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:44:45.818 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.66:3300,172.21.15.66:3301" 2023-12-04T10:44:45.818 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with new device syntax: 1@41e9b14e-2141-4ea1-b0af-8533c9689063.cephfs=/ 2023-12-04T10:44:45.818 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.63:3300/172.21.15.66:3300/172.21.15.66:3301" will pass to kernel 2023-12-04T10:44:45.821 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-04T10:44:45.822 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2023-12-04T10:44:45.822 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-04T10:44:45.822 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2023-12-04T10:44:45.822 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-04T10:44:45.826 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T10:44:45.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:45.827 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-04T10:44:45.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:45.908 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:45.955 INFO:teuthology.orchestra.run.smithi066.stdout:client4624 2023-12-04T10:44:45.956 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:44:45.956 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:44:46.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:46.049 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:46.101 INFO:teuthology.orchestra.run.smithi066.stdout:client4624 2023-12-04T10:44:46.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:46.102 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:46.156 INFO:teuthology.orchestra.run.smithi066.stdout:client4624 2023-12-04T10:44:46.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:46.157 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/41e9b14e-2141-4ea1-b0af-8533c9689063.client4624/status') 2023-12-04T10:44:46.253 INFO:teuthology.orchestra.run.smithi066.stdout:instance: client.4624 (3)192.168.0.1:0/1151555776 2023-12-04T10:44:46.253 INFO:teuthology.orchestra.run.smithi066.stdout:blocklisted: false 2023-12-04T10:44:46.253 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2023-12-04T10:44:46.253 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2023-12-04T10:44:46.253 INFO:teuthology.orchestra.run.smithi066.stderr:69 bytes copied, 9.9622e-05 s, 693 kB/s 2023-12-04T10:44:46.257 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-12-04T10:44:46.257 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-04T10:44:46.257 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-04T10:44:46.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T10:44:46.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.489+0000 7f44ec683640 1 Processor -- start 2023-12-04T10:44:46.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.489+0000 7f44ec683640 1 -- start start 2023-12-04T10:44:46.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.491+0000 7f44ec683640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 0x7f44e40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.491+0000 7f44ec683640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f44e40ca290 0x7f44e40ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.491+0000 7f44ec683640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e40cac20 con 0x7f44e40701b0 2023-12-04T10:44:46.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.491+0000 7f44ec683640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e40b2370 con 0x7f44e40ca290 2023-12-04T10:44:46.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.491+0000 7f44ec683640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40cae80 con 0x7f44e4144a00 2023-12-04T10:44:46.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.491+0000 7f44e9c1e640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f44e40701b0 0x7f44e4070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45688/0 (socket says 172.21.15.63:45688) 2023-12-04T10:44:46.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.491+0000 7f44e9c1e640 1 -- 172.21.15.63:0/2223677541 learned_addr learned my addr 172.21.15.63:0/2223677541 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44eac20640 1 --2- 172.21.15.63:0/2223677541 >> v2:172.21.15.66:3300/0 conn(0x7f44e40ca290 0x7f44e40ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44ea41f640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 0x7f44e40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2437531908 0 0) 0x7f44e40cac20 con 0x7f44e40701b0 2023-12-04T10:44:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d0003520 con 0x7f44e40701b0 2023-12-04T10:44:46.496 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2011228138 0 0) 0x7f44d0003520 con 0x7f44e40701b0 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 msgr2=0x7f44e40b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 0x7f44e40b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 >> v2:172.21.15.66:3300/0 conn(0x7f44e40ca290 msgr2=0x7f44e40ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 --2- 172.21.15.63:0/2223677541 >> v2:172.21.15.66:3300/0 conn(0x7f44e40ca290 0x7f44e40ca6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e406c460 con 0x7f44e40701b0 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f44d4001670 con 0x7f44e40701b0 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 >> v1:172.21.15.63:6789/0 conn(0x7f44e40701b0 legacy=0x7f44e4070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d0003970 0x7f44d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.492+0000 7f44e941d640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 0x7f44d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44e941d640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0004d00 0x7f44d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40b2370 con 0x7f44d0003970 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40cae80 con 0x7f44d0004d00 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d000b980 con 0x7f44e4144a00 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44ea41f640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d0003970 0x7f44d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44eac20640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0004d00 0x7f44d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44e9c1e640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 0x7f44d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44ea41f640 1 -- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 msgr2=0x7f44d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44ea41f640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 0x7f44d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44ea41f640 1 -- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0004d00 msgr2=0x7f44d0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44ea41f640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0004d00 0x7f44d0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44ea41f640 1 -- 172.21.15.63:0/2223677541 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d0003520 con 0x7f44d0003970 2023-12-04T10:44:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.493+0000 7f44e9c1e640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e4144a00 0x7f44d00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:46.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44ea41f640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d0003970 0x7f44d0003d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009ac0 tx=0x7f44d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f64477563903781 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:46.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e002c6d0 con 0x7f44d0003970 2023-12-04T10:44:46.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e002c830 con 0x7f44d0003970 2023-12-04T10:44:46.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44e941d640 1 -- 172.21.15.63:0/2223677541 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e002cbc0 con 0x7f44d0003970 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44ec683640 1 -- 172.21.15.63:0/2223677541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d0003970 msgr2=0x7f44d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44ec683640 1 --2- 172.21.15.63:0/2223677541 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44d0003970 0x7f44d0003d90 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f44e0009ac0 tx=0x7f44d00057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44eac20640 1 -- 172.21.15.63:0/2223677541 reap_dead start 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44ec683640 1 -- 172.21.15.63:0/2223677541 shutdown_connections 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.495+0000 7f44ec683640 1 -- 172.21.15.63:0/2223677541 >> 172.21.15.63:0/2223677541 conn(0x7f44e40cee80 msgr2=0x7f44e40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.496+0000 7f44ec683640 1 -- 172.21.15.63:0/2223677541 shutdown_connections 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.496+0000 7f44ec683640 1 -- 172.21.15.63:0/2223677541 wait complete. 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.497+0000 7f44ec683640 1 Processor -- start 2023-12-04T10:44:46.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.498+0000 7f44ec683640 1 -- start start 2023-12-04T10:44:46.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.498+0000 7f44ec683640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0003970 0x7f44e413b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.498+0000 7f44ec683640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e41f3500 0x7f44e4142c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44ec683640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e41f3980 0x7f44e415da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44ec683640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e413ef50 con 0x7f44e41f3980 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44ec683640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e413e340 con 0x7f44d0003970 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44ec683640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e413e620 con 0x7f44e41f3500 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44eac20640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e41f3980 0x7f44e415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44eac20640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e41f3980 0x7f44e415da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39226/0 (socket says 172.21.15.63:39226) 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44eac20640 1 -- 172.21.15.63:0/2821693808 learned_addr learned my addr 172.21.15.63:0/2821693808 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44ea41f640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0003970 0x7f44e413b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44e9c1e640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e41f3500 0x7f44e4142c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44eac20640 1 -- 172.21.15.63:0/2821693808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e41f3500 msgr2=0x7f44e4142c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44eac20640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e41f3500 0x7f44e4142c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44eac20640 1 -- 172.21.15.63:0/2821693808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0003970 msgr2=0x7f44e413b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44eac20640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0003970 0x7f44e413b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.499+0000 7f44eac20640 1 -- 172.21.15.63:0/2821693808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e413e900 con 0x7f44e41f3980 2023-12-04T10:44:46.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.500+0000 7f44eac20640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e41f3980 0x7f44e415da30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f44e4074670 tx=0x7f44dc0115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:46.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.500+0000 7f44daffd640 1 -- 172.21.15.63:0/2821693808 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc00e070 con 0x7f44e41f3980 2023-12-04T10:44:46.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.500+0000 7f44daffd640 1 -- 172.21.15.63:0/2821693808 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc011e10 con 0x7f44e41f3980 2023-12-04T10:44:46.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.500+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e413ebe0 con 0x7f44e41f3980 2023-12-04T10:44:46.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.500+0000 7f44daffd640 1 -- 172.21.15.63:0/2821693808 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc003990 con 0x7f44e41f3980 2023-12-04T10:44:46.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.500+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e415af20 con 0x7f44e41f3980 2023-12-04T10:44:46.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.501+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e413f0c0 con 0x7f44e41f3980 2023-12-04T10:44:46.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.503+0000 7f44daffd640 1 -- 172.21.15.63:0/2821693808 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44dc003af0 con 0x7f44e41f3980 2023-12-04T10:44:46.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.504+0000 7f44daffd640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f44c806ae40 0x7f44c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:46.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.504+0000 7f44daffd640 1 -- 172.21.15.63:0/2821693808 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f44dc089ee0 con 0x7f44e41f3980 2023-12-04T10:44:46.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.504+0000 7f44ea41f640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f44c806ae40 0x7f44c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:46.507 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.505+0000 7f44ea41f640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f44c806ae40 0x7f44c806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44e0036000 tx=0x7f44e0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:46.511 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.509+0000 7f44daffd640 1 -- 172.21.15.63:0/2821693808 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44dc054bc0 con 0x7f44e41f3980 2023-12-04T10:44:46.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.743+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f44e4068710 con 0x7f44e41f3980 2023-12-04T10:44:46.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.744+0000 7f44daffd640 1 -- 172.21.15.63:0/2821693808 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) v1 ==== 53+0+88 (secure 0 0 0) 0x7f44dc0581e0 con 0x7f44e41f3980 2023-12-04T10:44:46.746 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-04T10:44:46.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f44c806ae40 msgr2=0x7f44c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:46.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f44c806ae40 0x7f44c806d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f44e0036000 tx=0x7f44e0030000 comp rx=0 tx=0).stop 2023-12-04T10:44:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e41f3980 msgr2=0x7f44e415da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e41f3980 0x7f44e415da30 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f44e4074670 tx=0x7f44dc0115a0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 shutdown_connections 2023-12-04T10:44:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f44c806ae40 0x7f44c806d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f44e41f3500 0x7f44e4142c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f44e41f3980 0x7f44e415da30 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 --2- 172.21.15.63:0/2821693808 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f44d0003970 0x7f44e413b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:46.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 >> 172.21.15.63:0/2821693808 conn(0x7f44e40cee80 msgr2=0x7f44e413c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:46.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 shutdown_connections 2023-12-04T10:44:46.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:46.747+0000 7f44ec683640 1 -- 172.21.15.63:0/2821693808 wait complete. 2023-12-04T10:44:46.769 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-04T10:44:46.769 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T10:44:46.769 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi066.front.sepia.ceph.com 2023-12-04T10:44:46.769 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-04T10:44:46.769 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-04T10:44:46.770 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-04T10:44:46.770 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-04T10:44:46.770 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T10:44:46.770 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-04T10:44:46.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:46.770 DEBUG:teuthology.orchestra.run.smithi066:> ip addr 2023-12-04T10:44:46.830 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:46.830 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:84 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f0 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:a8:b4:85 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: altname enp7s0f1 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bc brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether 0c:c4:7a:b6:f8:bd brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:46.831 INFO:teuthology.orchestra.run.smithi066.stdout: inet 172.21.15.66/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft 42316sec preferred_lft 42316sec 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ec4:7aff:feb6:f8bd/64 scope link 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether a6:df:2a:7d:5a:b2 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::b834:46ff:fe61:4d13/64 scope link 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether a6:df:2a:7d:5a:b2 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::a4df:2aff:fe7d:5ab2/64 scope link 2023-12-04T10:44:46.832 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:46.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:46.833 DEBUG:teuthology.orchestra.run.smithi066:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T10:44:46.913 INFO:teuthology.orchestra.run.smithi066.stdout:1 2023-12-04T10:44:46.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:46.917 DEBUG:teuthology.orchestra.run.smithi066:> route 2023-12-04T10:44:46.965 INFO:teuthology.orchestra.run.smithi066.stdout:Kernel IP routing table 2023-12-04T10:44:46.965 INFO:teuthology.orchestra.run.smithi066.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T10:44:46.965 INFO:teuthology.orchestra.run.smithi066.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T10:44:46.965 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T10:44:46.966 INFO:teuthology.orchestra.run.smithi066.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T10:44:46.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:46.966 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:46.966 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:46.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T10:44:46.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T10:44:46.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T10:44:46.966 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:47.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:47.167 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list 2023-12-04T10:44:47.225 INFO:teuthology.orchestra.run.smithi066.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-04T10:44:47.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:47.226 DEBUG:teuthology.orchestra.run.smithi066:> ip netns list-id 2023-12-04T10:44:47.286 INFO:teuthology.orchestra.run.smithi066.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-04T10:44:47.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:47.287 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:47.287 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:47.287 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-04T10:44:47.287 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-04T10:44:47.287 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:47.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:47.455 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether ae:99:56:7b:0b:6a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-04T10:44:47.559 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-04T10:44:47.560 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:47.560 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ac99:56ff:fe7b:b6a/64 scope link 2023-12-04T10:44:47.560 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:47.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:47.564 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 ::1/128 scope host 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout: link/ether ae:99:56:7b:0b:6a brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-04T10:44:47.669 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:47.670 INFO:teuthology.orchestra.run.smithi066.stdout: inet6 fe80::ac99:56ff:fe7b:b6a/64 scope link 2023-12-04T10:44:47.670 INFO:teuthology.orchestra.run.smithi066.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:44:47.673 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-04T10:44:47.673 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:47.673 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:47.673 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:47.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-04T10:44:47.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-04T10:44:47.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-04T10:44:47.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-04T10:44:47.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-04T10:44:47.674 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:47.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:47.978 DEBUG:teuthology.orchestra.run.smithi066:> (cd / && exec bash -c ' 2023-12-04T10:44:47.978 DEBUG:teuthology.orchestra.run.smithi066:> set -e 2023-12-04T10:44:47.978 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set brx.1 up 2023-12-04T10:44:47.978 DEBUG:teuthology.orchestra.run.smithi066:> sudo ip link set dev brx.1 master ceph-brx 2023-12-04T10:44:47.978 DEBUG:teuthology.orchestra.run.smithi066:> ') 2023-12-04T10:44:48.163 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:48.163 DEBUG:teuthology.orchestra.run.smithi066:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-04T10:44:48.218 INFO:teuthology.orchestra.run.smithi066.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-04T10:44:48.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:44:48.218 DEBUG:teuthology.orchestra.run.smithi066:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-04T10:44:48.267 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-12-04T10:44:48.267 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:48.267 DEBUG:teuthology.orchestra.run.smithi066:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:48.422 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:48.422 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:44:48.459 INFO:teuthology.orchestra.run.smithi066.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:44:48.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:44:48.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.66:3300,172.21.15.66:3301" 2023-12-04T10:44:48.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: trying mount with new device syntax: 3@41e9b14e-2141-4ea1-b0af-8533c9689063.cephfs=/ 2023-12-04T10:44:48.459 INFO:teuthology.orchestra.run.smithi066.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.63:3300/172.21.15.66:3300/172.21.15.66:3301" will pass to kernel 2023-12-04T10:44:48.462 INFO:teuthology.orchestra.run.smithi066.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-12-04T10:44:48.462 INFO:teuthology.orchestra.run.smithi066.stdout: You just mounted a file system that supports labels which does not 2023-12-04T10:44:48.462 INFO:teuthology.orchestra.run.smithi066.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-04T10:44:48.462 INFO:teuthology.orchestra.run.smithi066.stdout: applications will generate AVC messages and not be allowed access to 2023-12-04T10:44:48.462 INFO:teuthology.orchestra.run.smithi066.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-04T10:44:48.467 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T10:44:48.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:48.467 DEBUG:teuthology.orchestra.run.smithi066:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-04T10:44:48.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:48.568 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:48.626 INFO:teuthology.orchestra.run.smithi066.stdout:client4502 2023-12-04T10:44:48.626 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:44:48.626 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:44:48.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:48.679 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:48.739 INFO:teuthology.orchestra.run.smithi066.stdout:client4502 2023-12-04T10:44:48.739 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:48.739 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:44:48.798 INFO:teuthology.orchestra.run.smithi066.stdout:client4502 2023-12-04T10:44:48.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:44:48.798 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/41e9b14e-2141-4ea1-b0af-8533c9689063.client4502/status') 2023-12-04T10:44:48.900 INFO:teuthology.orchestra.run.smithi066.stdout:instance: client.4502 (3)192.168.0.2:0/1087640880 2023-12-04T10:44:48.900 INFO:teuthology.orchestra.run.smithi066.stdout:blocklisted: false 2023-12-04T10:44:48.900 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2023-12-04T10:44:48.901 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2023-12-04T10:44:48.901 INFO:teuthology.orchestra.run.smithi066.stderr:69 bytes copied, 7.7084e-05 s, 895 kB/s 2023-12-04T10:44:48.904 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-04T10:44:48.921 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:49.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.156+0000 7fb08283d640 1 Processor -- start 2023-12-04T10:44:49.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.156+0000 7fb08283d640 1 -- start start 2023-12-04T10:44:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.158+0000 7fb08283d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 0x7fb07c0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.158+0000 7fb08283d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb07c0ca290 0x7fb07c0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.158+0000 7fb08283d640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c0cac20 con 0x7fb07c0701b0 2023-12-04T10:44:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.158+0000 7fb08283d640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c0b2370 con 0x7fb07c0ca290 2023-12-04T10:44:49.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.158+0000 7fb08283d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0cae80 con 0x7fb07c144a00 2023-12-04T10:44:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.159+0000 7fb080dda640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb07c0ca290 0x7fb07c0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.159+0000 7fb080dda640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb07c0ca290 0x7fb07c0ca6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:45950/0 (socket says 172.21.15.63:45950) 2023-12-04T10:44:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.159+0000 7fb080dda640 1 -- 172.21.15.63:0/1565779116 learned_addr learned my addr 172.21.15.63:0/1565779116 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.159+0000 7fb07bfff640 1 --2- 172.21.15.63:0/1565779116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 0x7fb07c0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.160+0000 7fb080dda640 1 -- 172.21.15.63:0/1565779116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 msgr2=0x7fb07c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:49.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.160+0000 7fb080dda640 1 --2- 172.21.15.63:0/1565779116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 0x7fb07c0b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.160+0000 7fb080dda640 1 -- 172.21.15.63:0/1565779116 >> v1:172.21.15.66:6789/0 conn(0x7fb07c0701b0 legacy=0x7fb07c070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.160+0000 7fb080dda640 1 -- 172.21.15.63:0/1565779116 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c06c460 con 0x7fb07c0ca290 2023-12-04T10:44:49.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.161+0000 7fb080dda640 1 --2- 172.21.15.63:0/1565779116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0ca290 0x7fb07c0ca6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb074009870 tx=0x7fb07402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97533e1b570c2d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:49.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.162+0000 7fb07b7fe640 1 -- 172.21.15.63:0/1565779116 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074030840 con 0x7fb07c0ca290 2023-12-04T10:44:49.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.162+0000 7fb07b7fe640 1 -- 172.21.15.63:0/1565779116 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0740309a0 con 0x7fb07c0ca290 2023-12-04T10:44:49.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.162+0000 7fb07b7fe640 1 -- 172.21.15.63:0/1565779116 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb074030d30 con 0x7fb07c0ca290 2023-12-04T10:44:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.162+0000 7fb08283d640 1 -- 172.21.15.63:0/1565779116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0ca290 msgr2=0x7fb07c0ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.162+0000 7fb08283d640 1 --2- 172.21.15.63:0/1565779116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0ca290 0x7fb07c0ca6e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb074009870 tx=0x7fb07402b980 comp rx=0 tx=0).stop 2023-12-04T10:44:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.163+0000 7fb08283d640 1 -- 172.21.15.63:0/1565779116 shutdown_connections 2023-12-04T10:44:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.163+0000 7fb08283d640 1 --2- 172.21.15.63:0/1565779116 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0ca290 0x7fb07c0ca6e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.163+0000 7fb08283d640 1 --2- 172.21.15.63:0/1565779116 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 0x7fb07c0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.163+0000 7fb08283d640 1 -- 172.21.15.63:0/1565779116 >> 172.21.15.63:0/1565779116 conn(0x7fb07c0cee80 msgr2=0x7fb07c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:49.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.163+0000 7fb08283d640 1 -- 172.21.15.63:0/1565779116 shutdown_connections 2023-12-04T10:44:49.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.163+0000 7fb08283d640 1 -- 172.21.15.63:0/1565779116 wait complete. 2023-12-04T10:44:49.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.165+0000 7fb08283d640 1 Processor -- start 2023-12-04T10:44:49.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.165+0000 7fb08283d640 1 -- start start 2023-12-04T10:44:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb08283d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0701b0 0x7fb07c1e5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb08283d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0ca290 0x7fb07c13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb08283d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 0x7fb07c1e3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb08283d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1e43c0 con 0x7fb07c0ca290 2023-12-04T10:44:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb08283d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1e46a0 con 0x7fb07c0701b0 2023-12-04T10:44:49.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb08283d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1e4980 con 0x7fb07c144a00 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb0737fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0ca290 0x7fb07c13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb0737fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0ca290 0x7fb07c13edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39242/0 (socket says 172.21.15.63:39242) 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb0737fe640 1 -- 172.21.15.63:0/1831717215 learned_addr learned my addr 172.21.15.63:0/1831717215 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb080dda640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 0x7fb07c1e3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.166+0000 7fb07bfff640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0701b0 0x7fb07c1e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0737fe640 1 -- 172.21.15.63:0/1831717215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 msgr2=0x7fb07c1e3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0737fe640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 0x7fb07c1e3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0737fe640 1 -- 172.21.15.63:0/1831717215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0701b0 msgr2=0x7fb07c1e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0737fe640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0701b0 0x7fb07c1e5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0737fe640 1 -- 172.21.15.63:0/1831717215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0740094d0 con 0x7fb07c0ca290 2023-12-04T10:44:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0737fe640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0ca290 0x7fb07c13edd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c450 tx=0x7fb06400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0797fa640 1 -- 172.21.15.63:0/1831717215 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0640052d0 con 0x7fb07c0ca290 2023-12-04T10:44:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0797fa640 1 -- 172.21.15.63:0/1831717215 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064005430 con 0x7fb07c0ca290 2023-12-04T10:44:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb0797fa640 1 -- 172.21.15.63:0/1831717215 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb064012870 con 0x7fb07c0ca290 2023-12-04T10:44:49.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.167+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c1e4c60 con 0x7fb07c0ca290 2023-12-04T10:44:49.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.168+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c13f310 con 0x7fb07c0ca290 2023-12-04T10:44:49.174 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.169+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c068710 con 0x7fb07c0ca290 2023-12-04T10:44:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.170+0000 7fb0797fa640 1 -- 172.21.15.63:0/1831717215 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb0640129d0 con 0x7fb07c0ca290 2023-12-04T10:44:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.171+0000 7fb0797fa640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb05c06ae40 0x7fb05c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.171+0000 7fb0797fa640 1 -- 172.21.15.63:0/1831717215 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb064089510 con 0x7fb07c0ca290 2023-12-04T10:44:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.171+0000 7fb07bfff640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb05c06ae40 0x7fb05c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.175 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.172+0000 7fb07bfff640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb05c06ae40 0x7fb05c06d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0073f0 tx=0x7fb06c00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:49.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.175+0000 7fb0797fa640 1 -- 172.21.15.63:0/1831717215 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb064054160 con 0x7fb07c0ca290 2023-12-04T10:44:49.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.370+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb07c06e2a0 con 0x7fb07c0ca290 2023-12-04T10:44:49.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.372+0000 7fb0797fa640 1 -- 172.21.15.63:0/1831717215 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7fb064057780 con 0x7fb07c0ca290 2023-12-04T10:44:49.375 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:49.375 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb05c06ae40 msgr2=0x7fb05c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb05c06ae40 0x7fb05c06d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb06c0073f0 tx=0x7fb06c00b040 comp rx=0 tx=0).stop 2023-12-04T10:44:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0ca290 msgr2=0x7fb07c13edd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0ca290 0x7fb07c13edd0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fb06400c450 tx=0x7fb06400c910 comp rx=0 tx=0).stop 2023-12-04T10:44:49.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 shutdown_connections 2023-12-04T10:44:49.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb05c06ae40 0x7fb05c06d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb07c144a00 0x7fb07c1e3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb07c0ca290 0x7fb07c13edd0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 --2- 172.21.15.63:0/1831717215 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb07c0701b0 0x7fb07c1e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 >> 172.21.15.63:0/1831717215 conn(0x7fb07c0cee80 msgr2=0x7fb07c0ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:49.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 shutdown_connections 2023-12-04T10:44:49.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.375+0000 7fb08283d640 1 -- 172.21.15.63:0/1831717215 wait complete. 2023-12-04T10:44:49.398 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:49.398 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:49.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.610+0000 7f0924c7c640 1 Processor -- start 2023-12-04T10:44:49.613 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.611+0000 7f0924c7c640 1 -- start start 2023-12-04T10:44:49.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.612+0000 7f0924c7c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f092015d5d0 0x7f09200d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.612+0000 7f0924c7c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09200d1fb0 0x7f09200b3160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.612+0000 7f0924c7c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09200b2710 con 0x7f09200ce8e0 2023-12-04T10:44:49.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.612+0000 7f0924c7c640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200ced70 con 0x7f09200d1fb0 2023-12-04T10:44:49.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.612+0000 7f0924c7c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09200cf050 con 0x7f092015d5d0 2023-12-04T10:44:49.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.613+0000 7f091ed9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09200d1fb0 0x7f09200b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.613+0000 7f091ed9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f09200d1fb0 0x7f09200b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39250/0 (socket says 172.21.15.63:39250) 2023-12-04T10:44:49.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.613+0000 7f091ed9d640 1 -- 172.21.15.63:0/429015336 learned_addr learned my addr 172.21.15.63:0/429015336 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.613+0000 7f091e59c640 1 --2- 172.21.15.63:0/429015336 >> v2:172.21.15.66:3300/0 conn(0x7f092015d5d0 0x7f09200d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.613+0000 7f091ed9d640 1 -- 172.21.15.63:0/429015336 >> v2:172.21.15.66:3300/0 conn(0x7f092015d5d0 msgr2=0x7f09200d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.613+0000 7f091ed9d640 1 --2- 172.21.15.63:0/429015336 >> v2:172.21.15.66:3300/0 conn(0x7f092015d5d0 0x7f09200d3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.613+0000 7f091ed9d640 1 -- 172.21.15.63:0/429015336 >> v1:172.21.15.66:6789/0 conn(0x7f09200ce8e0 legacy=0x7f09200d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.613+0000 7f091ed9d640 1 -- 172.21.15.63:0/429015336 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09200b2960 con 0x7f09200d1fb0 2023-12-04T10:44:49.616 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.615+0000 7f091ed9d640 1 --2- 172.21.15.63:0/429015336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f09200b3160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f092008da80 tx=0x7f091802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea0bba70a7cf383a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.615+0000 7f091dd9b640 1 -- 172.21.15.63:0/429015336 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091802ca80 con 0x7f09200d1fb0 2023-12-04T10:44:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.615+0000 7f091dd9b640 1 -- 172.21.15.63:0/429015336 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091802cbe0 con 0x7f09200d1fb0 2023-12-04T10:44:49.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.615+0000 7f091dd9b640 1 -- 172.21.15.63:0/429015336 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09180343f0 con 0x7f09200d1fb0 2023-12-04T10:44:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.616+0000 7f0924c7c640 1 -- 172.21.15.63:0/429015336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 msgr2=0x7f09200b3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.616+0000 7f0924c7c640 1 --2- 172.21.15.63:0/429015336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f09200b3160 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f092008da80 tx=0x7f091802bee0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.616+0000 7f0924c7c640 1 -- 172.21.15.63:0/429015336 shutdown_connections 2023-12-04T10:44:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.616+0000 7f0924c7c640 1 --2- 172.21.15.63:0/429015336 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f09200b3160 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.616+0000 7f0924c7c640 1 --2- 172.21.15.63:0/429015336 >> v2:172.21.15.66:3300/0 conn(0x7f092015d5d0 0x7f09200d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.616+0000 7f0924c7c640 1 -- 172.21.15.63:0/429015336 >> 172.21.15.63:0/429015336 conn(0x7f092009c600 msgr2=0x7f09200d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:49.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.616+0000 7f0924c7c640 1 -- 172.21.15.63:0/429015336 shutdown_connections 2023-12-04T10:44:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.616+0000 7f0924c7c640 1 -- 172.21.15.63:0/429015336 wait complete. 2023-12-04T10:44:49.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.618+0000 7f0924c7c640 1 Processor -- start 2023-12-04T10:44:49.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.618+0000 7f0924c7c640 1 -- start start 2023-12-04T10:44:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f0924c7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f092006b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f0924c7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f092015d5d0 0x7f092015b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f0924c7c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f092015bd60 0x7f09200b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f0924c7c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f092015c210 con 0x7f09200d1fb0 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f0924c7c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09200b9120 con 0x7f092015bd60 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f0924c7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09200b85a0 con 0x7f092015d5d0 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f091e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f092006b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f091e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f092006b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39258/0 (socket says 172.21.15.63:39258) 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f091e59c640 1 -- 172.21.15.63:0/1350417644 learned_addr learned my addr 172.21.15.63:0/1350417644 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f091ed9d640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f092015bd60 0x7f09200b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.619+0000 7f0917fff640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f092015d5d0 0x7f092015b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f091e59c640 1 -- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f092015d5d0 msgr2=0x7f092015b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f091e59c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f092015d5d0 0x7f092015b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.622 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f091e59c640 1 -- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f092015bd60 msgr2=0x7f09200b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f091e59c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f092015bd60 0x7f09200b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f091e59c640 1 -- 172.21.15.63:0/1350417644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0918009b30 con 0x7f09200d1fb0 2023-12-04T10:44:49.623 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f0917fff640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f092015d5d0 0x7f092015b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f091e59c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f092006b3d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f091000d5f0 tx=0x7f091000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f0916ffd640 1 -- 172.21.15.63:0/1350417644 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09100125f0 con 0x7f09200d1fb0 2023-12-04T10:44:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f0916ffd640 1 -- 172.21.15.63:0/1350417644 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0910012750 con 0x7f09200d1fb0 2023-12-04T10:44:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09200b8880 con 0x7f09200d1fb0 2023-12-04T10:44:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f0916ffd640 1 -- 172.21.15.63:0/1350417644 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0910012b00 con 0x7f09200d1fb0 2023-12-04T10:44:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.620+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09200b8e40 con 0x7f09200d1fb0 2023-12-04T10:44:49.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.622+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0920068710 con 0x7f09200d1fb0 2023-12-04T10:44:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.622+0000 7f0916ffd640 1 -- 172.21.15.63:0/1350417644 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0910012c60 con 0x7f09200d1fb0 2023-12-04T10:44:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.623+0000 7f0916ffd640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f090006ae40 0x7f090006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.624+0000 7f0916ffd640 1 -- 172.21.15.63:0/1350417644 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0910089e00 con 0x7f09200d1fb0 2023-12-04T10:44:49.625 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.624+0000 7f0917fff640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f090006ae40 0x7f090006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:49.626 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.624+0000 7f0917fff640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f090006ae40 0x7f090006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f09201f6320 tx=0x7f0908009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:49.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.628+0000 7f0916ffd640 1 -- 172.21.15.63:0/1350417644 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0910054b80 con 0x7f09200d1fb0 2023-12-04T10:44:49.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.812+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f09200b3f80 con 0x7f09200d1fb0 2023-12-04T10:44:49.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.813+0000 7f0916ffd640 1 -- 172.21.15.63:0/1350417644 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f09100581a0 con 0x7f09200d1fb0 2023-12-04T10:44:49.816 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f090006ae40 msgr2=0x7f090006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f090006ae40 0x7f090006d300 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f09201f6320 tx=0x7f0908009040 comp rx=0 tx=0).stop 2023-12-04T10:44:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 msgr2=0x7f092006b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f092006b3d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f091000d5f0 tx=0x7f091000dab0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 shutdown_connections 2023-12-04T10:44:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f090006ae40 0x7f090006d300 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f092015d5d0 0x7f092015b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f092015bd60 0x7f09200b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 --2- 172.21.15.63:0/1350417644 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f09200d1fb0 0x7f092006b3d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:49.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 >> 172.21.15.63:0/1350417644 conn(0x7f092009c600 msgr2=0x7f09200d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:49.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 shutdown_connections 2023-12-04T10:44:49.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:49.816+0000 7f0924c7c640 1 -- 172.21.15.63:0/1350417644 wait complete. 2023-12-04T10:44:49.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:50.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.053+0000 7fa8548c5640 1 Processor -- start 2023-12-04T10:44:50.056 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.053+0000 7fa8548c5640 1 -- start start 2023-12-04T10:44:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.055+0000 7fa8548c5640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa85014ae80 0x7fa8500703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.055+0000 7fa8548c5640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa850070bf0 con 0x7fa8500b2270 2023-12-04T10:44:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.055+0000 7fa8548c5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa850070ed0 con 0x7fa850161b60 2023-12-04T10:44:50.057 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.055+0000 7fa8548c5640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8500711b0 con 0x7fa85014ae80 2023-12-04T10:44:50.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.056+0000 7fa84f59e640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa8500b2270 0x7fa85006bef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45702/0 (socket says 172.21.15.63:45702) 2023-12-04T10:44:50.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.056+0000 7fa84f59e640 1 -- 172.21.15.63:0/3140238826 learned_addr learned my addr 172.21.15.63:0/3140238826 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:50.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.056+0000 7fa84ed9d640 1 --2- 172.21.15.63:0/3140238826 >> v2:172.21.15.63:3300/0 conn(0x7fa85014ae80 0x7fa8500703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.056+0000 7fa84dd9b640 1 -- 172.21.15.63:0/3140238826 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076308243 0 0) 0x7fa850070bf0 con 0x7fa8500b2270 2023-12-04T10:44:50.058 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.056+0000 7fa84dd9b640 1 -- 172.21.15.63:0/3140238826 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa838003520 con 0x7fa8500b2270 2023-12-04T10:44:50.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.056+0000 7fa84ed9d640 1 -- 172.21.15.63:0/3140238826 >> v1:172.21.15.66:6789/0 conn(0x7fa850161b60 legacy=0x7fa8500b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.056+0000 7fa84ed9d640 1 -- 172.21.15.63:0/3140238826 >> v1:172.21.15.63:6789/0 conn(0x7fa8500b2270 legacy=0x7fa85006bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.056+0000 7fa84ed9d640 1 -- 172.21.15.63:0/3140238826 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa850071490 con 0x7fa85014ae80 2023-12-04T10:44:50.059 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.057+0000 7fa84ed9d640 1 --2- 172.21.15.63:0/3140238826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa8500703c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8400097a0 tx=0x7fa84002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de938ac7d6d14e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.058+0000 7fa84dd9b640 1 -- 172.21.15.63:0/3140238826 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840030610 con 0x7fa85014ae80 2023-12-04T10:44:50.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.058+0000 7fa84dd9b640 1 -- 172.21.15.63:0/3140238826 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa840030770 con 0x7fa85014ae80 2023-12-04T10:44:50.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.058+0000 7fa84dd9b640 1 -- 172.21.15.63:0/3140238826 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840030ae0 con 0x7fa85014ae80 2023-12-04T10:44:50.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.058+0000 7fa8548c5640 1 -- 172.21.15.63:0/3140238826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 msgr2=0x7fa8500703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.060 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.058+0000 7fa8548c5640 1 --2- 172.21.15.63:0/3140238826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa8500703c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa8400097a0 tx=0x7fa84002b960 comp rx=0 tx=0).stop 2023-12-04T10:44:50.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.058+0000 7fa8548c5640 1 -- 172.21.15.63:0/3140238826 shutdown_connections 2023-12-04T10:44:50.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.058+0000 7fa8548c5640 1 --2- 172.21.15.63:0/3140238826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa8500703c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.058+0000 7fa8548c5640 1 -- 172.21.15.63:0/3140238826 >> 172.21.15.63:0/3140238826 conn(0x7fa8500b0860 msgr2=0x7fa8500b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:50.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.059+0000 7fa8548c5640 1 -- 172.21.15.63:0/3140238826 shutdown_connections 2023-12-04T10:44:50.061 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.059+0000 7fa8548c5640 1 -- 172.21.15.63:0/3140238826 wait complete. 2023-12-04T10:44:50.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.061+0000 7fa8548c5640 1 Processor -- start 2023-12-04T10:44:50.062 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.061+0000 7fa8548c5640 1 -- start start 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.062+0000 7fa8548c5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8500b2270 0x7fa8501f6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.062+0000 7fa8548c5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa850164bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.062+0000 7fa8548c5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa850161b60 0x7fa850165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.062+0000 7fa8548c5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85015a330 con 0x7fa85014ae80 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.062+0000 7fa8548c5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa85015cfe0 con 0x7fa8500b2270 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.062+0000 7fa8548c5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa850159c70 con 0x7fa850161b60 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.062+0000 7fa84e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa850164bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.062+0000 7fa84e59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa850164bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39278/0 (socket says 172.21.15.63:39278) 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84e59c640 1 -- 172.21.15.63:0/3483791679 learned_addr learned my addr 172.21.15.63:0/3483791679 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84ed9d640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8500b2270 0x7fa8501f6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84f59e640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa850161b60 0x7fa850165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.065 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84e59c640 1 -- 172.21.15.63:0/3483791679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa850161b60 msgr2=0x7fa850165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84e59c640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa850161b60 0x7fa850165100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84e59c640 1 -- 172.21.15.63:0/3483791679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8500b2270 msgr2=0x7fa8501f6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84e59c640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8500b2270 0x7fa8501f6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84e59c640 1 -- 172.21.15.63:0/3483791679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa840009400 con 0x7fa85014ae80 2023-12-04T10:44:50.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa84e59c640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa850164bc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c370 tx=0x7fa84400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.063+0000 7fa8377fe640 1 -- 172.21.15.63:0/3483791679 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8440052d0 con 0x7fa85014ae80 2023-12-04T10:44:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.064+0000 7fa8377fe640 1 -- 172.21.15.63:0/3483791679 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa844005430 con 0x7fa85014ae80 2023-12-04T10:44:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.064+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa850159f50 con 0x7fa85014ae80 2023-12-04T10:44:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.064+0000 7fa8377fe640 1 -- 172.21.15.63:0/3483791679 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844003880 con 0x7fa85014ae80 2023-12-04T10:44:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.064+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85015c270 con 0x7fa85014ae80 2023-12-04T10:44:50.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.065+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa85015a470 con 0x7fa85014ae80 2023-12-04T10:44:50.068 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.066+0000 7fa8377fe640 1 -- 172.21.15.63:0/3483791679 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8440039e0 con 0x7fa85014ae80 2023-12-04T10:44:50.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.067+0000 7fa8377fe640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.068+0000 7fa8377fe640 1 -- 172.21.15.63:0/3483791679 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa844088fa0 con 0x7fa85014ae80 2023-12-04T10:44:50.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.068+0000 7fa84ed9d640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.069+0000 7fa84ed9d640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa83c06ae40 0x7fa83c06d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa840036000 tx=0x7fa840008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.072+0000 7fa8377fe640 1 -- 172.21.15.63:0/3483791679 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa85015a470 con 0x7fa85014ae80 2023-12-04T10:44:50.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.258+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa85015a470 con 0x7fa85014ae80 2023-12-04T10:44:50.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.259+0000 7fa8377fe640 1 -- 172.21.15.63:0/3483791679 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa844017020 con 0x7fa85014ae80 2023-12-04T10:44:50.262 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa83c06ae40 msgr2=0x7fa83c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa83c06ae40 0x7fa83c06d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa840036000 tx=0x7fa840008030 comp rx=0 tx=0).stop 2023-12-04T10:44:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 msgr2=0x7fa850164bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa850164bc0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fa84400c370 tx=0x7fa84400c830 comp rx=0 tx=0).stop 2023-12-04T10:44:50.264 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 shutdown_connections 2023-12-04T10:44:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa83c06ae40 0x7fa83c06d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa850161b60 0x7fa850165100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa85014ae80 0x7fa850164bc0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 --2- 172.21.15.63:0/3483791679 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8500b2270 0x7fa8501f6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 >> 172.21.15.63:0/3483791679 conn(0x7fa8500b0860 msgr2=0x7fa8500aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:50.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 shutdown_connections 2023-12-04T10:44:50.266 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.262+0000 7fa8548c5640 1 -- 172.21.15.63:0/3483791679 wait complete. 2023-12-04T10:44:50.283 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.508+0000 7f18ad55c640 1 Processor -- start 2023-12-04T10:44:50.510 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.508+0000 7f18ad55c640 1 -- start start 2023-12-04T10:44:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.509+0000 7f18ad55c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f18a80cf180 0x7f18a80b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.509+0000 7f18ad55c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 0x7f18a80b1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.509+0000 7f18ad55c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a80ce810 con 0x7f18a815b450 2023-12-04T10:44:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.509+0000 7f18ad55c640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a80ccdd0 con 0x7f18a80cf180 2023-12-04T10:44:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.509+0000 7f18ad55c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80cc810 con 0x7f18a80cf5f0 2023-12-04T10:44:50.512 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.509+0000 7f18a7fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f18a815b450 0x7f18a80cea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45718/0 (socket says 172.21.15.63:45718) 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.509+0000 7f18a7fff640 1 -- 172.21.15.63:0/498815226 learned_addr learned my addr 172.21.15.63:0/498815226 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.509+0000 7f18a77fe640 1 --2- 172.21.15.63:0/498815226 >> v2:172.21.15.63:3300/0 conn(0x7f18a80cf180 0x7f18a80b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.510+0000 7f18acd5b640 1 --2- 172.21.15.63:0/498815226 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 0x7f18a80b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.510+0000 7f18a6ffd640 1 -- 172.21.15.63:0/498815226 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3219265071 0 0) 0x7f18a80ce810 con 0x7f18a815b450 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.510+0000 7f18a6ffd640 1 -- 172.21.15.63:0/498815226 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1890003520 con 0x7f18a815b450 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.510+0000 7f18a77fe640 1 -- 172.21.15.63:0/498815226 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 msgr2=0x7f18a80b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.510+0000 7f18a77fe640 1 --2- 172.21.15.63:0/498815226 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 0x7f18a80b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.510+0000 7f18a77fe640 1 -- 172.21.15.63:0/498815226 >> v1:172.21.15.63:6789/0 conn(0x7f18a815b450 legacy=0x7f18a80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.513 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.510+0000 7f18a77fe640 1 -- 172.21.15.63:0/498815226 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a80ccaf0 con 0x7f18a80cf180 2023-12-04T10:44:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.511+0000 7f18a77fe640 1 --2- 172.21.15.63:0/498815226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a80b0d50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f189c0097d0 tx=0x7f189c02b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4a50ec4ae48e107 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18a6ffd640 1 -- 172.21.15.63:0/498815226 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c031800 con 0x7f18a80cf180 2023-12-04T10:44:50.514 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18a6ffd640 1 -- 172.21.15.63:0/498815226 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189c031960 con 0x7f18a80cf180 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18a6ffd640 1 -- 172.21.15.63:0/498815226 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189c031cf0 con 0x7f18a80cf180 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18ad55c640 1 -- 172.21.15.63:0/498815226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 msgr2=0x7f18a80b0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18ad55c640 1 --2- 172.21.15.63:0/498815226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a80b0d50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f189c0097d0 tx=0x7f189c02b8a0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18ad55c640 1 -- 172.21.15.63:0/498815226 shutdown_connections 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18ad55c640 1 --2- 172.21.15.63:0/498815226 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 0x7f18a80b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18ad55c640 1 --2- 172.21.15.63:0/498815226 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a80b0d50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18ad55c640 1 -- 172.21.15.63:0/498815226 >> 172.21.15.63:0/498815226 conn(0x7f18a80b29b0 msgr2=0x7f18a80b2d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18ad55c640 1 -- 172.21.15.63:0/498815226 shutdown_connections 2023-12-04T10:44:50.515 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.512+0000 7f18ad55c640 1 -- 172.21.15.63:0/498815226 wait complete. 2023-12-04T10:44:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.514+0000 7f18ad55c640 1 Processor -- start 2023-12-04T10:44:50.516 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.514+0000 7f18ad55c640 1 -- start start 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.515+0000 7f18ad55c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a814f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.515+0000 7f18ad55c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 0x7f18a80b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18ad55c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a815b450 0x7f18a80c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18ad55c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80b5040 con 0x7f18a80cf180 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18ad55c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a814f780 con 0x7f18a815b450 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18ad55c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a80b4150 con 0x7f18a80cf5f0 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a814f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a814f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39296/0 (socket says 172.21.15.63:39296) 2023-12-04T10:44:50.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a7fff640 1 -- 172.21.15.63:0/51295620 learned_addr learned my addr 172.21.15.63:0/51295620 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a77fe640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 0x7f18a80b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.519 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18acd5b640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a815b450 0x7f18a80c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a7fff640 1 -- 172.21.15.63:0/51295620 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 msgr2=0x7f18a80b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a7fff640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 0x7f18a80b54d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a7fff640 1 -- 172.21.15.63:0/51295620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a815b450 msgr2=0x7f18a80c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a7fff640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a815b450 0x7f18a80c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.516+0000 7f18a7fff640 1 -- 172.21.15.63:0/51295620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c009400 con 0x7f18a80cf180 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.517+0000 7f18a7fff640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a814f240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f189800cbc0 tx=0x7f189800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.517+0000 7f18a4ff9640 1 -- 172.21.15.63:0/51295620 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800ad40 con 0x7f18a80cf180 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.517+0000 7f18a4ff9640 1 -- 172.21.15.63:0/51295620 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898012400 con 0x7f18a80cf180 2023-12-04T10:44:50.520 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.517+0000 7f18a4ff9640 1 -- 172.21.15.63:0/51295620 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800aea0 con 0x7f18a80cf180 2023-12-04T10:44:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.517+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a80b4430 con 0x7f18a80cf180 2023-12-04T10:44:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.517+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a80b49f0 con 0x7f18a80cf180 2023-12-04T10:44:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.518+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a80ce7c0 con 0x7f18a80cf180 2023-12-04T10:44:50.521 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.519+0000 7f18a4ff9640 1 -- 172.21.15.63:0/51295620 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1898007070 con 0x7f18a80cf180 2023-12-04T10:44:50.522 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.520+0000 7f18a4ff9640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f189406ae40 0x7f189406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.520+0000 7f18a4ff9640 1 -- 172.21.15.63:0/51295620 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f18980899f0 con 0x7f18a80cf180 2023-12-04T10:44:50.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.520+0000 7f18a77fe640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f189406ae40 0x7f189406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.521+0000 7f18a77fe640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f189406ae40 0x7f189406d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f189c036000 tx=0x7f189c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.524+0000 7f18a4ff9640 1 -- 172.21.15.63:0/51295620 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f18980546f0 con 0x7f18a80cf180 2023-12-04T10:44:50.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.718+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f18a804e840 con 0x7f18a80cf180 2023-12-04T10:44:50.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.719+0000 7f18a4ff9640 1 -- 172.21.15.63:0/51295620 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f18980170a0 con 0x7f18a80cf180 2023-12-04T10:44:50.721 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:44:50.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.722+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f189406ae40 msgr2=0x7f189406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.722+0000 7f18ad55c640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f189406ae40 0x7f189406d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f189c036000 tx=0x7f189c03c040 comp rx=0 tx=0).stop 2023-12-04T10:44:50.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.722+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 msgr2=0x7f18a814f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.724 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.722+0000 7f18ad55c640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a814f240 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f189800cbc0 tx=0x7f189800a430 comp rx=0 tx=0).stop 2023-12-04T10:44:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.723+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 shutdown_connections 2023-12-04T10:44:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.723+0000 7f18ad55c640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f189406ae40 0x7f189406d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.723+0000 7f18ad55c640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f18a80cf5f0 0x7f18a80b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.723+0000 7f18ad55c640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f18a815b450 0x7f18a80c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.723+0000 7f18ad55c640 1 --2- 172.21.15.63:0/51295620 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f18a80cf180 0x7f18a814f240 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.723+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 >> 172.21.15.63:0/51295620 conn(0x7f18a80b29b0 msgr2=0x7f18a806c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.723+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 shutdown_connections 2023-12-04T10:44:50.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.723+0000 7f18ad55c640 1 -- 172.21.15.63:0/51295620 wait complete. 2023-12-04T10:44:50.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:44:50.972 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.970+0000 7f6f9e128640 1 Processor -- start 2023-12-04T10:44:50.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.971+0000 7f6f9e128640 1 -- start start 2023-12-04T10:44:50.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.972+0000 7f6f9e128640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6f980d0180 0x7f6f98168220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.972+0000 7f6f9e128640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f980b6f70 con 0x7f6f9815d5e0 2023-12-04T10:44:50.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.972+0000 7f6f9e128640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f980d0e60 con 0x7f6f9815d200 2023-12-04T10:44:50.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.972+0000 7f6f9e128640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f980d1140 con 0x7f6f980d0180 2023-12-04T10:44:50.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.973+0000 7f6f9c925640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6f9815d5e0 0x7f6f980ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45730/0 (socket says 172.21.15.63:45730) 2023-12-04T10:44:50.975 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.973+0000 7f6f9c925640 1 -- 172.21.15.63:0/1228979431 learned_addr learned my addr 172.21.15.63:0/1228979431 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.973+0000 7f6f9d927640 1 --2- 172.21.15.63:0/1228979431 >> v2:172.21.15.66:3300/0 conn(0x7f6f980d0180 0x7f6f98168220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.973+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690808731 0 0) 0x7f6f980b6f70 con 0x7f6f9815d5e0 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.973+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f88003520 con 0x7f6f9815d5e0 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2497442499 0 0) 0x7f6f88003520 con 0x7f6f9815d5e0 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 >> v2:172.21.15.66:3300/0 conn(0x7f6f980d0180 msgr2=0x7f6f98168220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 --2- 172.21.15.63:0/1228979431 >> v2:172.21.15.66:3300/0 conn(0x7f6f980d0180 0x7f6f98168220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 >> v1:172.21.15.66:6789/0 conn(0x7f6f9815d200 legacy=0x7f6f980cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980d1420 con 0x7f6f9815d5e0 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f6f84001670 con 0x7f6f9815d5e0 2023-12-04T10:44:50.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 >> v1:172.21.15.63:6789/0 conn(0x7f6f9815d5e0 legacy=0x7f6f980ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f88003970 0x7f6f88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f88005180 0x7f6f8800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980d1140 con 0x7f6f880047c0 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8800c120 con 0x7f6f88003970 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8800c2e0 con 0x7f6f88005180 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f9c925640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.974+0000 7f6f9d927640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f88005180 0x7f6f8800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.975+0000 7f6f9d126640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f88003970 0x7f6f88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.975+0000 7f6f9c925640 1 -- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f88005180 msgr2=0x7f6f8800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:50.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.975+0000 7f6f9c925640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f88005180 0x7f6f8800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.975+0000 7f6f9c925640 1 -- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f88003970 msgr2=0x7f6f88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:50.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.975+0000 7f6f9c925640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f88003970 0x7f6f88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.975+0000 7f6f9c925640 1 -- 172.21.15.63:0/1228979431 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f88003520 con 0x7f6f880047c0 2023-12-04T10:44:50.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.975+0000 7f6f9d927640 1 -- 172.21.15.63:0/1228979431 reap_dead start 2023-12-04T10:44:50.979 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.975+0000 7f6f9d126640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f88003970 0x7f6f88003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.976+0000 7f6f9c925640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f88004c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400c190 tx=0x7f6f880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e1d2eb30357760f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.976+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f84005ad0 con 0x7f6f880047c0 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.976+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f84005c30 con 0x7f6f880047c0 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.976+0000 7f6f97fff640 1 -- 172.21.15.63:0/1228979431 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8402ca70 con 0x7f6f880047c0 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.977+0000 7f6f9e128640 1 -- 172.21.15.63:0/1228979431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 msgr2=0x7f6f88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.977+0000 7f6f9e128640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f88004c40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6f8400c190 tx=0x7f6f880057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.977+0000 7f6f9e128640 1 -- 172.21.15.63:0/1228979431 shutdown_connections 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.977+0000 7f6f9e128640 1 --2- 172.21.15.63:0/1228979431 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f88004c40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.977+0000 7f6f9e128640 1 -- 172.21.15.63:0/1228979431 >> 172.21.15.63:0/1228979431 conn(0x7f6f9809c3e0 msgr2=0x7f6f980d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.977+0000 7f6f9e128640 1 -- 172.21.15.63:0/1228979431 shutdown_connections 2023-12-04T10:44:50.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.977+0000 7f6f9e128640 1 -- 172.21.15.63:0/1228979431 wait complete. 2023-12-04T10:44:50.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.979+0000 7f6f9e128640 1 Processor -- start 2023-12-04T10:44:50.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.979+0000 7f6f9e128640 1 -- start start 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9e128640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f980c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9e128640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9814d770 0x7f6f981570c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9e128640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f98157600 0x7f6f980cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9e128640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980cb680 con 0x7f6f880047c0 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9e128640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980cb960 con 0x7f6f98157600 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9e128640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f980cbc40 con 0x7f6f9814d770 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9d126640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f980c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9d126640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f980c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39316/0 (socket says 172.21.15.63:39316) 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9d126640 1 -- 172.21.15.63:0/806960766 learned_addr learned my addr 172.21.15.63:0/806960766 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9c925640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9814d770 0x7f6f981570c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9d927640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f98157600 0x7f6f980cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9d126640 1 -- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9814d770 msgr2=0x7f6f981570c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.980+0000 7f6f9d126640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9814d770 0x7f6f981570c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f9d126640 1 -- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f98157600 msgr2=0x7f6f980cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f9d126640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f98157600 0x7f6f980cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f9d126640 1 -- 172.21.15.63:0/806960766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f980d2080 con 0x7f6f880047c0 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f9c925640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9814d770 0x7f6f981570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f9d126640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f980c96e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00d810 tx=0x7f6f8c00dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f95ffb640 1 -- 172.21.15.63:0/806960766 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c003990 con 0x7f6f880047c0 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f95ffb640 1 -- 172.21.15.63:0/806960766 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f8c003b10 con 0x7f6f880047c0 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f95ffb640 1 -- 172.21.15.63:0/806960766 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f8c00b6b0 con 0x7f6f880047c0 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f980cbf20 con 0x7f6f880047c0 2023-12-04T10:44:50.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.981+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f98156cf0 con 0x7f6f880047c0 2023-12-04T10:44:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.983+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f9804e840 con 0x7f6f880047c0 2023-12-04T10:44:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.983+0000 7f6f95ffb640 1 -- 172.21.15.63:0/806960766 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f8c00b810 con 0x7f6f880047c0 2023-12-04T10:44:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.984+0000 7f6f95ffb640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f7c06ae40 0x7f6f7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:50.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.984+0000 7f6f95ffb640 1 -- 172.21.15.63:0/806960766 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6f8c089250 con 0x7f6f880047c0 2023-12-04T10:44:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.985+0000 7f6f9c925640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f7c06ae40 0x7f6f7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:50.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.985+0000 7f6f9c925640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f7c06ae40 0x7f6f7c06d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034000 tx=0x7f6f84009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:50.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:50.989+0000 7f6f95ffb640 1 -- 172.21.15.63:0/806960766 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f8c053ff0 con 0x7f6f880047c0 2023-12-04T10:44:51.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.183+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f6f980d0750 con 0x7f6f880047c0 2023-12-04T10:44:51.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.184+0000 7f6f95ffb640 1 -- 172.21.15.63:0/806960766 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f6f8c057610 con 0x7f6f880047c0 2023-12-04T10:44:51.186 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:51.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f7c06ae40 msgr2=0x7f6f7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f7c06ae40 0x7f6f7c06d300 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6f84034000 tx=0x7f6f84009030 comp rx=0 tx=0).stop 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 msgr2=0x7f6f980c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f980c96e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c00d810 tx=0x7f6f8c00dcd0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 shutdown_connections 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6f7c06ae40 0x7f6f7c06d300 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6f9814d770 0x7f6f981570c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f98157600 0x7f6f980cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.186+0000 7f6f9e128640 1 --2- 172.21.15.63:0/806960766 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6f880047c0 0x7f6f980c96e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.187+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 >> 172.21.15.63:0/806960766 conn(0x7f6f9809c3e0 msgr2=0x7f6f9806c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.187+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 shutdown_connections 2023-12-04T10:44:51.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.187+0000 7f6f9e128640 1 -- 172.21.15.63:0/806960766 wait complete. 2023-12-04T10:44:51.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:51.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.431+0000 7f7417fff640 1 Processor -- start 2023-12-04T10:44:51.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.432+0000 7f7417fff640 1 -- start start 2023-12-04T10:44:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.433+0000 7f7417fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7418151ca0 0x7f741806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.434+0000 7f7417fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f741806e0b0 0x7f7418071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.434+0000 7f7417fff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74180cc7f0 con 0x7f741815b470 2023-12-04T10:44:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.434+0000 7f7417fff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74180cca40 con 0x7f741806e0b0 2023-12-04T10:44:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.434+0000 7f7417fff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74180ccd20 con 0x7f7418151ca0 2023-12-04T10:44:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.434+0000 7f74177fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f741806e0b0 0x7f7418071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.434+0000 7f74177fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f741806e0b0 0x7f7418071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39318/0 (socket says 172.21.15.63:39318) 2023-12-04T10:44:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.434+0000 7f74177fe640 1 -- 172.21.15.63:0/2522795368 learned_addr learned my addr 172.21.15.63:0/2522795368 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.434+0000 7f7416ffd640 1 --2- 172.21.15.63:0/2522795368 >> v2:172.21.15.66:3300/0 conn(0x7f7418151ca0 0x7f741806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.435+0000 7f74177fe640 1 -- 172.21.15.63:0/2522795368 >> v2:172.21.15.66:3300/0 conn(0x7f7418151ca0 msgr2=0x7f741806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.435+0000 7f74177fe640 1 --2- 172.21.15.63:0/2522795368 >> v2:172.21.15.66:3300/0 conn(0x7f7418151ca0 0x7f741806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.435+0000 7f74177fe640 1 -- 172.21.15.63:0/2522795368 >> v1:172.21.15.66:6789/0 conn(0x7f741815b470 legacy=0x7f74180cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:51.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.435+0000 7f74177fe640 1 -- 172.21.15.63:0/2522795368 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74180cd000 con 0x7f741806e0b0 2023-12-04T10:44:51.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.436+0000 7f74177fe640 1 --2- 172.21.15.63:0/2522795368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f741806e0b0 0x7f7418071740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f74180cdfb0 tx=0x7f741002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a8da25cc72e2f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:51.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.436+0000 7f74167fc640 1 -- 172.21.15.63:0/2522795368 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741002c9f0 con 0x7f741806e0b0 2023-12-04T10:44:51.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.436+0000 7f74167fc640 1 -- 172.21.15.63:0/2522795368 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741002cb50 con 0x7f741806e0b0 2023-12-04T10:44:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f74167fc640 1 -- 172.21.15.63:0/2522795368 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74100343f0 con 0x7f741806e0b0 2023-12-04T10:44:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f7417fff640 1 -- 172.21.15.63:0/2522795368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f741806e0b0 msgr2=0x7f7418071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f7417fff640 1 --2- 172.21.15.63:0/2522795368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f741806e0b0 0x7f7418071740 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f74180cdfb0 tx=0x7f741002be50 comp rx=0 tx=0).stop 2023-12-04T10:44:51.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f7417fff640 1 -- 172.21.15.63:0/2522795368 shutdown_connections 2023-12-04T10:44:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f7417fff640 1 --2- 172.21.15.63:0/2522795368 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f741806e0b0 0x7f7418071740 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f7417fff640 1 --2- 172.21.15.63:0/2522795368 >> v2:172.21.15.66:3300/0 conn(0x7f7418151ca0 0x7f741806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f7417fff640 1 -- 172.21.15.63:0/2522795368 >> 172.21.15.63:0/2522795368 conn(0x7f74180b07f0 msgr2=0x7f74180b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f7417fff640 1 -- 172.21.15.63:0/2522795368 shutdown_connections 2023-12-04T10:44:51.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.437+0000 7f7417fff640 1 -- 172.21.15.63:0/2522795368 wait complete. 2023-12-04T10:44:51.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.439+0000 7f7417fff640 1 Processor -- start 2023-12-04T10:44:51.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.439+0000 7f7417fff640 1 -- start start 2023-12-04T10:44:51.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.440+0000 7f7417fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f741806e0b0 0x7f741814ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.440+0000 7f7417fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7418151ca0 0x7f74180ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.440+0000 7f7417fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74180cacd0 0x7f74180b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.440+0000 7f7417fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f741814d370 con 0x7f7418151ca0 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.440+0000 7f7417fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74180ca630 con 0x7f741806e0b0 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.440+0000 7f7417fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74180adc40 con 0x7f74180cacd0 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7418151ca0 0x7f74180ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7418151ca0 0x7f74180ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39322/0 (socket says 172.21.15.63:39322) 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 -- 172.21.15.63:0/1246700511 learned_addr learned my addr 172.21.15.63:0/1246700511 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f7416ffd640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f741806e0b0 0x7f741814ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f74177fe640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74180cacd0 0x7f74180b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 -- 172.21.15.63:0/1246700511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74180cacd0 msgr2=0x7f74180b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74180cacd0 0x7f74180b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 -- 172.21.15.63:0/1246700511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f741806e0b0 msgr2=0x7f741814ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f741806e0b0 0x7f741814ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 -- 172.21.15.63:0/1246700511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7410009b30 con 0x7f7418151ca0 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.441+0000 7f740ffff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7418151ca0 0x7f74180ca0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f740000b3f0 tx=0x7f740000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.442+0000 7f740f7fe640 1 -- 172.21.15.63:0/1246700511 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400011830 con 0x7f7418151ca0 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.442+0000 7f740f7fe640 1 -- 172.21.15.63:0/1246700511 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7400011990 con 0x7f7418151ca0 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.442+0000 7f740f7fe640 1 -- 172.21.15.63:0/1246700511 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400011d40 con 0x7f7418151ca0 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.442+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180ad350 con 0x7f7418151ca0 2023-12-04T10:44:51.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.442+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74180ad5f0 con 0x7f7418151ca0 2023-12-04T10:44:51.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.443+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74180addf0 con 0x7f7418151ca0 2023-12-04T10:44:51.446 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.444+0000 7f740f7fe640 1 -- 172.21.15.63:0/1246700511 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f740001a400 con 0x7f7418151ca0 2023-12-04T10:44:51.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.445+0000 7f740f7fe640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f73f806ae40 0x7f73f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.445+0000 7f740f7fe640 1 -- 172.21.15.63:0/1246700511 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f7400089810 con 0x7f7418151ca0 2023-12-04T10:44:51.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.445+0000 7f7416ffd640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f73f806ae40 0x7f73f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.446+0000 7f7416ffd640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f73f806ae40 0x7f73f806d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7408009a10 tx=0x7f7408008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:51.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.449+0000 7f740f7fe640 1 -- 172.21.15.63:0/1246700511 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f74180addf0 con 0x7f7418151ca0 2023-12-04T10:44:51.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.646+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f741806cf50 con 0x7f7418151ca0 2023-12-04T10:44:51.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.649+0000 7f740f7fe640 1 -- 172.21.15.63:0/1246700511 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f741806cf50 con 0x7f7418151ca0 2023-12-04T10:44:51.652 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:51.652 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:51.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f73f806ae40 msgr2=0x7f73f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f73f806ae40 0x7f73f806d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7408009a10 tx=0x7f7408008040 comp rx=0 tx=0).stop 2023-12-04T10:44:51.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7418151ca0 msgr2=0x7f74180ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7418151ca0 0x7f74180ca0f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f740000b3f0 tx=0x7f740000b8b0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 shutdown_connections 2023-12-04T10:44:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f73f806ae40 0x7f73f806d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f74180cacd0 0x7f74180b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f7418151ca0 0x7f74180ca0f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 --2- 172.21.15.63:0/1246700511 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f741806e0b0 0x7f741814ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 >> 172.21.15.63:0/1246700511 conn(0x7f74180b07f0 msgr2=0x7f741806ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 shutdown_connections 2023-12-04T10:44:51.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.652+0000 7f7417fff640 1 -- 172.21.15.63:0/1246700511 wait complete. 2023-12-04T10:44:51.675 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:51.676 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:51.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.900+0000 7fac060d1640 1 Processor -- start 2023-12-04T10:44:51.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.900+0000 7fac060d1640 1 -- start start 2023-12-04T10:44:51.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.902+0000 7fac060d1640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac00143950 0x7fac0006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.902+0000 7fac060d1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fac000b3790 0x7fac0015a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.902+0000 7fac060d1640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac0015b280 con 0x7fac0006dcf0 2023-12-04T10:44:51.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.902+0000 7fac060d1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac000710a0 con 0x7fac000b3790 2023-12-04T10:44:51.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.902+0000 7fac060d1640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac000b26f0 con 0x7fac00143950 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.903+0000 7fac058d0640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fac0006dcf0 0x7fac0015da10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45738/0 (socket says 172.21.15.63:45738) 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.903+0000 7fac058d0640 1 -- 172.21.15.63:0/739321730 learned_addr learned my addr 172.21.15.63:0/739321730 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.903+0000 7fac050cf640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac00143950 0x7fac0006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.903+0000 7fac048ce640 1 --2- 172.21.15.63:0/739321730 >> v2:172.21.15.66:3300/0 conn(0x7fac000b3790 0x7fac0015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.903+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133789824 0 0) 0x7fac0015b280 con 0x7fac0006dcf0 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.903+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fabec003520 con 0x7fac0006dcf0 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1514170278 0 0) 0x7fabec003520 con 0x7fac0006dcf0 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac00143950 msgr2=0x7fac0006d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac00143950 0x7fac0006d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 >> v2:172.21.15.66:3300/0 conn(0x7fac000b3790 msgr2=0x7fac0015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 --2- 172.21.15.63:0/739321730 >> v2:172.21.15.66:3300/0 conn(0x7fac000b3790 0x7fac0015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000b29d0 con 0x7fac0006dcf0 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fabf80019f0 con 0x7fac0006dcf0 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 >> v1:172.21.15.63:6789/0 conn(0x7fac0006dcf0 legacy=0x7fac0015da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac00143950 0x7fabec003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec003ef0 0x7fabec0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabec004d00 0x7fabec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac000710a0 con 0x7fabec004d00 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac000b26f0 con 0x7fabec003ef0 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabec00db90 con 0x7fac00143950 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.904+0000 7fac058d0640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabec004d00 0x7fabec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.905+0000 7fac050cf640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac00143950 0x7fabec003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.905+0000 7fac048ce640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec003ef0 0x7fabec0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.905+0000 7fac058d0640 1 -- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac00143950 msgr2=0x7fabec003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:51.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.905+0000 7fac058d0640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac00143950 0x7fabec003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.905+0000 7fac058d0640 1 -- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec003ef0 msgr2=0x7fabec0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:51.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.905+0000 7fac058d0640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec003ef0 0x7fabec0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.905+0000 7fac058d0640 1 -- 172.21.15.63:0/739321730 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec003520 con 0x7fabec004d00 2023-12-04T10:44:51.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.905+0000 7fac048ce640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec003ef0 0x7fabec0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.906+0000 7fac058d0640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabec004d00 0x7fabec005180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac000cec00 tx=0x7fabec0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7983b434854ab990 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.906+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8034630 con 0x7fabec004d00 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.906+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf802f070 con 0x7fabec004d00 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.906+0000 7fabf7fff640 1 -- 172.21.15.63:0/739321730 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf8034a10 con 0x7fabec004d00 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.907+0000 7fac060d1640 1 -- 172.21.15.63:0/739321730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabec004d00 msgr2=0x7fabec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.907+0000 7fac060d1640 1 --2- 172.21.15.63:0/739321730 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fabec004d00 0x7fabec005180 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fac000cec00 tx=0x7fabec0057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.907+0000 7fac058d0640 1 -- 172.21.15.63:0/739321730 reap_dead start 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.907+0000 7fac060d1640 1 -- 172.21.15.63:0/739321730 shutdown_connections 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.907+0000 7fac060d1640 1 -- 172.21.15.63:0/739321730 >> 172.21.15.63:0/739321730 conn(0x7fac000b0860 msgr2=0x7fac000b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:51.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.907+0000 7fac060d1640 1 -- 172.21.15.63:0/739321730 shutdown_connections 2023-12-04T10:44:51.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.907+0000 7fac060d1640 1 -- 172.21.15.63:0/739321730 wait complete. 2023-12-04T10:44:51.911 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.909+0000 7fac060d1640 1 Processor -- start 2023-12-04T10:44:51.912 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.909+0000 7fac060d1640 1 -- start start 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.910+0000 7fac060d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec004d00 0x7fac0015c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.910+0000 7fac060d1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0015b9f0 0x7fac0015de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.910+0000 7fac060d1640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac0015e3d0 0x7fac001416c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.910+0000 7fac060d1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac001406f0 con 0x7fac0015b9f0 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.910+0000 7fac060d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0015e850 con 0x7fabec004d00 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.910+0000 7fac060d1640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac0015dc00 con 0x7fac0015e3d0 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0015b9f0 0x7fac0015de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0015b9f0 0x7fac0015de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39332/0 (socket says 172.21.15.63:39332) 2023-12-04T10:44:51.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 -- 172.21.15.63:0/3486393293 learned_addr learned my addr 172.21.15.63:0/3486393293 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac050cf640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec004d00 0x7fac0015c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 -- 172.21.15.63:0/3486393293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac0015e3d0 msgr2=0x7fac001416c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac0015e3d0 0x7fac001416c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 -- 172.21.15.63:0/3486393293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec004d00 msgr2=0x7fac0015c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec004d00 0x7fac0015c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 -- 172.21.15.63:0/3486393293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00140900 con 0x7fac0015b9f0 2023-12-04T10:44:51.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.911+0000 7fac048ce640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0015b9f0 0x7fac0015de90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fabf00108a0 tx=0x7fabf0010d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.912+0000 7fabf5ffb640 1 -- 172.21.15.63:0/3486393293 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf0004220 con 0x7fac0015b9f0 2023-12-04T10:44:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.912+0000 7fabf5ffb640 1 -- 172.21.15.63:0/3486393293 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf0004380 con 0x7fac0015b9f0 2023-12-04T10:44:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.912+0000 7fabf5ffb640 1 -- 172.21.15.63:0/3486393293 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf000eb60 con 0x7fac0015b9f0 2023-12-04T10:44:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.912+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac00140be0 con 0x7fac0015b9f0 2023-12-04T10:44:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.912+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac001411a0 con 0x7fac0015b9f0 2023-12-04T10:44:51.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.913+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac00141360 con 0x7fac0015b9f0 2023-12-04T10:44:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.914+0000 7fabf5ffb640 1 -- 172.21.15.63:0/3486393293 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fabf000ecc0 con 0x7fac0015b9f0 2023-12-04T10:44:51.916 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.915+0000 7fabf5ffb640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fabe406ae70 0x7fabe406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.915+0000 7fabf5ffb640 1 -- 172.21.15.63:0/3486393293 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fabf0089d70 con 0x7fac0015b9f0 2023-12-04T10:44:51.917 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.915+0000 7fac050cf640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fabe406ae70 0x7fabe406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:51.918 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.916+0000 7fac050cf640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fabe406ae70 0x7fabe406d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009a10 tx=0x7fabfc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:51.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:51.920+0000 7fabf5ffb640 1 -- 172.21.15.63:0/3486393293 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fabf00549c0 con 0x7fac0015b9f0 2023-12-04T10:44:52.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.117+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fac0004e840 con 0x7fac0015b9f0 2023-12-04T10:44:52.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.118+0000 7fabf5ffb640 1 -- 172.21.15.63:0/3486393293 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fabf0021020 con 0x7fac0015b9f0 2023-12-04T10:44:52.120 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fabe406ae70 msgr2=0x7fabe406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fabe406ae70 0x7fabe406d330 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fabfc009a10 tx=0x7fabfc008040 comp rx=0 tx=0).stop 2023-12-04T10:44:52.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0015b9f0 msgr2=0x7fac0015de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0015b9f0 0x7fac0015de90 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fabf00108a0 tx=0x7fabf0010d60 comp rx=0 tx=0).stop 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 shutdown_connections 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fabe406ae70 0x7fabe406d330 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fac0015e3d0 0x7fac001416c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fac0015b9f0 0x7fac0015de90 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 --2- 172.21.15.63:0/3486393293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fabec004d00 0x7fac0015c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.121+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 >> 172.21.15.63:0/3486393293 conn(0x7fac000b0860 msgr2=0x7fac000b1d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.122+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 shutdown_connections 2023-12-04T10:44:52.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.122+0000 7fac060d1640 1 -- 172.21.15.63:0/3486393293 wait complete. 2023-12-04T10:44:52.143 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:52.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.365+0000 7f5a8e13c640 1 Processor -- start 2023-12-04T10:44:52.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.365+0000 7f5a8e13c640 1 -- start start 2023-12-04T10:44:52.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.367+0000 7f5a8e13c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5a8806c520 0x7f5a88165f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.367+0000 7f5a8e13c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a880cb800 con 0x7f5a88143ca0 2023-12-04T10:44:52.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.367+0000 7f5a8e13c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a880cbae0 con 0x7f5a88144370 2023-12-04T10:44:52.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.367+0000 7f5a8e13c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a880cbdc0 con 0x7f5a8806c520 2023-12-04T10:44:52.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.367+0000 7f5a8d13a640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5a88143ca0 0x7f5a880b2e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45742/0 (socket says 172.21.15.63:45742) 2023-12-04T10:44:52.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.367+0000 7f5a8d13a640 1 -- 172.21.15.63:0/166249219 learned_addr learned my addr 172.21.15.63:0/166249219 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:52.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094500994 0 0) 0x7f5a880cb800 con 0x7f5a88143ca0 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a74003520 con 0x7f5a88143ca0 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a8d93b640 1 --2- 172.21.15.63:0/166249219 >> v2:172.21.15.66:3300/0 conn(0x7f5a8806c520 0x7f5a88165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2048186420 0 0) 0x7f5a74003520 con 0x7f5a88143ca0 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 >> v2:172.21.15.66:3300/0 conn(0x7f5a8806c520 msgr2=0x7f5a88165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 --2- 172.21.15.63:0/166249219 >> v2:172.21.15.66:3300/0 conn(0x7f5a8806c520 0x7f5a88165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 >> v1:172.21.15.66:6789/0 conn(0x7f5a88144370 legacy=0x7f5a8806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a880b2610 con 0x7f5a88143ca0 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f5a84001670 con 0x7f5a88143ca0 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 >> v1:172.21.15.63:6789/0 conn(0x7f5a88143ca0 legacy=0x7f5a880b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a74003970 0x7f5a74003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.368+0000 7f5a7ffff640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a740047c0 0x7f5a74004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a7ffff640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a74005180 0x7f5a7400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a880cbdc0 con 0x7f5a74005180 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7400c0b0 con 0x7f5a740047c0 2023-12-04T10:44:52.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7400c270 con 0x7f5a74003970 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8d93b640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a74005180 0x7f5a7400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8d13a640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a74003970 0x7f5a74003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8d93b640 1 -- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a74003970 msgr2=0x7f5a74003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8c939640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a740047c0 0x7f5a74004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8d93b640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a74003970 0x7f5a74003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8d93b640 1 -- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a740047c0 msgr2=0x7f5a74004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8d93b640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a740047c0 0x7f5a74004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8d93b640 1 -- 172.21.15.63:0/166249219 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a74003520 con 0x7f5a74005180 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.369+0000 7f5a8d13a640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a74003970 0x7f5a74003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.370+0000 7f5a8d93b640 1 -- 172.21.15.63:0/166249219 reap_dead start 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.370+0000 7f5a8d93b640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a74005180 0x7f5a7400b980 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5a80007330 tx=0x7f5a740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f864010af9747d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a8002ccd0 con 0x7f5a74005180 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a8002ce30 con 0x7f5a74005180 2023-12-04T10:44:52.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a7ffff640 1 -- 172.21.15.63:0/166249219 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a80003bd0 con 0x7f5a74005180 2023-12-04T10:44:52.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a8e13c640 1 -- 172.21.15.63:0/166249219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a74005180 msgr2=0x7f5a7400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a8e13c640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a74005180 0x7f5a7400b980 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5a80007330 tx=0x7f5a740057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a8e13c640 1 -- 172.21.15.63:0/166249219 shutdown_connections 2023-12-04T10:44:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a8e13c640 1 --2- 172.21.15.63:0/166249219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a74005180 0x7f5a7400b980 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a8e13c640 1 -- 172.21.15.63:0/166249219 >> 172.21.15.63:0/166249219 conn(0x7f5a880b0860 msgr2=0x7f5a880b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a8e13c640 1 -- 172.21.15.63:0/166249219 shutdown_connections 2023-12-04T10:44:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.371+0000 7f5a8e13c640 1 -- 172.21.15.63:0/166249219 wait complete. 2023-12-04T10:44:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.373+0000 7f5a8e13c640 1 Processor -- start 2023-12-04T10:44:52.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.373+0000 7f5a8e13c640 1 -- start start 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.374+0000 7f5a8e13c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a74005180 0x7f5a8815c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.374+0000 7f5a8e13c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a8815ca70 0x7f5a8813d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.374+0000 7f5a8e13c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a8813d970 0x7f5a8813ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.374+0000 7f5a8e13c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8813ee90 con 0x7f5a8815ca70 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.374+0000 7f5a8e13c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8813e330 con 0x7f5a74005180 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.374+0000 7f5a8e13c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8815cfd0 con 0x7f5a8813d970 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a8815ca70 0x7f5a8813d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a8815ca70 0x7f5a8813d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39352/0 (socket says 172.21.15.63:39352) 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 -- 172.21.15.63:0/2380900380 learned_addr learned my addr 172.21.15.63:0/2380900380 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8d93b640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a8813d970 0x7f5a8813ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 -- 172.21.15.63:0/2380900380 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a8813d970 msgr2=0x7f5a8813ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a8813d970 0x7f5a8813ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8d13a640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a74005180 0x7f5a8815c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 -- 172.21.15.63:0/2380900380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a74005180 msgr2=0x7f5a8815c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a74005180 0x7f5a8815c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 -- 172.21.15.63:0/2380900380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a8815d2b0 con 0x7f5a8815ca70 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.375+0000 7f5a8c939640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a8815ca70 0x7f5a8813d430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800d4d0 tx=0x7f5a7800d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.376+0000 7f5a7dffb640 1 -- 172.21.15.63:0/2380900380 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78012800 con 0x7f5a8815ca70 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.376+0000 7f5a7dffb640 1 -- 172.21.15.63:0/2380900380 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a78012960 con 0x7f5a8815ca70 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.376+0000 7f5a7dffb640 1 -- 172.21.15.63:0/2380900380 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78012d10 con 0x7f5a8815ca70 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.376+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a8815d590 con 0x7f5a8815ca70 2023-12-04T10:44:52.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.376+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a8815db50 con 0x7f5a8815ca70 2023-12-04T10:44:52.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.377+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8804e840 con 0x7f5a8815ca70 2023-12-04T10:44:52.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.378+0000 7f5a7dffb640 1 -- 172.21.15.63:0/2380900380 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5a7801b450 con 0x7f5a8815ca70 2023-12-04T10:44:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.379+0000 7f5a7dffb640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5a6c06ae70 0x7f5a6c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.379+0000 7f5a7dffb640 1 -- 172.21.15.63:0/2380900380 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f5a78089e50 con 0x7f5a8815ca70 2023-12-04T10:44:52.381 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.379+0000 7f5a8d13a640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5a6c06ae70 0x7f5a6c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.382 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.380+0000 7f5a8d13a640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5a6c06ae70 0x7f5a6c06d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5a840018e0 tx=0x7f5a84009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:52.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.384+0000 7f5a7dffb640 1 -- 172.21.15.63:0/2380900380 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5a78054aa0 con 0x7f5a8815ca70 2023-12-04T10:44:52.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.576+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5a88140290 con 0x7f5a8815ca70 2023-12-04T10:44:52.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.577+0000 7f5a7dffb640 1 -- 172.21.15.63:0/2380900380 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5a780580c0 con 0x7f5a8815ca70 2023-12-04T10:44:52.580 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5a6c06ae70 msgr2=0x7f5a6c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5a6c06ae70 0x7f5a6c06d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f5a840018e0 tx=0x7f5a84009040 comp rx=0 tx=0).stop 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a8815ca70 msgr2=0x7f5a8813d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a8815ca70 0x7f5a8813d430 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800d4d0 tx=0x7f5a7800d990 comp rx=0 tx=0).stop 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 shutdown_connections 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5a6c06ae70 0x7f5a6c06d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5a8813d970 0x7f5a8813ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5a8815ca70 0x7f5a8813d430 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 --2- 172.21.15.63:0/2380900380 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5a74005180 0x7f5a8815c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.580+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 >> 172.21.15.63:0/2380900380 conn(0x7f5a880b0860 msgr2=0x7f5a88140a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.581+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 shutdown_connections 2023-12-04T10:44:52.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.581+0000 7f5a8e13c640 1 -- 172.21.15.63:0/2380900380 wait complete. 2023-12-04T10:44:52.601 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.825+0000 7fcbb437c640 1 Processor -- start 2023-12-04T10:44:52.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.825+0000 7fcbb437c640 1 -- start start 2023-12-04T10:44:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.827+0000 7fcbb437c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac144a00 0x7fcbac0b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.827+0000 7fcbb437c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fcbac0ca290 0x7fcbac0ca6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.827+0000 7fcbb437c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbac0cac20 con 0x7fcbac0701b0 2023-12-04T10:44:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.827+0000 7fcbb437c640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbac0b2370 con 0x7fcbac0ca290 2023-12-04T10:44:52.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.827+0000 7fcbb437c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0cae80 con 0x7fcbac144a00 2023-12-04T10:44:52.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb1917640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fcbac0701b0 0x7fcbac070590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45754/0 (socket says 172.21.15.63:45754) 2023-12-04T10:44:52.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb1917640 1 -- 172.21.15.63:0/2595366477 learned_addr learned my addr 172.21.15.63:0/2595366477 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:52.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb2919640 1 --2- 172.21.15.63:0/2595366477 >> v2:172.21.15.63:3300/0 conn(0x7fcbac0ca290 0x7fcbac0ca6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb2118640 1 --2- 172.21.15.63:0/2595366477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac144a00 0x7fcbac0b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb1116640 1 -- 172.21.15.63:0/2595366477 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 918902009 0 0) 0x7fcbac0cac20 con 0x7fcbac0701b0 2023-12-04T10:44:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb1116640 1 -- 172.21.15.63:0/2595366477 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb98003520 con 0x7fcbac0701b0 2023-12-04T10:44:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb2919640 1 -- 172.21.15.63:0/2595366477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac144a00 msgr2=0x7fcbac0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb2919640 1 --2- 172.21.15.63:0/2595366477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac144a00 0x7fcbac0b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb2919640 1 -- 172.21.15.63:0/2595366477 >> v1:172.21.15.63:6789/0 conn(0x7fcbac0701b0 legacy=0x7fcbac070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.828+0000 7fcbb2919640 1 -- 172.21.15.63:0/2595366477 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac06c460 con 0x7fcbac0ca290 2023-12-04T10:44:52.831 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.830+0000 7fcbb2919640 1 --2- 172.21.15.63:0/2595366477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac0ca290 0x7fcbac0ca6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009d90 tx=0x7fcba402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b4cfd4b4a0de40 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:52.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.830+0000 7fcbb1116640 1 -- 172.21.15.63:0/2595366477 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba402cc50 con 0x7fcbac0ca290 2023-12-04T10:44:52.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.830+0000 7fcbb1116640 1 -- 172.21.15.63:0/2595366477 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba402cdb0 con 0x7fcbac0ca290 2023-12-04T10:44:52.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.830+0000 7fcbb1116640 1 -- 172.21.15.63:0/2595366477 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4034660 con 0x7fcbac0ca290 2023-12-04T10:44:52.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.830+0000 7fcbb437c640 1 -- 172.21.15.63:0/2595366477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac0ca290 msgr2=0x7fcbac0ca6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.830+0000 7fcbb437c640 1 --2- 172.21.15.63:0/2595366477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac0ca290 0x7fcbac0ca6e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009d90 tx=0x7fcba402bea0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.831+0000 7fcbb437c640 1 -- 172.21.15.63:0/2595366477 shutdown_connections 2023-12-04T10:44:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.831+0000 7fcbb437c640 1 --2- 172.21.15.63:0/2595366477 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac0ca290 0x7fcbac0ca6e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.831+0000 7fcbb437c640 1 --2- 172.21.15.63:0/2595366477 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac144a00 0x7fcbac0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.831+0000 7fcbb437c640 1 -- 172.21.15.63:0/2595366477 >> 172.21.15.63:0/2595366477 conn(0x7fcbac0cee80 msgr2=0x7fcbac0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.831+0000 7fcbb437c640 1 -- 172.21.15.63:0/2595366477 shutdown_connections 2023-12-04T10:44:52.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.831+0000 7fcbb437c640 1 -- 172.21.15.63:0/2595366477 wait complete. 2023-12-04T10:44:52.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.832+0000 7fcbb437c640 1 Processor -- start 2023-12-04T10:44:52.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.833+0000 7fcbb437c640 1 -- start start 2023-12-04T10:44:52.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.833+0000 7fcbb437c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbac0701b0 0x7fcbac0a8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb437c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac0ca290 0x7fcbac0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb437c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac144a00 0x7fcbac0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.836 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb437c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1f1b80 con 0x7fcbac144a00 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb437c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac1f1850 con 0x7fcbac0701b0 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb437c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac0c5000 con 0x7fcbac0ca290 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2919640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac144a00 0x7fcbac0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2919640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac144a00 0x7fcbac0c85b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39366/0 (socket says 172.21.15.63:39366) 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2919640 1 -- 172.21.15.63:0/1720042769 learned_addr learned my addr 172.21.15.63:0/1720042769 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2118640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbac0701b0 0x7fcbac0a8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb1917640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac0ca290 0x7fcbac0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2919640 1 -- 172.21.15.63:0/1720042769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac0ca290 msgr2=0x7fcbac0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2919640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac0ca290 0x7fcbac0c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2919640 1 -- 172.21.15.63:0/1720042769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbac0701b0 msgr2=0x7fcbac0a8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2919640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbac0701b0 0x7fcbac0a8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.834+0000 7fcbb2919640 1 -- 172.21.15.63:0/1720042769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcba4009a70 con 0x7fcbac144a00 2023-12-04T10:44:52.837 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.835+0000 7fcbb2919640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac144a00 0x7fcbac0c85b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009eb0 tx=0x7fcba4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:52.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.835+0000 7fcba2ffd640 1 -- 172.21.15.63:0/1720042769 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4040650 con 0x7fcbac144a00 2023-12-04T10:44:52.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.835+0000 7fcba2ffd640 1 -- 172.21.15.63:0/1720042769 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba40407b0 con 0x7fcbac144a00 2023-12-04T10:44:52.838 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.835+0000 7fcba2ffd640 1 -- 172.21.15.63:0/1720042769 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba4040b60 con 0x7fcbac144a00 2023-12-04T10:44:52.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.835+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbac0c52e0 con 0x7fcbac144a00 2023-12-04T10:44:52.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.835+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbac0c4cf0 con 0x7fcbac144a00 2023-12-04T10:44:52.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.836+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbac1f1cc0 con 0x7fcbac144a00 2023-12-04T10:44:52.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.837+0000 7fcba2ffd640 1 -- 172.21.15.63:0/1720042769 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcba4040cc0 con 0x7fcbac144a00 2023-12-04T10:44:52.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.838+0000 7fcba2ffd640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcb9006ae40 0x7fcb9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:52.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.838+0000 7fcba2ffd640 1 -- 172.21.15.63:0/1720042769 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fcba40ac750 con 0x7fcbac144a00 2023-12-04T10:44:52.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.838+0000 7fcbb2118640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcb9006ae40 0x7fcb9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:52.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.839+0000 7fcbb2118640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcb9006ae40 0x7fcb9006d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0b3e10 tx=0x7fcba8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:52.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:52.843+0000 7fcba2ffd640 1 -- 172.21.15.63:0/1720042769 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbac1f1cc0 con 0x7fcbac144a00 2023-12-04T10:44:53.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.037+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcbac1f1cc0 con 0x7fcbac144a00 2023-12-04T10:44:53.040 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.038+0000 7fcba2ffd640 1 -- 172.21.15.63:0/1720042769 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbac1f1cc0 con 0x7fcbac144a00 2023-12-04T10:44:53.040 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcb9006ae40 msgr2=0x7fcb9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcb9006ae40 0x7fcb9006d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0b3e10 tx=0x7fcba8008040 comp rx=0 tx=0).stop 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac144a00 msgr2=0x7fcbac0c85b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac144a00 0x7fcbac0c85b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fcba4009eb0 tx=0x7fcba4004a40 comp rx=0 tx=0).stop 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 shutdown_connections 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fcb9006ae40 0x7fcb9006d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fcbac0ca290 0x7fcbac0c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fcbac144a00 0x7fcbac0c85b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 --2- 172.21.15.63:0/1720042769 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbac0701b0 0x7fcbac0a8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 >> 172.21.15.63:0/1720042769 conn(0x7fcbac0cee80 msgr2=0x7fcbac0ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:53.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 shutdown_connections 2023-12-04T10:44:53.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.041+0000 7fcbb437c640 1 -- 172.21.15.63:0/1720042769 wait complete. 2023-12-04T10:44:53.061 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:44:53.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.281+0000 7ff665a2d640 1 Processor -- start 2023-12-04T10:44:53.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.282+0000 7ff665a2d640 1 -- start start 2023-12-04T10:44:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.283+0000 7ff665a2d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6600cf850 0x7ff6600cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.283+0000 7ff665a2d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600b3e50 0x7ff6600b42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.283+0000 7ff665a2d640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6600cf3d0 con 0x7ff6600cfc30 2023-12-04T10:44:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.283+0000 7ff665a2d640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6600b4820 con 0x7ff6600cf850 2023-12-04T10:44:53.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.283+0000 7ff665a2d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600b2480 con 0x7ff6600b3e50 2023-12-04T10:44:53.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65effd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6600cf850 0x7ff6600cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65e7fc640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff6600cfc30 0x7ff6600cc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:45758/0 (socket says 172.21.15.63:45758) 2023-12-04T10:44:53.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65effd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff6600cf850 0x7ff6600cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39370/0 (socket says 172.21.15.63:39370) 2023-12-04T10:44:53.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65e7fc640 1 -- 172.21.15.63:0/2323237809 learned_addr learned my addr 172.21.15.63:0/2323237809 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:53.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65f7fe640 1 --2- 172.21.15.63:0/2323237809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600b3e50 0x7ff6600b42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65effd640 1 -- 172.21.15.63:0/2323237809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600b3e50 msgr2=0x7ff6600b42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:53.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65effd640 1 --2- 172.21.15.63:0/2323237809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600b3e50 0x7ff6600b42e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65effd640 1 -- 172.21.15.63:0/2323237809 >> v1:172.21.15.63:6789/0 conn(0x7ff6600cfc30 legacy=0x7ff6600cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65effd640 1 -- 172.21.15.63:0/2323237809 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6600b2760 con 0x7ff6600cf850 2023-12-04T10:44:53.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.284+0000 7ff65f7fe640 1 --2- 172.21.15.63:0/2323237809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600b3e50 0x7ff6600b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:53.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.285+0000 7ff65effd640 1 --2- 172.21.15.63:0/2323237809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600cf850 0x7ff6600cee90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff65002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b610c862b7675d90 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:53.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff65dffb640 1 -- 172.21.15.63:0/2323237809 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65002cc50 con 0x7ff6600cf850 2023-12-04T10:44:53.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff65dffb640 1 -- 172.21.15.63:0/2323237809 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65002cdb0 con 0x7ff6600cf850 2023-12-04T10:44:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff65dffb640 1 -- 172.21.15.63:0/2323237809 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650034660 con 0x7ff6600cf850 2023-12-04T10:44:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff665a2d640 1 -- 172.21.15.63:0/2323237809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600cf850 msgr2=0x7ff6600cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff665a2d640 1 --2- 172.21.15.63:0/2323237809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600cf850 0x7ff6600cee90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff65002bea0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff665a2d640 1 -- 172.21.15.63:0/2323237809 shutdown_connections 2023-12-04T10:44:53.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff665a2d640 1 --2- 172.21.15.63:0/2323237809 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600b3e50 0x7ff6600b42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff665a2d640 1 --2- 172.21.15.63:0/2323237809 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600cf850 0x7ff6600cee90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff665a2d640 1 -- 172.21.15.63:0/2323237809 >> 172.21.15.63:0/2323237809 conn(0x7ff6600d1000 msgr2=0x7ff6600d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:53.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.286+0000 7ff665a2d640 1 -- 172.21.15.63:0/2323237809 shutdown_connections 2023-12-04T10:44:53.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.287+0000 7ff665a2d640 1 -- 172.21.15.63:0/2323237809 wait complete. 2023-12-04T10:44:53.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.288+0000 7ff665a2d640 1 Processor -- start 2023-12-04T10:44:53.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.288+0000 7ff665a2d640 1 -- start start 2023-12-04T10:44:53.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.289+0000 7ff665a2d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600b3e50 0x7ff660155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.289+0000 7ff665a2d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600cf850 0x7ff6600c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.289+0000 7ff665a2d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6600cfc30 0x7ff66006bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.289+0000 7ff665a2d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff660155f70 con 0x7ff6600b3e50 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.289+0000 7ff665a2d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600c90e0 con 0x7ff6600cfc30 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.289+0000 7ff665a2d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6600c8b20 con 0x7ff6600cf850 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600b3e50 0x7ff660155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600b3e50 0x7ff660155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39380/0 (socket says 172.21.15.63:39380) 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 -- 172.21.15.63:0/3637659967 learned_addr learned my addr 172.21.15.63:0/3637659967 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 -- 172.21.15.63:0/3637659967 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600cf850 msgr2=0x7ff6600c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600cf850 0x7ff6600c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 -- 172.21.15.63:0/3637659967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6600cfc30 msgr2=0x7ff66006bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6600cfc30 0x7ff66006bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 -- 172.21.15.63:0/3637659967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff650009a70 con 0x7ff6600b3e50 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.290+0000 7ff65effd640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600b3e50 0x7ff660155a30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff650004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.291+0000 7ff657fff640 1 -- 172.21.15.63:0/3637659967 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650040650 con 0x7ff6600b3e50 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.291+0000 7ff657fff640 1 -- 172.21.15.63:0/3637659967 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6500407b0 con 0x7ff6600b3e50 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.291+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6600c8e00 con 0x7ff6600b3e50 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.291+0000 7ff657fff640 1 -- 172.21.15.63:0/3637659967 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff650040b60 con 0x7ff6600b3e50 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.291+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6600c9930 con 0x7ff6600b3e50 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.292+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6600ce4b0 con 0x7ff6600b3e50 2023-12-04T10:44:53.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.293+0000 7ff657fff640 1 -- 172.21.15.63:0/3637659967 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff650040cc0 con 0x7ff6600b3e50 2023-12-04T10:44:53.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.294+0000 7ff657fff640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff64006ae40 0x7ff64006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.294+0000 7ff657fff640 1 -- 172.21.15.63:0/3637659967 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff6500ac7a0 con 0x7ff6600b3e50 2023-12-04T10:44:53.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.294+0000 7ff65e7fc640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff64006ae40 0x7ff64006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.295+0000 7ff65e7fc640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff64006ae40 0x7ff64006d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff660158ce0 tx=0x7ff648007a40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:53.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.298+0000 7ff657fff640 1 -- 172.21.15.63:0/3637659967 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff650077520 con 0x7ff6600b3e50 2023-12-04T10:44:53.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.496+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff660068710 con 0x7ff6600b3e50 2023-12-04T10:44:53.499 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.497+0000 7ff657fff640 1 -- 172.21.15.63:0/3637659967 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff65007ab40 con 0x7ff6600b3e50 2023-12-04T10:44:53.499 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:53.502 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.500+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff64006ae40 msgr2=0x7ff64006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.500+0000 7ff665a2d640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff64006ae40 0x7ff64006d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff660158ce0 tx=0x7ff648007a40 comp rx=0 tx=0).stop 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.500+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600b3e50 msgr2=0x7ff660155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.500+0000 7ff665a2d640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600b3e50 0x7ff660155a30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7ff650009d90 tx=0x7ff650004a40 comp rx=0 tx=0).stop 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.500+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 shutdown_connections 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.501+0000 7ff665a2d640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff64006ae40 0x7ff64006d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.501+0000 7ff665a2d640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff6600cf850 0x7ff6600c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.501+0000 7ff665a2d640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff6600cfc30 0x7ff66006bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.501+0000 7ff665a2d640 1 --2- 172.21.15.63:0/3637659967 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff6600b3e50 0x7ff660155a30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.501+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 >> 172.21.15.63:0/3637659967 conn(0x7ff6600d1000 msgr2=0x7ff6600cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.501+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 shutdown_connections 2023-12-04T10:44:53.503 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.501+0000 7ff665a2d640 1 -- 172.21.15.63:0/3637659967 wait complete. 2023-12-04T10:44:53.522 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.743+0000 7f34c709e640 1 Processor -- start 2023-12-04T10:44:53.745 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.743+0000 7f34c709e640 1 -- start start 2023-12-04T10:44:53.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.745+0000 7f34c709e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34c015e5b0 0x7f34c00b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.745+0000 7f34c709e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f34c00d1960 0x7f34c00cd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.745+0000 7f34c709e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c00cdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.745+0000 7f34c709e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c00ce7c0 con 0x7f34c015e5b0 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.745+0000 7f34c709e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34c00cc5c0 con 0x7f34c00d1960 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.745+0000 7f34c709e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00ce4e0 con 0x7f34c015e990 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.745+0000 7f34c609c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34c015e5b0 0x7f34c00b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c609c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34c015e5b0 0x7f34c00b1de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39394/0 (socket says 172.21.15.63:39394) 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c609c640 1 -- 172.21.15.63:0/1335615308 learned_addr learned my addr 172.21.15.63:0/1335615308 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:53.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c589b640 1 --2- 172.21.15.63:0/1335615308 >> v2:172.21.15.66:3300/0 conn(0x7f34c00d1960 0x7f34c00cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c689d640 1 --2- 172.21.15.63:0/1335615308 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c00cdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c609c640 1 -- 172.21.15.63:0/1335615308 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 msgr2=0x7f34c00cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:53.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c609c640 1 --2- 172.21.15.63:0/1335615308 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c00cdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c609c640 1 -- 172.21.15.63:0/1335615308 >> v2:172.21.15.66:3300/0 conn(0x7f34c00d1960 msgr2=0x7f34c00cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:53.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c609c640 1 --2- 172.21.15.63:0/1335615308 >> v2:172.21.15.66:3300/0 conn(0x7f34c00d1960 0x7f34c00cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c609c640 1 -- 172.21.15.63:0/1335615308 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34c00cc860 con 0x7f34c015e5b0 2023-12-04T10:44:53.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.746+0000 7f34c589b640 1 --2- 172.21.15.63:0/1335615308 >> v2:172.21.15.66:3300/0 conn(0x7f34c00d1960 0x7f34c00cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:44:53.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.748+0000 7f34c609c640 1 --2- 172.21.15.63:0/1335615308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b1de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34c00d0de0 tx=0x7f34bc02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eec209e1cf29485f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:53.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.751+0000 7f34c509a640 1 -- 172.21.15.63:0/1335615308 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc031750 con 0x7f34c015e5b0 2023-12-04T10:44:53.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.751+0000 7f34c509a640 1 -- 172.21.15.63:0/1335615308 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34bc0318b0 con 0x7f34c015e5b0 2023-12-04T10:44:53.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.751+0000 7f34c509a640 1 -- 172.21.15.63:0/1335615308 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34bc031c40 con 0x7f34c015e5b0 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 -- 172.21.15.63:0/1335615308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 msgr2=0x7f34c00b1de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 --2- 172.21.15.63:0/1335615308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b1de0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34c00d0de0 tx=0x7f34bc02b7f0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 -- 172.21.15.63:0/1335615308 shutdown_connections 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 --2- 172.21.15.63:0/1335615308 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c00cdca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 --2- 172.21.15.63:0/1335615308 >> v2:172.21.15.66:3300/0 conn(0x7f34c00d1960 0x7f34c00cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 --2- 172.21.15.63:0/1335615308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b1de0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 -- 172.21.15.63:0/1335615308 >> 172.21.15.63:0/1335615308 conn(0x7f34c00d0e40 msgr2=0x7f34c00d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 -- 172.21.15.63:0/1335615308 shutdown_connections 2023-12-04T10:44:53.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.752+0000 7f34c709e640 1 -- 172.21.15.63:0/1335615308 wait complete. 2023-12-04T10:44:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.754+0000 7f34c709e640 1 Processor -- start 2023-12-04T10:44:53.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.754+0000 7f34c709e640 1 -- start start 2023-12-04T10:44:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c709e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34c00d1960 0x7f34c00b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c709e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c709e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c01f62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c709e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00b40b0 con 0x7f34c015e5b0 2023-12-04T10:44:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c709e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00b4390 con 0x7f34c00d1960 2023-12-04T10:44:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c709e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34c00b4670 con 0x7f34c015e990 2023-12-04T10:44:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c589b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c589b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39398/0 (socket says 172.21.15.63:39398) 2023-12-04T10:44:53.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.755+0000 7f34c589b640 1 -- 172.21.15.63:0/1757285873 learned_addr learned my addr 172.21.15.63:0/1757285873 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c609c640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34c00d1960 0x7f34c00b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c689d640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c01f62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c589b640 1 -- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 msgr2=0x7f34c01f62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c589b640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c01f62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c589b640 1 -- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34c00d1960 msgr2=0x7f34c00b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c589b640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34c00d1960 0x7f34c00b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c589b640 1 -- 172.21.15.63:0/1757285873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0094d0 con 0x7f34c015e5b0 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c689d640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c01f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c589b640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b6470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e810 tx=0x7f34b000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34b6ffd640 1 -- 172.21.15.63:0/1757285873 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0004030 con 0x7f34c015e5b0 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34b6ffd640 1 -- 172.21.15.63:0/1757285873 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0004190 con 0x7f34c015e5b0 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34b6ffd640 1 -- 172.21.15.63:0/1757285873 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0004520 con 0x7f34c015e5b0 2023-12-04T10:44:53.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.756+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34c00b4950 con 0x7f34c015e5b0 2023-12-04T10:44:53.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.757+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34c00b3bb0 con 0x7f34c015e5b0 2023-12-04T10:44:53.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.758+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34c00b3e30 con 0x7f34c015e5b0 2023-12-04T10:44:53.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.759+0000 7f34b6ffd640 1 -- 172.21.15.63:0/1757285873 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34b000c6d0 con 0x7f34c015e5b0 2023-12-04T10:44:53.761 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.760+0000 7f34b6ffd640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34a406ae40 0x7f34a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.760+0000 7f34b6ffd640 1 -- 172.21.15.63:0/1757285873 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34b0089530 con 0x7f34c015e5b0 2023-12-04T10:44:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.760+0000 7f34c609c640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34a406ae40 0x7f34a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:53.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.761+0000 7f34c609c640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34a406ae40 0x7f34a406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f34bc035000 tx=0x7f34bc008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:53.766 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.764+0000 7f34b6ffd640 1 -- 172.21.15.63:0/1757285873 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34b00542b0 con 0x7f34c015e5b0 2023-12-04T10:44:53.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.962+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f34c004e840 con 0x7f34c015e5b0 2023-12-04T10:44:53.967 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.965+0000 7f34b6ffd640 1 -- 172.21.15.63:0/1757285873 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f34b00578d0 con 0x7f34c015e5b0 2023-12-04T10:44:53.968 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:53.968 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:53.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34a406ae40 msgr2=0x7f34a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34a406ae40 0x7f34a406d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f34bc035000 tx=0x7f34bc008030 comp rx=0 tx=0).stop 2023-12-04T10:44:53.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 msgr2=0x7f34c00b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:53.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b6470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f34b000e810 tx=0x7f34b000ecd0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 shutdown_connections 2023-12-04T10:44:53.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34a406ae40 0x7f34a406d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.970 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34c015e990 0x7f34c01f62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34c015e5b0 0x7f34c00b6470 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 --2- 172.21.15.63:0/1757285873 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34c00d1960 0x7f34c00b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:53.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 >> 172.21.15.63:0/1757285873 conn(0x7f34c00d0e40 msgr2=0x7f34c006fae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:53.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 shutdown_connections 2023-12-04T10:44:53.971 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:53.968+0000 7f34c709e640 1 -- 172.21.15.63:0/1757285873 wait complete. 2023-12-04T10:44:53.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:53.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:54.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.223+0000 7f8ccdd0f640 1 Processor -- start 2023-12-04T10:44:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.223+0000 7f8ccdd0f640 1 -- start start 2023-12-04T10:44:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.224+0000 7f8ccdd0f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cc815b260 0x7f8cc80b2290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.224+0000 7f8ccdd0f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8cc80cfbb0 0x7f8cc80cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.224+0000 7f8ccdd0f640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cc80cbfc0 con 0x7f8cc80cba30 2023-12-04T10:44:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.224+0000 7f8ccdd0f640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc80cc2a0 con 0x7f8cc815b260 2023-12-04T10:44:54.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.224+0000 7f8ccdd0f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cc80cc580 con 0x7f8cc80cfbb0 2023-12-04T10:44:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.225+0000 7f8cc77fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f8cc815b260 0x7f8cc80b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.225+0000 7f8cc6ffd640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8cc80cba30 0x7f8cc80cf4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37638/0 (socket says 172.21.15.63:37638) 2023-12-04T10:44:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.225+0000 7f8cc6ffd640 1 -- 172.21.15.63:0/3038548290 learned_addr learned my addr 172.21.15.63:0/3038548290 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:54.227 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.225+0000 7f8cc67fc640 1 -- 172.21.15.63:0/3038548290 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849725204 0 0) 0x7f8cc80cbfc0 con 0x7f8cc80cba30 2023-12-04T10:44:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.225+0000 7f8cc77fe640 1 -- 172.21.15.63:0/3038548290 >> v2:172.21.15.66:3300/0 conn(0x7f8cc80cfbb0 msgr2=0x7f8cc80cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.225+0000 7f8cc77fe640 1 --2- 172.21.15.63:0/3038548290 >> v2:172.21.15.66:3300/0 conn(0x7f8cc80cfbb0 0x7f8cc80cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.225+0000 7f8cc77fe640 1 -- 172.21.15.63:0/3038548290 >> v1:172.21.15.63:6789/0 conn(0x7f8cc80cba30 legacy=0x7f8cc80cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.225+0000 7f8cc77fe640 1 -- 172.21.15.63:0/3038548290 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc80cc860 con 0x7f8cc815b260 2023-12-04T10:44:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.227+0000 7f8cc77fe640 1 --2- 172.21.15.63:0/3038548290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc815b260 0x7f8cc80b2290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80ce930 tx=0x7f8cb802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7801528d5da208be server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.227+0000 7f8cc67fc640 1 -- 172.21.15.63:0/3038548290 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb802cc80 con 0x7f8cc815b260 2023-12-04T10:44:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.227+0000 7f8cc67fc640 1 -- 172.21.15.63:0/3038548290 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb802cde0 con 0x7f8cc815b260 2023-12-04T10:44:54.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.227+0000 7f8cc67fc640 1 -- 172.21.15.63:0/3038548290 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8034660 con 0x7f8cc815b260 2023-12-04T10:44:54.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.228+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/3038548290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc815b260 msgr2=0x7f8cc80b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.228+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/3038548290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc815b260 0x7f8cc80b2290 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8cc80ce930 tx=0x7f8cb802bed0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.228+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/3038548290 shutdown_connections 2023-12-04T10:44:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.228+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/3038548290 >> v2:172.21.15.66:3300/0 conn(0x7f8cc80cfbb0 0x7f8cc80cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.228+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/3038548290 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc815b260 0x7f8cc80b2290 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.228+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/3038548290 >> 172.21.15.63:0/3038548290 conn(0x7f8cc80d1050 msgr2=0x7f8cc80d1460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.228+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/3038548290 shutdown_connections 2023-12-04T10:44:54.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.228+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/3038548290 wait complete. 2023-12-04T10:44:54.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.230+0000 7f8ccdd0f640 1 Processor -- start 2023-12-04T10:44:54.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.230+0000 7f8ccdd0f640 1 -- start start 2023-12-04T10:44:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8ccdd0f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc80cba30 0x7f8cc8150280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8ccdd0f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cc80cfbb0 0x7f8cc8157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8ccdd0f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8cc815b260 0x7f8cc815d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8ccdd0f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc81507c0 con 0x7f8cc80cba30 2023-12-04T10:44:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8ccdd0f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc815c8b0 con 0x7f8cc80cfbb0 2023-12-04T10:44:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8ccdd0f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc815cb90 con 0x7f8cc815b260 2023-12-04T10:44:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8cc77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc80cba30 0x7f8cc8150280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8cc77fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc80cba30 0x7f8cc8150280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47638/0 (socket says 172.21.15.63:47638) 2023-12-04T10:44:54.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.231+0000 7f8cc77fe640 1 -- 172.21.15.63:0/342323109 learned_addr learned my addr 172.21.15.63:0/342323109 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.232+0000 7f8cc6ffd640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cc80cfbb0 0x7f8cc8157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.232+0000 7f8cc77fe640 1 -- 172.21.15.63:0/342323109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8cc815b260 msgr2=0x7f8cc815d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.232+0000 7f8cc77fe640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8cc815b260 0x7f8cc815d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.232+0000 7f8cc77fe640 1 -- 172.21.15.63:0/342323109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cc80cfbb0 msgr2=0x7f8cc8157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.232+0000 7f8cc77fe640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cc80cfbb0 0x7f8cc8157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.232+0000 7f8cc77fe640 1 -- 172.21.15.63:0/342323109 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb8009a70 con 0x7f8cc80cba30 2023-12-04T10:44:54.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.232+0000 7f8cc6ffd640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cc80cfbb0 0x7f8cc8157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.232+0000 7f8cc77fe640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc80cba30 0x7f8cc8150280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8037040 tx=0x7f8cb8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.233+0000 7f8cbffff640 1 -- 172.21.15.63:0/342323109 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb803e610 con 0x7f8cc80cba30 2023-12-04T10:44:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.233+0000 7f8cbffff640 1 -- 172.21.15.63:0/342323109 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb803e770 con 0x7f8cc80cba30 2023-12-04T10:44:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.233+0000 7f8cbffff640 1 -- 172.21.15.63:0/342323109 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb803eb20 con 0x7f8cc80cba30 2023-12-04T10:44:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.233+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cc815ce70 con 0x7f8cc80cba30 2023-12-04T10:44:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.233+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cc815d430 con 0x7f8cc80cba30 2023-12-04T10:44:54.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.234+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cc815d650 con 0x7f8cc80cba30 2023-12-04T10:44:54.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.236+0000 7f8cbffff640 1 -- 172.21.15.63:0/342323109 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cb803b050 con 0x7f8cc80cba30 2023-12-04T10:44:54.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.236+0000 7f8cbffff640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8ca806ae90 0x7f8ca806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.237+0000 7f8cbffff640 1 -- 172.21.15.63:0/342323109 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8cb80ac450 con 0x7f8cc80cba30 2023-12-04T10:44:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.237+0000 7f8cc6ffd640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8ca806ae90 0x7f8ca806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.237+0000 7f8cc6ffd640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8ca806ae90 0x7f8ca806d350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cc81411e0 tx=0x7f8cb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:54.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.241+0000 7f8cbffff640 1 -- 172.21.15.63:0/342323109 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cb80771b0 con 0x7f8cc80cba30 2023-12-04T10:44:54.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.437+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8cc8068710 con 0x7f8cc80cba30 2023-12-04T10:44:54.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.438+0000 7f8cbffff640 1 -- 172.21.15.63:0/342323109 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8cb807a7d0 con 0x7f8cc80cba30 2023-12-04T10:44:54.440 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:54.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8ca806ae90 msgr2=0x7f8ca806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8ca806ae90 0x7f8ca806d350 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cc81411e0 tx=0x7f8cb0009040 comp rx=0 tx=0).stop 2023-12-04T10:44:54.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc80cba30 msgr2=0x7f8cc8150280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc80cba30 0x7f8cc8150280 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8cb8037040 tx=0x7f8cb8004a40 comp rx=0 tx=0).stop 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 shutdown_connections 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8ca806ae90 0x7f8ca806d350 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8cc815b260 0x7f8cc815d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8cc80cfbb0 0x7f8cc8157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 --2- 172.21.15.63:0/342323109 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8cc80cba30 0x7f8cc8150280 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 >> 172.21.15.63:0/342323109 conn(0x7f8cc80d1050 msgr2=0x7f8cc80b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 shutdown_connections 2023-12-04T10:44:54.444 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.441+0000 7f8ccdd0f640 1 -- 172.21.15.63:0/342323109 wait complete. 2023-12-04T10:44:54.462 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:54.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.691+0000 7f350e4ad640 1 Processor -- start 2023-12-04T10:44:54.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.691+0000 7f350e4ad640 1 -- start start 2023-12-04T10:44:54.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.693+0000 7f350e4ad640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f350815d0c0 0x7f35080b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.693+0000 7f350e4ad640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35080ac890 con 0x7f3508070c30 2023-12-04T10:44:54.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.693+0000 7f350e4ad640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35080b2b60 con 0x7f3508070090 2023-12-04T10:44:54.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.693+0000 7f350e4ad640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35080b2e40 con 0x7f350815d0c0 2023-12-04T10:44:54.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.693+0000 7f350dcac640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f3508070c30 0x7f35080acd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37640/0 (socket says 172.21.15.63:37640) 2023-12-04T10:44:54.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.693+0000 7f350dcac640 1 -- 172.21.15.63:0/3826236051 learned_addr learned my addr 172.21.15.63:0/3826236051 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:54.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f350d4ab640 1 --2- 172.21.15.63:0/3826236051 >> v2:172.21.15.66:3300/0 conn(0x7f350815d0c0 0x7f35080b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884883730 0 0) 0x7f35080ac890 con 0x7f3508070c30 2023-12-04T10:44:54.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34f4003520 con 0x7f3508070c30 2023-12-04T10:44:54.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3912350845 0 0) 0x7f34f4003520 con 0x7f3508070c30 2023-12-04T10:44:54.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 >> v2:172.21.15.66:3300/0 conn(0x7f350815d0c0 msgr2=0x7f35080b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 --2- 172.21.15.63:0/3826236051 >> v2:172.21.15.66:3300/0 conn(0x7f350815d0c0 0x7f35080b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 >> v1:172.21.15.66:6789/0 conn(0x7f3508070090 legacy=0x7f3508070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080b3120 con 0x7f3508070c30 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f35000019f0 con 0x7f3508070c30 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 >> v1:172.21.15.63:6789/0 conn(0x7f3508070c30 legacy=0x7f35080acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.694+0000 7f34fffff640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34f4003970 0x7f34f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f34fffff640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34f40047c0 0x7f34f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f34fffff640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f34f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080b2e40 con 0x7f34f4005180 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f400c020 con 0x7f34f40047c0 2023-12-04T10:44:54.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f400c1e0 con 0x7f34f4003970 2023-12-04T10:44:54.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f350dcac640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f34f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f350ccaa640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34f40047c0 0x7f34f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f350dcac640 1 -- 172.21.15.63:0/3826236051 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34f4003970 msgr2=0x7f34f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:54.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f350dcac640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34f4003970 0x7f34f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f350dcac640 1 -- 172.21.15.63:0/3826236051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34f40047c0 msgr2=0x7f34f4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:54.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f350dcac640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34f40047c0 0x7f34f4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.695+0000 7f350dcac640 1 -- 172.21.15.63:0/3826236051 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f4003520 con 0x7f34f4005180 2023-12-04T10:44:54.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.696+0000 7f350dcac640 1 -- 172.21.15.63:0/3826236051 reap_dead start 2023-12-04T10:44:54.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.696+0000 7f350dcac640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f34f400b980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f350000a830 tx=0x7f34f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebe954079775e4ca server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:54.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.697+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000072d0 con 0x7f34f4005180 2023-12-04T10:44:54.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.697+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350002f070 con 0x7f34f4005180 2023-12-04T10:44:54.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.697+0000 7f34fffff640 1 -- 172.21.15.63:0/3826236051 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000076b0 con 0x7f34f4005180 2023-12-04T10:44:54.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.697+0000 7f350e4ad640 1 -- 172.21.15.63:0/3826236051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 msgr2=0x7f34f400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.697+0000 7f350e4ad640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f34f400b980 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f350000a830 tx=0x7f34f40057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.697+0000 7f350e4ad640 1 -- 172.21.15.63:0/3826236051 shutdown_connections 2023-12-04T10:44:54.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.697+0000 7f350e4ad640 1 --2- 172.21.15.63:0/3826236051 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f34f400b980 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.697+0000 7f350e4ad640 1 -- 172.21.15.63:0/3826236051 >> 172.21.15.63:0/3826236051 conn(0x7f35080b0860 msgr2=0x7f35080b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:54.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.698+0000 7f350e4ad640 1 -- 172.21.15.63:0/3826236051 shutdown_connections 2023-12-04T10:44:54.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.698+0000 7f350e4ad640 1 -- 172.21.15.63:0/3826236051 wait complete. 2023-12-04T10:44:54.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.699+0000 7f350e4ad640 1 Processor -- start 2023-12-04T10:44:54.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.700+0000 7f350e4ad640 1 -- start start 2023-12-04T10:44:54.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.700+0000 7f350e4ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f35080ae540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350e4ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35080b0180 0x7f350814cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350e4ad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f350806d510 0x7f350806d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350e4ad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350806df00 con 0x7f34f4005180 2023-12-04T10:44:54.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350e4ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35080af780 con 0x7f35080b0180 2023-12-04T10:44:54.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350e4ad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35080b05c0 con 0x7f350806d510 2023-12-04T10:44:54.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350d4ab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f35080ae540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350d4ab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f35080ae540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47664/0 (socket says 172.21.15.63:47664) 2023-12-04T10:44:54.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350d4ab640 1 -- 172.21.15.63:0/1666504778 learned_addr learned my addr 172.21.15.63:0/1666504778 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:54.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350d4ab640 1 -- 172.21.15.63:0/1666504778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f350806d510 msgr2=0x7f350806d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350d4ab640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f350806d510 0x7f350806d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350d4ab640 1 -- 172.21.15.63:0/1666504778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35080b0180 msgr2=0x7f350814cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350d4ab640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35080b0180 0x7f350814cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.701+0000 7f350d4ab640 1 -- 172.21.15.63:0/1666504778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080aec00 con 0x7f34f4005180 2023-12-04T10:44:54.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.702+0000 7f350d4ab640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f35080ae540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f350400e7a0 tx=0x7f350400ec60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:54.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.702+0000 7f34fdffb640 1 -- 172.21.15.63:0/1666504778 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400eeb0 con 0x7f34f4005180 2023-12-04T10:44:54.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.702+0000 7f34fdffb640 1 -- 172.21.15.63:0/1666504778 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350400c940 con 0x7f34f4005180 2023-12-04T10:44:54.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.702+0000 7f34fdffb640 1 -- 172.21.15.63:0/1666504778 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400cd10 con 0x7f34f4005180 2023-12-04T10:44:54.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.702+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35080aeee0 con 0x7f34f4005180 2023-12-04T10:44:54.710 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.702+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35080af4a0 con 0x7f34f4005180 2023-12-04T10:44:54.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.703+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f350804e840 con 0x7f34f4005180 2023-12-04T10:44:54.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.704+0000 7f34fdffb640 1 -- 172.21.15.63:0/1666504778 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3504013470 con 0x7f34f4005180 2023-12-04T10:44:54.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.705+0000 7f34fdffb640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34ec06ae70 0x7f34ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:54.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.705+0000 7f34fdffb640 1 -- 172.21.15.63:0/1666504778 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3504089b10 con 0x7f34f4005180 2023-12-04T10:44:54.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.705+0000 7f350ccaa640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34ec06ae70 0x7f34ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:54.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.706+0000 7f350ccaa640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34ec06ae70 0x7f34ec06d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3508157cc0 tx=0x7f34f8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:54.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.710+0000 7f34fdffb640 1 -- 172.21.15.63:0/1666504778 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3504054800 con 0x7f34f4005180 2023-12-04T10:44:54.905 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.903+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35080cc6a0 con 0x7f34f4005180 2023-12-04T10:44:54.907 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.904+0000 7f34fdffb640 1 -- 172.21.15.63:0/1666504778 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3504017020 con 0x7f34f4005180 2023-12-04T10:44:54.907 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34ec06ae70 msgr2=0x7f34ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34ec06ae70 0x7f34ec06d330 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3508157cc0 tx=0x7f34f8009040 comp rx=0 tx=0).stop 2023-12-04T10:44:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 msgr2=0x7f35080ae540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f35080ae540 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f350400e7a0 tx=0x7f350400ec60 comp rx=0 tx=0).stop 2023-12-04T10:44:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 shutdown_connections 2023-12-04T10:44:54.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f34ec06ae70 0x7f34ec06d330 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f350806d510 0x7f350806d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f35080b0180 0x7f350814cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 --2- 172.21.15.63:0/1666504778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34f4005180 0x7f35080ae540 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 >> 172.21.15.63:0/1666504778 conn(0x7f35080b0860 msgr2=0x7f3508157f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 shutdown_connections 2023-12-04T10:44:54.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:54.907+0000 7f350e4ad640 1 -- 172.21.15.63:0/1666504778 wait complete. 2023-12-04T10:44:54.929 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:55.157 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.155+0000 7f23389e3640 1 Processor -- start 2023-12-04T10:44:55.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.156+0000 7f23389e3640 1 -- start start 2023-12-04T10:44:55.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.157+0000 7f23389e3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2334144a00 0x7f23340b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.158+0000 7f23389e3640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f23340701b0 0x7f2334070590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.158+0000 7f23389e3640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23340b2370 con 0x7f23340ca290 2023-12-04T10:44:55.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.158+0000 7f23389e3640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2334070ad0 con 0x7f23340701b0 2023-12-04T10:44:55.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.158+0000 7f23389e3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23340cae80 con 0x7f2334144a00 2023-12-04T10:44:55.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.158+0000 7f233259c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2334144a00 0x7f23340b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.158+0000 7f232bfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f23340701b0 0x7f2334070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.158+0000 7f233259c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2334144a00 0x7f23340b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:49846/0 (socket says 172.21.15.63:49846) 2023-12-04T10:44:55.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.158+0000 7f233259c640 1 -- 172.21.15.63:0/2069796664 learned_addr learned my addr 172.21.15.63:0/2069796664 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:55.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.159+0000 7f233259c640 1 -- 172.21.15.63:0/2069796664 >> v2:172.21.15.66:3300/0 conn(0x7f23340701b0 msgr2=0x7f2334070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:55.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.159+0000 7f233259c640 1 --2- 172.21.15.63:0/2069796664 >> v2:172.21.15.66:3300/0 conn(0x7f23340701b0 0x7f2334070590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.159+0000 7f233259c640 1 -- 172.21.15.63:0/2069796664 >> v1:172.21.15.66:6789/0 conn(0x7f23340ca290 legacy=0x7f23340ca6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.159+0000 7f233259c640 1 -- 172.21.15.63:0/2069796664 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f233406c460 con 0x7f2334144a00 2023-12-04T10:44:55.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.160+0000 7f233259c640 1 --2- 172.21.15.63:0/2069796664 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2334144a00 0x7f23340b1e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2324009870 tx=0x7f232402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84fac43642e6ad8e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:55.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.161+0000 7f2331d9b640 1 -- 172.21.15.63:0/2069796664 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324030840 con 0x7f2334144a00 2023-12-04T10:44:55.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.161+0000 7f2331d9b640 1 -- 172.21.15.63:0/2069796664 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23240309a0 con 0x7f2334144a00 2023-12-04T10:44:55.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.161+0000 7f2331d9b640 1 -- 172.21.15.63:0/2069796664 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2324030d30 con 0x7f2334144a00 2023-12-04T10:44:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.162+0000 7f23389e3640 1 -- 172.21.15.63:0/2069796664 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2334144a00 msgr2=0x7f23340b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.162+0000 7f23389e3640 1 --2- 172.21.15.63:0/2069796664 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2334144a00 0x7f23340b1e30 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2324009870 tx=0x7f232402b980 comp rx=0 tx=0).stop 2023-12-04T10:44:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.162+0000 7f23389e3640 1 -- 172.21.15.63:0/2069796664 shutdown_connections 2023-12-04T10:44:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.162+0000 7f23389e3640 1 --2- 172.21.15.63:0/2069796664 >> v2:172.21.15.66:3300/0 conn(0x7f23340701b0 0x7f2334070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.162+0000 7f23389e3640 1 --2- 172.21.15.63:0/2069796664 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2334144a00 0x7f23340b1e30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.162+0000 7f23389e3640 1 -- 172.21.15.63:0/2069796664 >> 172.21.15.63:0/2069796664 conn(0x7f23340cee80 msgr2=0x7f23340cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.162+0000 7f23389e3640 1 -- 172.21.15.63:0/2069796664 shutdown_connections 2023-12-04T10:44:55.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.162+0000 7f23389e3640 1 -- 172.21.15.63:0/2069796664 wait complete. 2023-12-04T10:44:55.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.164+0000 7f23389e3640 1 Processor -- start 2023-12-04T10:44:55.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.164+0000 7f23389e3640 1 -- start start 2023-12-04T10:44:55.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f23389e3640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f23340701b0 0x7f23340c5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f23389e3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23340ca290 0x7f23341591d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f23389e3640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2334144a00 0x7f233415ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f23389e3640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233413dde0 con 0x7f23340ca290 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f23389e3640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2334139040 con 0x7f2334144a00 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f23389e3640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2334139320 con 0x7f23340701b0 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f232bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23340ca290 0x7f23341591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f232bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23340ca290 0x7f23341591d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47666/0 (socket says 172.21.15.63:47666) 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f232bfff640 1 -- 172.21.15.63:0/4108370232 learned_addr learned my addr 172.21.15.63:0/4108370232 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f233259c640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f23340701b0 0x7f23340c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f2332d9d640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2334144a00 0x7f233415ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.165+0000 7f232bfff640 1 -- 172.21.15.63:0/4108370232 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f23340701b0 msgr2=0x7f23340c5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f232bfff640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f23340701b0 0x7f23340c5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f232bfff640 1 -- 172.21.15.63:0/4108370232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2334144a00 msgr2=0x7f233415ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f232bfff640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2334144a00 0x7f233415ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f232bfff640 1 -- 172.21.15.63:0/4108370232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23240094d0 con 0x7f23340ca290 2023-12-04T10:44:55.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f232bfff640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23340ca290 0x7f23341591d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f231c00e9b0 tx=0x7f231c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:55.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f232affd640 1 -- 172.21.15.63:0/4108370232 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c009670 con 0x7f23340ca290 2023-12-04T10:44:55.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f232affd640 1 -- 172.21.15.63:0/4108370232 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f231c00c9a0 con 0x7f23340ca290 2023-12-04T10:44:55.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f232affd640 1 -- 172.21.15.63:0/4108370232 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f231c00cd50 con 0x7f23340ca290 2023-12-04T10:44:55.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2334139600 con 0x7f23340ca290 2023-12-04T10:44:55.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.166+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2334139bc0 con 0x7f23340ca290 2023-12-04T10:44:55.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.167+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2334139d80 con 0x7f23340ca290 2023-12-04T10:44:55.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.168+0000 7f232affd640 1 -- 172.21.15.63:0/4108370232 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f231c013470 con 0x7f23340ca290 2023-12-04T10:44:55.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.169+0000 7f232affd640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f231406ae40 0x7f231406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.169+0000 7f232affd640 1 -- 172.21.15.63:0/4108370232 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f231c089dd0 con 0x7f23340ca290 2023-12-04T10:44:55.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.170+0000 7f233259c640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f231406ae40 0x7f231406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.170+0000 7f233259c640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f231406ae40 0x7f231406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2324036000 tx=0x7f232403b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:55.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.174+0000 7f232affd640 1 -- 172.21.15.63:0/4108370232 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f231c054910 con 0x7f23340ca290 2023-12-04T10:44:55.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.371+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2334068710 con 0x7f23340ca290 2023-12-04T10:44:55.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.372+0000 7f232affd640 1 -- 172.21.15.63:0/4108370232 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f231c057f30 con 0x7f23340ca290 2023-12-04T10:44:55.374 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:44:55.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f231406ae40 msgr2=0x7f231406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f231406ae40 0x7f231406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2324036000 tx=0x7f232403b040 comp rx=0 tx=0).stop 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23340ca290 msgr2=0x7f23341591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23340ca290 0x7f23341591d0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f231c00e9b0 tx=0x7f231c00ee70 comp rx=0 tx=0).stop 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 shutdown_connections 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f231406ae40 0x7f231406d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2334144a00 0x7f233415ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f23340ca290 0x7f23341591d0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 --2- 172.21.15.63:0/4108370232 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f23340701b0 0x7f23340c5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 >> 172.21.15.63:0/4108370232 conn(0x7f23340cee80 msgr2=0x7f233413c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.375+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 shutdown_connections 2023-12-04T10:44:55.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.376+0000 7f23389e3640 1 -- 172.21.15.63:0/4108370232 wait complete. 2023-12-04T10:44:55.396 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:44:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.625+0000 7f6959716640 1 Processor -- start 2023-12-04T10:44:55.627 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.625+0000 7f6959716640 1 -- start start 2023-12-04T10:44:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.626+0000 7f6959716640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f695415d5e0 0x7f69540ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.626+0000 7f6959716640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f69540d0180 0x7f69540ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.626+0000 7f6959716640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69540d0e60 con 0x7f695415d200 2023-12-04T10:44:55.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.626+0000 7f6959716640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69540b6f70 con 0x7f69540d0180 2023-12-04T10:44:55.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.626+0000 7f6959716640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69540d1140 con 0x7f695415d5e0 2023-12-04T10:44:55.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.627+0000 7f6958f15640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f69540d0180 0x7f69540ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.627+0000 7f6958f15640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f69540d0180 0x7f69540ced00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47678/0 (socket says 172.21.15.63:47678) 2023-12-04T10:44:55.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.627+0000 7f6958f15640 1 -- 172.21.15.63:0/1418041784 learned_addr learned my addr 172.21.15.63:0/1418041784 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:55.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.627+0000 7f69537fe640 1 --2- 172.21.15.63:0/1418041784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f695415d5e0 0x7f69540ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.627+0000 7f6958f15640 1 -- 172.21.15.63:0/1418041784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f695415d5e0 msgr2=0x7f69540ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:55.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.627+0000 7f6958f15640 1 --2- 172.21.15.63:0/1418041784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f695415d5e0 0x7f69540ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.628+0000 7f6958f15640 1 -- 172.21.15.63:0/1418041784 >> v1:172.21.15.66:6789/0 conn(0x7f695415d200 legacy=0x7f69540cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.628+0000 7f6958f15640 1 -- 172.21.15.63:0/1418041784 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69540d1420 con 0x7f69540d0180 2023-12-04T10:44:55.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.629+0000 7f6958f15640 1 --2- 172.21.15.63:0/1418041784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540d0180 0x7f69540ced00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f694c009870 tx=0x7f694c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448e63a8ae5530 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:55.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.629+0000 7f6952ffd640 1 -- 172.21.15.63:0/1418041784 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c031640 con 0x7f69540d0180 2023-12-04T10:44:55.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.629+0000 7f6952ffd640 1 -- 172.21.15.63:0/1418041784 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c0317a0 con 0x7f69540d0180 2023-12-04T10:44:55.631 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.629+0000 7f6952ffd640 1 -- 172.21.15.63:0/1418041784 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c031b30 con 0x7f69540d0180 2023-12-04T10:44:55.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.630+0000 7f6959716640 1 -- 172.21.15.63:0/1418041784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540d0180 msgr2=0x7f69540ced00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.630+0000 7f6959716640 1 --2- 172.21.15.63:0/1418041784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540d0180 0x7f69540ced00 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f694c009870 tx=0x7f694c02b8f0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.630+0000 7f6959716640 1 -- 172.21.15.63:0/1418041784 shutdown_connections 2023-12-04T10:44:55.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.630+0000 7f6959716640 1 --2- 172.21.15.63:0/1418041784 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69540d0180 0x7f69540ced00 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.630+0000 7f6959716640 1 --2- 172.21.15.63:0/1418041784 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f695415d5e0 0x7f69540ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.630+0000 7f6959716640 1 -- 172.21.15.63:0/1418041784 >> 172.21.15.63:0/1418041784 conn(0x7f695409c3e0 msgr2=0x7f69540d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:55.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.630+0000 7f6959716640 1 -- 172.21.15.63:0/1418041784 shutdown_connections 2023-12-04T10:44:55.632 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.630+0000 7f6959716640 1 -- 172.21.15.63:0/1418041784 wait complete. 2023-12-04T10:44:55.633 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.632+0000 7f6959716640 1 Processor -- start 2023-12-04T10:44:55.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.632+0000 7f6959716640 1 -- start start 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6959716640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69540d0180 0x7f6954154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6959716640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695415d200 0x7f6954158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6959716640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f695415d5e0 0x7f6954159060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6959716640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6954154b70 con 0x7f695415d5e0 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6959716640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695415f770 con 0x7f695415d200 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6959716640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695415fa50 con 0x7f69540d0180 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6958f15640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f695415d5e0 0x7f6954159060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6958f15640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f695415d5e0 0x7f6954159060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47682/0 (socket says 172.21.15.63:47682) 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6958f15640 1 -- 172.21.15.63:0/1232932797 learned_addr learned my addr 172.21.15.63:0/1232932797 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f69537fe640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695415d200 0x7f6954158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.633+0000 7f6953fff640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69540d0180 0x7f6954154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6958f15640 1 -- 172.21.15.63:0/1232932797 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69540d0180 msgr2=0x7f6954154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.636 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6958f15640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69540d0180 0x7f6954154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6958f15640 1 -- 172.21.15.63:0/1232932797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695415d200 msgr2=0x7f6954158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6958f15640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695415d200 0x7f6954158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6958f15640 1 -- 172.21.15.63:0/1232932797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f694c0094d0 con 0x7f695415d5e0 2023-12-04T10:44:55.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6958f15640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f695415d5e0 0x7f6954159060 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f694c009870 tx=0x7f694c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:55.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6950ff9640 1 -- 172.21.15.63:0/1232932797 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c03ac60 con 0x7f695415d5e0 2023-12-04T10:44:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6950ff9640 1 -- 172.21.15.63:0/1232932797 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f694c03ade0 con 0x7f695415d5e0 2023-12-04T10:44:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69540d2080 con 0x7f695415d5e0 2023-12-04T10:44:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.634+0000 7f6950ff9640 1 -- 172.21.15.63:0/1232932797 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c044630 con 0x7f695415d5e0 2023-12-04T10:44:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.635+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6954160010 con 0x7f695415d5e0 2023-12-04T10:44:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.636+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f695404e840 con 0x7f695415d5e0 2023-12-04T10:44:55.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.637+0000 7f6950ff9640 1 -- 172.21.15.63:0/1232932797 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f694c02f050 con 0x7f695415d5e0 2023-12-04T10:44:55.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.638+0000 7f6950ff9640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f694006ae40 0x7f694006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:55.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.638+0000 7f6950ff9640 1 -- 172.21.15.63:0/1232932797 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f694c0ab8b0 con 0x7f695415d5e0 2023-12-04T10:44:55.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.638+0000 7f6953fff640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f694006ae40 0x7f694006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:55.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.639+0000 7f6953fff640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f694006ae40 0x7f694006d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69540c6b00 tx=0x7f6944009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:55.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.643+0000 7f6950ff9640 1 -- 172.21.15.63:0/1232932797 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f694c076590 con 0x7f695415d5e0 2023-12-04T10:44:55.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.838+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f69540d0750 con 0x7f695415d5e0 2023-12-04T10:44:55.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.839+0000 7f6950ff9640 1 -- 172.21.15.63:0/1232932797 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f694c079bb0 con 0x7f695415d5e0 2023-12-04T10:44:55.841 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:55.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f694006ae40 msgr2=0x7f694006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f694006ae40 0x7f694006d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f69540c6b00 tx=0x7f6944009040 comp rx=0 tx=0).stop 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f695415d5e0 msgr2=0x7f6954159060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f695415d5e0 0x7f6954159060 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f694c009870 tx=0x7f694c0046c0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 shutdown_connections 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f694006ae40 0x7f694006d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f695415d5e0 0x7f6954159060 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f695415d200 0x7f6954158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 --2- 172.21.15.63:0/1232932797 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69540d0180 0x7f6954154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.841+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 >> 172.21.15.63:0/1232932797 conn(0x7f695409c3e0 msgr2=0x7f69540b5d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.842+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 shutdown_connections 2023-12-04T10:44:55.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:55.842+0000 7f6959716640 1 -- 172.21.15.63:0/1232932797 wait complete. 2023-12-04T10:44:55.864 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:56.087 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.085+0000 7f07b6f06640 1 Processor -- start 2023-12-04T10:44:56.087 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.085+0000 7f07b6f06640 1 -- start start 2023-12-04T10:44:56.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.087+0000 7f07b6f06640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f07b0151ca0 0x7f07b006db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.087+0000 7f07b6f06640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07b015b470 0x7f07b00cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.087+0000 7f07b6f06640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07b00cc7f0 con 0x7f07b006e0b0 2023-12-04T10:44:56.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.087+0000 7f07b6f06640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b00cca40 con 0x7f07b015b470 2023-12-04T10:44:56.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.087+0000 7f07b6f06640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07b00ccd20 con 0x7f07b0151ca0 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.087+0000 7f07b5703640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f07b015b470 0x7f07b00cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.087+0000 7f07b6705640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f07b006e0b0 0x7f07b0071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37650/0 (socket says 172.21.15.63:37650) 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.087+0000 7f07b6705640 1 -- 172.21.15.63:0/3921717864 learned_addr learned my addr 172.21.15.63:0/3921717864 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.088+0000 7f07b5f04640 1 --2- 172.21.15.63:0/3921717864 >> v2:172.21.15.66:3300/0 conn(0x7f07b0151ca0 0x7f07b006db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.088+0000 7f07b5703640 1 -- 172.21.15.63:0/3921717864 >> v2:172.21.15.66:3300/0 conn(0x7f07b0151ca0 msgr2=0x7f07b006db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.088+0000 7f07b5703640 1 --2- 172.21.15.63:0/3921717864 >> v2:172.21.15.66:3300/0 conn(0x7f07b0151ca0 0x7f07b006db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.088+0000 7f07b5703640 1 -- 172.21.15.63:0/3921717864 >> v1:172.21.15.63:6789/0 conn(0x7f07b006e0b0 legacy=0x7f07b0071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.088+0000 7f07b5703640 1 -- 172.21.15.63:0/3921717864 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07b00cd000 con 0x7f07b015b470 2023-12-04T10:44:56.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.088+0000 7f07b4f02640 1 -- 172.21.15.63:0/3921717864 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121118527 0 0) 0x7f07b00cc7f0 con 0x7f07b006e0b0 2023-12-04T10:44:56.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.089+0000 7f07b5703640 1 --2- 172.21.15.63:0/3921717864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b015b470 0x7f07b00cb570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07b00cdfb0 tx=0x7f07a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67431f1b325380f8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:56.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.090+0000 7f07b4f02640 1 -- 172.21.15.63:0/3921717864 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a002e070 con 0x7f07b015b470 2023-12-04T10:44:56.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.090+0000 7f07b4f02640 1 -- 172.21.15.63:0/3921717864 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a00315a0 con 0x7f07b015b470 2023-12-04T10:44:56.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.090+0000 7f07b4f02640 1 -- 172.21.15.63:0/3921717864 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a0031930 con 0x7f07b015b470 2023-12-04T10:44:56.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.090+0000 7f07b6f06640 1 -- 172.21.15.63:0/3921717864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b015b470 msgr2=0x7f07b00cb570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.090+0000 7f07b6f06640 1 --2- 172.21.15.63:0/3921717864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b015b470 0x7f07b00cb570 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f07b00cdfb0 tx=0x7f07a002b840 comp rx=0 tx=0).stop 2023-12-04T10:44:56.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.090+0000 7f07b6f06640 1 -- 172.21.15.63:0/3921717864 shutdown_connections 2023-12-04T10:44:56.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.091+0000 7f07b6f06640 1 --2- 172.21.15.63:0/3921717864 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b015b470 0x7f07b00cb570 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.091+0000 7f07b6f06640 1 --2- 172.21.15.63:0/3921717864 >> v2:172.21.15.66:3300/0 conn(0x7f07b0151ca0 0x7f07b006db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.091+0000 7f07b6f06640 1 -- 172.21.15.63:0/3921717864 >> 172.21.15.63:0/3921717864 conn(0x7f07b00b07f0 msgr2=0x7f07b00b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:56.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.091+0000 7f07b6f06640 1 -- 172.21.15.63:0/3921717864 shutdown_connections 2023-12-04T10:44:56.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.091+0000 7f07b6f06640 1 -- 172.21.15.63:0/3921717864 wait complete. 2023-12-04T10:44:56.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.092+0000 7f07b6f06640 1 Processor -- start 2023-12-04T10:44:56.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.093+0000 7f07b6f06640 1 -- start start 2023-12-04T10:44:56.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.093+0000 7f07b6f06640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b006e0b0 0x7f07b00b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.093+0000 7f07b6f06640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07b0151ca0 0x7f07b00b1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b6f06640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b0156150 0x7f07b0070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b6f06640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00c5230 con 0x7f07b006e0b0 2023-12-04T10:44:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b6f06640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07b0156650 con 0x7f07b0156150 2023-12-04T10:44:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b6f06640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07b00712c0 con 0x7f07b0151ca0 2023-12-04T10:44:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b006e0b0 0x7f07b00b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b006e0b0 0x7f07b00b18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47702/0 (socket says 172.21.15.63:47702) 2023-12-04T10:44:56.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 -- 172.21.15.63:0/4072703272 learned_addr learned my addr 172.21.15.63:0/4072703272 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 -- 172.21.15.63:0/4072703272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07b0151ca0 msgr2=0x7f07b00b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07b0151ca0 0x7f07b00b1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 -- 172.21.15.63:0/4072703272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b0156150 msgr2=0x7f07b0070240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b0156150 0x7f07b0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 -- 172.21.15.63:0/4072703272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0009400 con 0x7f07b006e0b0 2023-12-04T10:44:56.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.094+0000 7f07b5f04640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b006e0b0 0x7f07b00b18e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00d800 tx=0x7f07ac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.095+0000 7f07a67fc640 1 -- 172.21.15.63:0/4072703272 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00b6c0 con 0x7f07b006e0b0 2023-12-04T10:44:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.095+0000 7f07a67fc640 1 -- 172.21.15.63:0/4072703272 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07ac00b820 con 0x7f07b006e0b0 2023-12-04T10:44:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.095+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07b00715a0 con 0x7f07b006e0b0 2023-12-04T10:44:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.095+0000 7f07a67fc640 1 -- 172.21.15.63:0/4072703272 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07ac00bbb0 con 0x7f07b006e0b0 2023-12-04T10:44:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.095+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07b01568a0 con 0x7f07b006e0b0 2023-12-04T10:44:56.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.096+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07b0156a30 con 0x7f07b006e0b0 2023-12-04T10:44:56.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.097+0000 7f07a67fc640 1 -- 172.21.15.63:0/4072703272 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f07ac00bd10 con 0x7f07b006e0b0 2023-12-04T10:44:56.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.098+0000 7f07a67fc640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f079406ae70 0x7f079406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.098+0000 7f07a67fc640 1 -- 172.21.15.63:0/4072703272 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f07ac089f60 con 0x7f07b006e0b0 2023-12-04T10:44:56.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.098+0000 7f07b5703640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f079406ae70 0x7f079406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.099+0000 7f07b5703640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f079406ae70 0x7f079406d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07a0036000 tx=0x7f07a0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:56.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.102+0000 7f07a67fc640 1 -- 172.21.15.63:0/4072703272 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07ac054c50 con 0x7f07b006e0b0 2023-12-04T10:44:56.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.304+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07b004e840 con 0x7f07b006e0b0 2023-12-04T10:44:56.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.306+0000 7f07a67fc640 1 -- 172.21.15.63:0/4072703272 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f07ac058270 con 0x7f07b006e0b0 2023-12-04T10:44:56.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:56.309 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:56.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.309+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f079406ae70 msgr2=0x7f079406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.309+0000 7f07b6f06640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f079406ae70 0x7f079406d330 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f07a0036000 tx=0x7f07a0030000 comp rx=0 tx=0).stop 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.309+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b006e0b0 msgr2=0x7f07b00b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.309+0000 7f07b6f06640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b006e0b0 0x7f07b00b18e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f07ac00d800 tx=0x7f07ac00dcc0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.310+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 shutdown_connections 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.310+0000 7f07b6f06640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f079406ae70 0x7f079406d330 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.310+0000 7f07b6f06640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f07b0151ca0 0x7f07b00b1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.310+0000 7f07b6f06640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f07b0156150 0x7f07b0070240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.310+0000 7f07b6f06640 1 --2- 172.21.15.63:0/4072703272 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f07b006e0b0 0x7f07b00b18e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.310+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 >> 172.21.15.63:0/4072703272 conn(0x7f07b00b07f0 msgr2=0x7f07b00c96e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.310+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 shutdown_connections 2023-12-04T10:44:56.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.310+0000 7f07b6f06640 1 -- 172.21.15.63:0/4072703272 wait complete. 2023-12-04T10:44:56.330 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:56.331 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:56.548 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.546+0000 7f3247fff640 1 Processor -- start 2023-12-04T10:44:56.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.547+0000 7f3247fff640 1 -- start start 2023-12-04T10:44:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.548+0000 7f3247fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3248143ca0 0x7f32480b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.548+0000 7f3247fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f324806c520 0x7f32480cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3247fff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32480cb800 con 0x7f32480b3350 2023-12-04T10:44:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3247fff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480cbae0 con 0x7f3248143ca0 2023-12-04T10:44:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3247fff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32480cbdc0 con 0x7f324806c520 2023-12-04T10:44:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3246ffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3248143ca0 0x7f32480b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3246ffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f3248143ca0 0x7f32480b2e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47710/0 (socket says 172.21.15.63:47710) 2023-12-04T10:44:56.551 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3246ffd640 1 -- 172.21.15.63:0/2009190138 learned_addr learned my addr 172.21.15.63:0/2009190138 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:56.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f32477fe640 1 --2- 172.21.15.63:0/2009190138 >> v2:172.21.15.66:3300/0 conn(0x7f324806c520 0x7f32480cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3246ffd640 1 -- 172.21.15.63:0/2009190138 >> v2:172.21.15.66:3300/0 conn(0x7f324806c520 msgr2=0x7f32480cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:56.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3246ffd640 1 --2- 172.21.15.63:0/2009190138 >> v2:172.21.15.66:3300/0 conn(0x7f324806c520 0x7f32480cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3246ffd640 1 -- 172.21.15.63:0/2009190138 >> v1:172.21.15.66:6789/0 conn(0x7f32480b3350 legacy=0x7f324806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:56.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f3246ffd640 1 -- 172.21.15.63:0/2009190138 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32480b2610 con 0x7f3248143ca0 2023-12-04T10:44:56.552 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.549+0000 7f32477fe640 1 --2- 172.21.15.63:0/2009190138 >> v2:172.21.15.66:3300/0 conn(0x7f324806c520 0x7f32480cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:56.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.551+0000 7f3246ffd640 1 --2- 172.21.15.63:0/2009190138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3248143ca0 0x7f32480b2e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3248144ef0 tx=0x7f323802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2341624c2633f56e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:56.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.551+0000 7f3245ffb640 1 -- 172.21.15.63:0/2009190138 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f323802ca80 con 0x7f3248143ca0 2023-12-04T10:44:56.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.551+0000 7f3245ffb640 1 -- 172.21.15.63:0/2009190138 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f323802cbe0 con 0x7f3248143ca0 2023-12-04T10:44:56.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.551+0000 7f3245ffb640 1 -- 172.21.15.63:0/2009190138 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32380343f0 con 0x7f3248143ca0 2023-12-04T10:44:56.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.552+0000 7f3247fff640 1 -- 172.21.15.63:0/2009190138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3248143ca0 msgr2=0x7f32480b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.552+0000 7f3247fff640 1 --2- 172.21.15.63:0/2009190138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3248143ca0 0x7f32480b2e10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f3248144ef0 tx=0x7f323802bee0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.552+0000 7f3247fff640 1 -- 172.21.15.63:0/2009190138 shutdown_connections 2023-12-04T10:44:56.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.552+0000 7f3247fff640 1 --2- 172.21.15.63:0/2009190138 >> v2:172.21.15.66:3300/0 conn(0x7f324806c520 0x7f32480cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.552+0000 7f3247fff640 1 --2- 172.21.15.63:0/2009190138 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3248143ca0 0x7f32480b2e10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.552+0000 7f3247fff640 1 -- 172.21.15.63:0/2009190138 >> 172.21.15.63:0/2009190138 conn(0x7f32480b0860 msgr2=0x7f32480b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:56.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.552+0000 7f3247fff640 1 -- 172.21.15.63:0/2009190138 shutdown_connections 2023-12-04T10:44:56.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.552+0000 7f3247fff640 1 -- 172.21.15.63:0/2009190138 wait complete. 2023-12-04T10:44:56.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.554+0000 7f3247fff640 1 Processor -- start 2023-12-04T10:44:56.556 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.554+0000 7f3247fff640 1 -- start start 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f3247fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f324806c520 0x7f32480ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f3247fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32480b3350 0x7f32481f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f3247fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3248143ca0 0x7f32481f6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f3247fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324815e0c0 con 0x7f32480b3350 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f3247fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f324815d540 con 0x7f3248143ca0 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f3247fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f324815d820 con 0x7f324806c520 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f32467fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32480b3350 0x7f32481f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f32467fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32480b3350 0x7f32481f60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47718/0 (socket says 172.21.15.63:47718) 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.555+0000 7f32467fc640 1 -- 172.21.15.63:0/2663939392 learned_addr learned my addr 172.21.15.63:0/2663939392 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:56.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f32477fe640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3248143ca0 0x7f32481f6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f3246ffd640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f324806c520 0x7f32480ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f32467fc640 1 -- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f324806c520 msgr2=0x7f32480ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f32467fc640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f324806c520 0x7f32480ca7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f32467fc640 1 -- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3248143ca0 msgr2=0x7f32481f6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f32467fc640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3248143ca0 0x7f32481f6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f32467fc640 1 -- 172.21.15.63:0/2663939392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3238009b30 con 0x7f32480b3350 2023-12-04T10:44:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f32477fe640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3248143ca0 0x7f32481f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:56.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.556+0000 7f32467fc640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32480b3350 0x7f32481f60d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f323000c3f0 tx=0x7f323000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.557+0000 7f323ffff640 1 -- 172.21.15.63:0/2663939392 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300054e0 con 0x7f32480b3350 2023-12-04T10:44:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.557+0000 7f323ffff640 1 -- 172.21.15.63:0/2663939392 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230003640 con 0x7f32480b3350 2023-12-04T10:44:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.557+0000 7f323ffff640 1 -- 172.21.15.63:0/2663939392 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300039b0 con 0x7f32480b3350 2023-12-04T10:44:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.557+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f324815db00 con 0x7f32480b3350 2023-12-04T10:44:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.557+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32480cad00 con 0x7f32480b3350 2023-12-04T10:44:56.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.558+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f324804e840 con 0x7f32480b3350 2023-12-04T10:44:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.559+0000 7f323ffff640 1 -- 172.21.15.63:0/2663939392 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3230003b10 con 0x7f32480b3350 2023-12-04T10:44:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.560+0000 7f323ffff640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f322806ae40 0x7f322806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.560+0000 7f323ffff640 1 -- 172.21.15.63:0/2663939392 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3230088b40 con 0x7f32480b3350 2023-12-04T10:44:56.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.560+0000 7f3246ffd640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f322806ae40 0x7f322806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:56.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.561+0000 7f3246ffd640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f322806ae40 0x7f322806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3238035000 tx=0x7f3238030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:56.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.564+0000 7f323ffff640 1 -- 172.21.15.63:0/2663939392 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f32300538e0 con 0x7f32480b3350 2023-12-04T10:44:56.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.758+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f324806db90 con 0x7f32480b3350 2023-12-04T10:44:56.761 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.759+0000 7f323ffff640 1 -- 172.21.15.63:0/2663939392 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f32300170a0 con 0x7f32480b3350 2023-12-04T10:44:56.761 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:56.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f322806ae40 msgr2=0x7f322806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f322806ae40 0x7f322806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3238035000 tx=0x7f3238030000 comp rx=0 tx=0).stop 2023-12-04T10:44:56.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32480b3350 msgr2=0x7f32481f60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:56.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32480b3350 0x7f32481f60d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f323000c3f0 tx=0x7f323000c8b0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 shutdown_connections 2023-12-04T10:44:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f322806ae40 0x7f322806d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3248143ca0 0x7f32481f6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f32480b3350 0x7f32481f60d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 --2- 172.21.15.63:0/2663939392 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f324806c520 0x7f32480ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 >> 172.21.15.63:0/2663939392 conn(0x7f32480b0860 msgr2=0x7f324806be10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 shutdown_connections 2023-12-04T10:44:56.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:56.762+0000 7f3247fff640 1 -- 172.21.15.63:0/2663939392 wait complete. 2023-12-04T10:44:56.784 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:57.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.011+0000 7f6ac0d39640 1 Processor -- start 2023-12-04T10:44:57.013 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.011+0000 7f6ac0d39640 1 -- start start 2023-12-04T10:44:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.013+0000 7f6ac0d39640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6abc15d730 0x7f6abc0b14f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.013+0000 7f6ac0d39640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc0d3820 0x7f6abc0b1a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.013+0000 7f6ac0d39640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6abc0b0450 con 0x7f6abc15d350 2023-12-04T10:44:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.013+0000 7f6ac0d39640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6abc0b0730 con 0x7f6abc15d730 2023-12-04T10:44:57.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.013+0000 7f6ac0d39640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b0a10 con 0x7f6abc0d3820 2023-12-04T10:44:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.013+0000 7f6ab1d9b640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6abc15d730 0x7f6abc0b14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.013+0000 7f6aba59c640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6abc15d350 0x7f6abc0d3110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37652/0 (socket says 172.21.15.63:37652) 2023-12-04T10:44:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.013+0000 7f6aba59c640 1 -- 172.21.15.63:0/3181539535 learned_addr learned my addr 172.21.15.63:0/3181539535 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.014+0000 7f6abad9d640 1 --2- 172.21.15.63:0/3181539535 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc0d3820 0x7f6abc0b1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.014+0000 7f6ab1d9b640 1 -- 172.21.15.63:0/3181539535 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc0d3820 msgr2=0x7f6abc0b1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.014+0000 7f6ab1d9b640 1 --2- 172.21.15.63:0/3181539535 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc0d3820 0x7f6abc0b1a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.014+0000 7f6ab1d9b640 1 -- 172.21.15.63:0/3181539535 >> v1:172.21.15.63:6789/0 conn(0x7f6abc15d350 legacy=0x7f6abc0d3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.014+0000 7f6ab1d9b640 1 -- 172.21.15.63:0/3181539535 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6abc0b0cf0 con 0x7f6abc15d730 2023-12-04T10:44:57.017 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.014+0000 7f6ab9d9b640 1 -- 172.21.15.63:0/3181539535 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2231209552 0 0) 0x7f6abc0b0450 con 0x7f6abc15d350 2023-12-04T10:44:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.015+0000 7f6ab1d9b640 1 --2- 172.21.15.63:0/3181539535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc15d730 0x7f6abc0b14f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40097a0 tx=0x7f6aa402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd72313ed23bf04 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.015+0000 7f6ab9d9b640 1 -- 172.21.15.63:0/3181539535 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4031780 con 0x7f6abc15d730 2023-12-04T10:44:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.015+0000 7f6ab9d9b640 1 -- 172.21.15.63:0/3181539535 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aa40318e0 con 0x7f6abc15d730 2023-12-04T10:44:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.015+0000 7f6ab9d9b640 1 -- 172.21.15.63:0/3181539535 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aa4031c70 con 0x7f6abc15d730 2023-12-04T10:44:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.016+0000 7f6ac0d39640 1 -- 172.21.15.63:0/3181539535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc15d730 msgr2=0x7f6abc0b14f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.016+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/3181539535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc15d730 0x7f6abc0b14f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6aa40097a0 tx=0x7f6aa402b820 comp rx=0 tx=0).stop 2023-12-04T10:44:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.016+0000 7f6ac0d39640 1 -- 172.21.15.63:0/3181539535 shutdown_connections 2023-12-04T10:44:57.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.016+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/3181539535 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc0d3820 0x7f6abc0b1a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.016+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/3181539535 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc15d730 0x7f6abc0b14f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.016+0000 7f6ac0d39640 1 -- 172.21.15.63:0/3181539535 >> 172.21.15.63:0/3181539535 conn(0x7f6abc08cc80 msgr2=0x7f6abc09c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.016+0000 7f6ac0d39640 1 -- 172.21.15.63:0/3181539535 shutdown_connections 2023-12-04T10:44:57.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.016+0000 7f6ac0d39640 1 -- 172.21.15.63:0/3181539535 wait complete. 2023-12-04T10:44:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.018+0000 7f6ac0d39640 1 Processor -- start 2023-12-04T10:44:57.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.018+0000 7f6ac0d39640 1 -- start start 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6ac0d39640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc0d3820 0x7f6abc15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6ac0d39640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6abc15d350 0x7f6abc0b73b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6ac0d39640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc15d730 0x7f6abc15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6ac0d39640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b7a40 con 0x7f6abc0d3820 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6ac0d39640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b7d20 con 0x7f6abc15d350 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6ac0d39640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc0b8000 con 0x7f6abc15d730 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6aba59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc0d3820 0x7f6abc15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6aba59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc0d3820 0x7f6abc15a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47740/0 (socket says 172.21.15.63:47740) 2023-12-04T10:44:57.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.019+0000 7f6aba59c640 1 -- 172.21.15.63:0/4121252744 learned_addr learned my addr 172.21.15.63:0/4121252744 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6aba59c640 1 -- 172.21.15.63:0/4121252744 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc15d730 msgr2=0x7f6abc15f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6aba59c640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc15d730 0x7f6abc15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6aba59c640 1 -- 172.21.15.63:0/4121252744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6abc15d350 msgr2=0x7f6abc0b73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6aba59c640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6abc15d350 0x7f6abc0b73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6aba59c640 1 -- 172.21.15.63:0/4121252744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa4009400 con 0x7f6abc0d3820 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6aba59c640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc0d3820 0x7f6abc15a800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c4d0 tx=0x7f6aac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6ab37fe640 1 -- 172.21.15.63:0/4121252744 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac0074e0 con 0x7f6abc0d3820 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6ab37fe640 1 -- 172.21.15.63:0/4121252744 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6aac007660 con 0x7f6abc0d3820 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6ab37fe640 1 -- 172.21.15.63:0/4121252744 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6aac004a20 con 0x7f6abc0d3820 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc0b82e0 con 0x7f6abc0d3820 2023-12-04T10:44:57.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.020+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc15f560 con 0x7f6abc0d3820 2023-12-04T10:44:57.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.021+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc0b8800 con 0x7f6abc0d3820 2023-12-04T10:44:57.024 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.022+0000 7f6ab37fe640 1 -- 172.21.15.63:0/4121252744 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6aac004b80 con 0x7f6abc0d3820 2023-12-04T10:44:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.024+0000 7f6ab37fe640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a9c06ae70 0x7f6a9c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.024+0000 7f6ab37fe640 1 -- 172.21.15.63:0/4121252744 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6aac088c10 con 0x7f6abc0d3820 2023-12-04T10:44:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.024+0000 7f6ab1d9b640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a9c06ae70 0x7f6a9c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.025+0000 7f6ab1d9b640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a9c06ae70 0x7f6a9c06d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4036000 tx=0x7f6aa4030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.030 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.028+0000 7f6ab37fe640 1 -- 172.21.15.63:0/4121252744 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6abc0b8800 con 0x7f6abc0d3820 2023-12-04T10:44:57.225 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.223+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6abc0b8800 con 0x7f6abc0d3820 2023-12-04T10:44:57.226 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.224+0000 7f6ab37fe640 1 -- 172.21.15.63:0/4121252744 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6abc0b8800 con 0x7f6abc0d3820 2023-12-04T10:44:57.226 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:57.228 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a9c06ae70 msgr2=0x7f6a9c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a9c06ae70 0x7f6a9c06d330 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6aa4036000 tx=0x7f6aa4030000 comp rx=0 tx=0).stop 2023-12-04T10:44:57.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc0d3820 msgr2=0x7f6abc15a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc0d3820 0x7f6abc15a800 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6aac00c4d0 tx=0x7f6aac00c990 comp rx=0 tx=0).stop 2023-12-04T10:44:57.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 shutdown_connections 2023-12-04T10:44:57.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6a9c06ae70 0x7f6a9c06d330 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6abc15d730 0x7f6abc15f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6abc15d350 0x7f6abc0b73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 --2- 172.21.15.63:0/4121252744 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6abc0d3820 0x7f6abc15a800 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 >> 172.21.15.63:0/4121252744 conn(0x7f6abc08cc80 msgr2=0x7f6abc06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:57.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 shutdown_connections 2023-12-04T10:44:57.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.227+0000 7f6ac0d39640 1 -- 172.21.15.63:0/4121252744 wait complete. 2023-12-04T10:44:57.249 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:57.481 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.479+0000 7fc7bc72c640 1 Processor -- start 2023-12-04T10:44:57.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.480+0000 7fc7bc72c640 1 -- start start 2023-12-04T10:44:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.481+0000 7fc7bc72c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc7b40d1fb0 0x7fc7b4168250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.481+0000 7fc7bc72c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b40b2710 con 0x7fc7b40ce8e0 2023-12-04T10:44:57.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.481+0000 7fc7bc72c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7b40d4150 con 0x7fc7b415d5d0 2023-12-04T10:44:57.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.481+0000 7fc7bc72c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7b40ced70 con 0x7fc7b40d1fb0 2023-12-04T10:44:57.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.482+0000 7fc7b9cc7640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc7b40ce8e0 0x7fc7b40d18a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37666/0 (socket says 172.21.15.63:37666) 2023-12-04T10:44:57.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.482+0000 7fc7b9cc7640 1 -- 172.21.15.63:0/2874816193 learned_addr learned my addr 172.21.15.63:0/2874816193 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.482+0000 7fc7bacc9640 1 --2- 172.21.15.63:0/2874816193 >> v2:172.21.15.66:3300/0 conn(0x7fc7b40d1fb0 0x7fc7b4168250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.482+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1791528586 0 0) 0x7fc7b40b2710 con 0x7fc7b40ce8e0 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.482+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc79c003520 con 0x7fc7b40ce8e0 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.482+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 641902111 0 0) 0x7fc79c003520 con 0x7fc7b40ce8e0 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 >> v2:172.21.15.66:3300/0 conn(0x7fc7b40d1fb0 msgr2=0x7fc7b4168250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 --2- 172.21.15.63:0/2874816193 >> v2:172.21.15.66:3300/0 conn(0x7fc7b40d1fb0 0x7fc7b4168250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 >> v1:172.21.15.66:6789/0 conn(0x7fc7b415d5d0 legacy=0x7fc7b40d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b40cf050 con 0x7fc7b40ce8e0 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fc7a8001670 con 0x7fc7b40ce8e0 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 >> v1:172.21.15.63:6789/0 conn(0x7fc7b40ce8e0 legacy=0x7fc7b40d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc79c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc79c0047c0 0x7fc79c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc79c005180 0x7fc79c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40ced70 con 0x7fc79c003970 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c00c020 con 0x7fc79c0047c0 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc79c00c1e0 con 0x7fc79c005180 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7ba4c8640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc79c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7b9cc7640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc79c0047c0 0x7fc79c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7bacc9640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc79c005180 0x7fc79c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7ba4c8640 1 -- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc79c005180 msgr2=0x7fc79c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7ba4c8640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc79c005180 0x7fc79c00b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.483+0000 7fc7ba4c8640 1 -- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc79c0047c0 msgr2=0x7fc79c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:57.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.484+0000 7fc7ba4c8640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc79c0047c0 0x7fc79c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.484+0000 7fc7ba4c8640 1 -- 172.21.15.63:0/2874816193 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc79c003520 con 0x7fc79c003970 2023-12-04T10:44:57.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.484+0000 7fc7b9cc7640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc79c0047c0 0x7fc79c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:57.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.484+0000 7fc7bacc9640 1 -- 172.21.15.63:0/2874816193 reap_dead start 2023-12-04T10:44:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.485+0000 7fc7ba4c8640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc79c003d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4001e50 tx=0x7fc79c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68fb4a19ef906d72 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.485+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4003b70 con 0x7fc79c003970 2023-12-04T10:44:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.485+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4003cd0 con 0x7fc79c003970 2023-12-04T10:44:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.485+0000 7fc7b94c6640 1 -- 172.21.15.63:0/2874816193 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4005310 con 0x7fc79c003970 2023-12-04T10:44:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.485+0000 7fc7bc72c640 1 -- 172.21.15.63:0/2874816193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 msgr2=0x7fc79c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.485+0000 7fc7bc72c640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc79c003d90 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4001e50 tx=0x7fc79c0057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.486+0000 7fc7bc72c640 1 -- 172.21.15.63:0/2874816193 shutdown_connections 2023-12-04T10:44:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.486+0000 7fc7bc72c640 1 --2- 172.21.15.63:0/2874816193 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc79c003d90 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.486+0000 7fc7bc72c640 1 -- 172.21.15.63:0/2874816193 >> 172.21.15.63:0/2874816193 conn(0x7fc7b409c600 msgr2=0x7fc7b40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.486+0000 7fc7bc72c640 1 -- 172.21.15.63:0/2874816193 shutdown_connections 2023-12-04T10:44:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.486+0000 7fc7bc72c640 1 -- 172.21.15.63:0/2874816193 wait complete. 2023-12-04T10:44:57.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.488+0000 7fc7bc72c640 1 Processor -- start 2023-12-04T10:44:57.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.488+0000 7fc7bc72c640 1 -- start start 2023-12-04T10:44:57.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7bc72c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc7b40b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7bc72c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7b40b8840 0x7fc7b40b6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7bc72c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7b40b6db0 0x7fc7b415dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7bc72c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40b7260 con 0x7fc79c003970 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7bc72c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40cbca0 con 0x7fc7b40b6db0 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7bc72c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7b40cbf80 con 0x7fc7b40b8840 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7ba4c8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc7b40b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7ba4c8640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc7b40b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47770/0 (socket says 172.21.15.63:47770) 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7ba4c8640 1 -- 172.21.15.63:0/3213597309 learned_addr learned my addr 172.21.15.63:0/3213597309 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.489+0000 7fc7b9cc7640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7b40b8840 0x7fc7b40b6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7bacc9640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7b40b6db0 0x7fc7b415dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7ba4c8640 1 -- 172.21.15.63:0/3213597309 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7b40b8840 msgr2=0x7fc7b40b6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7ba4c8640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7b40b8840 0x7fc7b40b6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7ba4c8640 1 -- 172.21.15.63:0/3213597309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7b40b6db0 msgr2=0x7fc7b415dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7ba4c8640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7b40b6db0 0x7fc7b415dd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7ba4c8640 1 -- 172.21.15.63:0/3213597309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b40cc260 con 0x7fc79c003970 2023-12-04T10:44:57.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7ba4c8640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc7b40b11b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc7a402bf90 tx=0x7fc7a40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7b2ffd640 1 -- 172.21.15.63:0/3213597309 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a403e070 con 0x7fc79c003970 2023-12-04T10:44:57.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7b2ffd640 1 -- 172.21.15.63:0/3213597309 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7a4006b50 con 0x7fc79c003970 2023-12-04T10:44:57.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7b2ffd640 1 -- 172.21.15.63:0/3213597309 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4007030 con 0x7fc79c003970 2023-12-04T10:44:57.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7b40b7260 con 0x7fc79c003970 2023-12-04T10:44:57.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.490+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7b40cc820 con 0x7fc79c003970 2023-12-04T10:44:57.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.492+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7b40cc9b0 con 0x7fc79c003970 2023-12-04T10:44:57.494 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.493+0000 7fc7b2ffd640 1 -- 172.21.15.63:0/3213597309 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7a4007190 con 0x7fc79c003970 2023-12-04T10:44:57.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.494+0000 7fc7b2ffd640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc7a006ae40 0x7fc7a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.494+0000 7fc7b2ffd640 1 -- 172.21.15.63:0/3213597309 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc7a40ab5b0 con 0x7fc79c003970 2023-12-04T10:44:57.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.494+0000 7fc7b9cc7640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc7a006ae40 0x7fc7a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.498 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.495+0000 7fc7b9cc7640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc7a006ae40 0x7fc7a006d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4160e20 tx=0x7fc7a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.499+0000 7fc7b2ffd640 1 -- 172.21.15.63:0/3213597309 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7a4076290 con 0x7fc79c003970 2023-12-04T10:44:57.695 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.693+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc7b4068710 con 0x7fc79c003970 2023-12-04T10:44:57.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.694+0000 7fc7b2ffd640 1 -- 172.21.15.63:0/3213597309 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc7a40798b0 con 0x7fc79c003970 2023-12-04T10:44:57.696 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:44:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc7a006ae40 msgr2=0x7fc7a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc7a006ae40 0x7fc7a006d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4160e20 tx=0x7fc7a8009040 comp rx=0 tx=0).stop 2023-12-04T10:44:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 msgr2=0x7fc7b40b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc7b40b11b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fc7a402bf90 tx=0x7fc7a40014a0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 shutdown_connections 2023-12-04T10:44:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc7a006ae40 0x7fc7a006d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc7b40b8840 0x7fc7b40b6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc7b40b6db0 0x7fc7b415dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 --2- 172.21.15.63:0/3213597309 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc79c003970 0x7fc7b40b11b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 >> 172.21.15.63:0/3213597309 conn(0x7fc7b409c600 msgr2=0x7fc7b40d18a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 shutdown_connections 2023-12-04T10:44:57.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.697+0000 7fc7bc72c640 1 -- 172.21.15.63:0/3213597309 wait complete. 2023-12-04T10:44:57.721 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:44:57.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.948+0000 7f96e7fff640 1 Processor -- start 2023-12-04T10:44:57.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.948+0000 7f96e7fff640 1 -- start start 2023-12-04T10:44:57.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.950+0000 7f96e7fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e806c520 0x7f96e8165f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.950+0000 7f96e7fff640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80cb800 con 0x7f96e8144370 2023-12-04T10:44:57.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.950+0000 7f96e7fff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e80cbae0 con 0x7f96e8143ca0 2023-12-04T10:44:57.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.950+0000 7f96e7fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80cbdc0 con 0x7f96e806c520 2023-12-04T10:44:57.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.950+0000 7f96dffff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f96e8144370 0x7f96e806be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37680/0 (socket says 172.21.15.63:37680) 2023-12-04T10:44:57.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.950+0000 7f96dffff640 1 -- 172.21.15.63:0/3005974293 learned_addr learned my addr 172.21.15.63:0/3005974293 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.950+0000 7f96e77fe640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e806c520 0x7f96e8165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 162380285 0 0) 0x7f96e80cb800 con 0x7f96e8144370 2023-12-04T10:44:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d4003520 con 0x7f96e8144370 2023-12-04T10:44:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1638668026 0 0) 0x7f96d4003520 con 0x7f96e8144370 2023-12-04T10:44:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e806c520 msgr2=0x7f96e8165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e806c520 0x7f96e8165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 >> v1:172.21.15.66:6789/0 conn(0x7f96e8143ca0 legacy=0x7f96e80b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e80b2610 con 0x7f96e8144370 2023-12-04T10:44:57.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f96d00017f0 con 0x7f96e8144370 2023-12-04T10:44:57.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 >> v1:172.21.15.63:6789/0 conn(0x7f96e8144370 legacy=0x7f96e806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d40039a0 0x7f96d4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e806c520 0x7f96d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e80cbdc0 con 0x7f96d40047c0 2023-12-04T10:44:57.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d400ba90 con 0x7f96d40039a0 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.951+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d400bc50 con 0x7f96e806c520 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96dffff640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96e6ffd640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d40039a0 0x7f96d4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96dffff640 1 -- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e806c520 msgr2=0x7f96d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96e77fe640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e806c520 0x7f96d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96dffff640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e806c520 0x7f96d4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96dffff640 1 -- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d40039a0 msgr2=0x7f96d4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96dffff640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d40039a0 0x7f96d4003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96dffff640 1 -- 172.21.15.63:0/3005974293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d4003520 con 0x7f96d40047c0 2023-12-04T10:44:57.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.952+0000 7f96e6ffd640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96d40039a0 0x7f96d4003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:57.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.953+0000 7f96dffff640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96d4004c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f96d0007fb0 tx=0x7f96d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=905430c84d4f130c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.953+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0007270 con 0x7f96d40047c0 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.953+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d00073d0 con 0x7f96d40047c0 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.953+0000 7f96e67fc640 1 -- 172.21.15.63:0/3005974293 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00057a0 con 0x7f96d40047c0 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.954+0000 7f96e7fff640 1 -- 172.21.15.63:0/3005974293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 msgr2=0x7f96d4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.954+0000 7f96e7fff640 1 --2- 172.21.15.63:0/3005974293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96d4004c40 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f96d0007fb0 tx=0x7f96d40057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.954+0000 7f96e77fe640 1 -- 172.21.15.63:0/3005974293 reap_dead start 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.954+0000 7f96e7fff640 1 -- 172.21.15.63:0/3005974293 shutdown_connections 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.954+0000 7f96e7fff640 1 -- 172.21.15.63:0/3005974293 >> 172.21.15.63:0/3005974293 conn(0x7f96e80b0860 msgr2=0x7f96e80b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.954+0000 7f96e7fff640 1 -- 172.21.15.63:0/3005974293 shutdown_connections 2023-12-04T10:44:57.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.954+0000 7f96e7fff640 1 -- 172.21.15.63:0/3005974293 wait complete. 2023-12-04T10:44:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.956+0000 7f96e7fff640 1 Processor -- start 2023-12-04T10:44:57.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.956+0000 7f96e7fff640 1 -- start start 2023-12-04T10:44:57.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96e815c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e7fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96e815ac30 0x7f96e815d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e7fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e81f3db0 0x7f96e81366b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e7fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e81f6020 con 0x7f96d40047c0 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e7fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e815b0b0 con 0x7f96e815ac30 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e7fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e815d970 con 0x7f96e81f3db0 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96e815c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e6ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96e815c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47784/0 (socket says 172.21.15.63:47784) 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.957+0000 7f96e6ffd640 1 -- 172.21.15.63:0/2372944419 learned_addr learned my addr 172.21.15.63:0/2372944419 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96dffff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96e815ac30 0x7f96e815d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96e6ffd640 1 -- 172.21.15.63:0/2372944419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e81f3db0 msgr2=0x7f96e81366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96e6ffd640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e81f3db0 0x7f96e81366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96e6ffd640 1 -- 172.21.15.63:0/2372944419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96e815ac30 msgr2=0x7f96e815d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96e6ffd640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96e815ac30 0x7f96e815d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:57.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96e6ffd640 1 -- 172.21.15.63:0/2372944419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e815c780 con 0x7f96d40047c0 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96dffff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96e815ac30 0x7f96e815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96e6ffd640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96e815c080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96d800d720 tx=0x7f96d800dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96df7fe640 1 -- 172.21.15.63:0/2372944419 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8017070 con 0x7f96d40047c0 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96df7fe640 1 -- 172.21.15.63:0/2372944419 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d8005070 con 0x7f96d40047c0 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.958+0000 7f96df7fe640 1 -- 172.21.15.63:0/2372944419 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d8005420 con 0x7f96d40047c0 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.959+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e8070210 con 0x7f96d40047c0 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.959+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e80707d0 con 0x7f96d40047c0 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.960+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e8070990 con 0x7f96d40047c0 2023-12-04T10:44:57.964 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.961+0000 7f96df7fe640 1 -- 172.21.15.63:0/2372944419 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f96d8007030 con 0x7f96d40047c0 2023-12-04T10:44:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.962+0000 7f96df7fe640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f96c806ae40 0x7f96c806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.962+0000 7f96df7fe640 1 -- 172.21.15.63:0/2372944419 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f96d80892c0 con 0x7f96d40047c0 2023-12-04T10:44:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.962+0000 7f96dffff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f96c806ae40 0x7f96c806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:57.965 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.963+0000 7f96dffff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f96c806ae40 0x7f96c806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96d0034000 tx=0x7f96d0009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:57.969 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:57.967+0000 7f96df7fe640 1 -- 172.21.15.63:0/2372944419 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f96d8053f10 con 0x7f96d40047c0 2023-12-04T10:44:58.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.160+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f96e804e840 con 0x7f96d40047c0 2023-12-04T10:44:58.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.161+0000 7f96df7fe640 1 -- 172.21.15.63:0/2372944419 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f96d8057530 con 0x7f96d40047c0 2023-12-04T10:44:58.163 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f96c806ae40 msgr2=0x7f96c806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f96c806ae40 0x7f96c806d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f96d0034000 tx=0x7f96d0009030 comp rx=0 tx=0).stop 2023-12-04T10:44:58.166 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 msgr2=0x7f96e815c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96e815c080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f96d800d720 tx=0x7f96d800dbe0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 shutdown_connections 2023-12-04T10:44:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f96c806ae40 0x7f96c806d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f96e81f3db0 0x7f96e81366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f96e815ac30 0x7f96e815d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.163+0000 7f96e7fff640 1 --2- 172.21.15.63:0/2372944419 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f96d40047c0 0x7f96e815c080 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.164+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 >> 172.21.15.63:0/2372944419 conn(0x7f96e80b0860 msgr2=0x7f96e806c900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:58.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.164+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 shutdown_connections 2023-12-04T10:44:58.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.164+0000 7f96e7fff640 1 -- 172.21.15.63:0/2372944419 wait complete. 2023-12-04T10:44:58.198 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-04T10:44:58.199 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:44:58.427 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.425+0000 7f693de32640 1 Processor -- start 2023-12-04T10:44:58.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.426+0000 7f693de32640 1 -- start start 2023-12-04T10:44:58.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.427+0000 7f693de32640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f693815d710 0x7f69380ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.429 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.427+0000 7f693de32640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f69380d3cd0 0x7f69380b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.427+0000 7f693de32640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69380cef40 con 0x7f69380d16b0 2023-12-04T10:44:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.427+0000 7f693de32640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69380b25c0 con 0x7f693815d710 2023-12-04T10:44:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.427+0000 7f693de32640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69380b28a0 con 0x7f69380d3cd0 2023-12-04T10:44:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.427+0000 7f693ce30640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f69380d16b0 0x7f69380d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37682/0 (socket says 172.21.15.63:37682) 2023-12-04T10:44:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f693ce30640 1 -- 172.21.15.63:0/2041653685 learned_addr learned my addr 172.21.15.63:0/2041653685 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:58.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f6937fff640 1 --2- 172.21.15.63:0/2041653685 >> v2:172.21.15.63:3300/0 conn(0x7f693815d710 0x7f69380ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f693d631640 1 --2- 172.21.15.63:0/2041653685 >> v2:172.21.15.66:3300/0 conn(0x7f69380d3cd0 0x7f69380b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f69377fe640 1 -- 172.21.15.63:0/2041653685 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3841345584 0 0) 0x7f69380cef40 con 0x7f69380d16b0 2023-12-04T10:44:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f69377fe640 1 -- 172.21.15.63:0/2041653685 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6928003520 con 0x7f69380d16b0 2023-12-04T10:44:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f6937fff640 1 -- 172.21.15.63:0/2041653685 >> v2:172.21.15.66:3300/0 conn(0x7f69380d3cd0 msgr2=0x7f69380b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f6937fff640 1 --2- 172.21.15.63:0/2041653685 >> v2:172.21.15.66:3300/0 conn(0x7f69380d3cd0 0x7f69380b3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f6937fff640 1 -- 172.21.15.63:0/2041653685 >> v1:172.21.15.63:6789/0 conn(0x7f69380d16b0 legacy=0x7f69380d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.428+0000 7f6937fff640 1 -- 172.21.15.63:0/2041653685 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69380b2b80 con 0x7f693815d710 2023-12-04T10:44:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.430+0000 7f6937fff640 1 --2- 172.21.15.63:0/2041653685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f693815d710 0x7f69380ce6f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f693808b230 tx=0x7f692402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bfc8a7eb20b2d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.430+0000 7f69377fe640 1 -- 172.21.15.63:0/2041653685 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692402e070 con 0x7f693815d710 2023-12-04T10:44:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.430+0000 7f69377fe640 1 -- 172.21.15.63:0/2041653685 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69240315a0 con 0x7f693815d710 2023-12-04T10:44:58.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.430+0000 7f69377fe640 1 -- 172.21.15.63:0/2041653685 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924031930 con 0x7f693815d710 2023-12-04T10:44:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.431+0000 7f693de32640 1 -- 172.21.15.63:0/2041653685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f693815d710 msgr2=0x7f69380ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.431+0000 7f693de32640 1 --2- 172.21.15.63:0/2041653685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f693815d710 0x7f69380ce6f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f693808b230 tx=0x7f692402b840 comp rx=0 tx=0).stop 2023-12-04T10:44:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.431+0000 7f693de32640 1 -- 172.21.15.63:0/2041653685 shutdown_connections 2023-12-04T10:44:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.431+0000 7f693de32640 1 --2- 172.21.15.63:0/2041653685 >> v2:172.21.15.66:3300/0 conn(0x7f69380d3cd0 0x7f69380b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.431+0000 7f693de32640 1 --2- 172.21.15.63:0/2041653685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f693815d710 0x7f69380ce6f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.431+0000 7f693de32640 1 -- 172.21.15.63:0/2041653685 >> 172.21.15.63:0/2041653685 conn(0x7f69380d30d0 msgr2=0x7f69380d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:58.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.431+0000 7f693de32640 1 -- 172.21.15.63:0/2041653685 shutdown_connections 2023-12-04T10:44:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.431+0000 7f693de32640 1 -- 172.21.15.63:0/2041653685 wait complete. 2023-12-04T10:44:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.433+0000 7f693de32640 1 Processor -- start 2023-12-04T10:44:58.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.433+0000 7f693de32640 1 -- start start 2023-12-04T10:44:58.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f693de32640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69380d16b0 0x7f693815db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f693de32640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69380d3cd0 0x7f693815eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f693de32640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f693815d710 0x7f69381f2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f693de32640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693815f040 con 0x7f69380d3cd0 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f693de32640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f693815f2b0 con 0x7f693815d710 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f693de32640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f693815f590 con 0x7f69380d16b0 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f6937fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69380d3cd0 0x7f693815eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f6937fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69380d3cd0 0x7f693815eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47796/0 (socket says 172.21.15.63:47796) 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f6937fff640 1 -- 172.21.15.63:0/4195949481 learned_addr learned my addr 172.21.15.63:0/4195949481 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f693d631640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f693815d710 0x7f69381f2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f693ce30640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69380d16b0 0x7f693815db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f6937fff640 1 -- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69380d16b0 msgr2=0x7f693815db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f6937fff640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69380d16b0 0x7f693815db20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.434+0000 7f6937fff640 1 -- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f693815d710 msgr2=0x7f69381f2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.437 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f6937fff640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f693815d710 0x7f69381f2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f6937fff640 1 -- 172.21.15.63:0/4195949481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6924009400 con 0x7f69380d3cd0 2023-12-04T10:44:58.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f693d631640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f693815d710 0x7f69381f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:58.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f6937fff640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69380d3cd0 0x7f693815eb00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6924009890 tx=0x7f69240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:58.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f69357fa640 1 -- 172.21.15.63:0/4195949481 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924032840 con 0x7f69380d3cd0 2023-12-04T10:44:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f69357fa640 1 -- 172.21.15.63:0/4195949481 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6924031f00 con 0x7f69380d3cd0 2023-12-04T10:44:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f69357fa640 1 -- 172.21.15.63:0/4195949481 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6924032be0 con 0x7f69380d3cd0 2023-12-04T10:44:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693815f870 con 0x7f69380d3cd0 2023-12-04T10:44:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.435+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693815fe30 con 0x7f69380d3cd0 2023-12-04T10:44:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.437+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6938160020 con 0x7f69380d3cd0 2023-12-04T10:44:58.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.437+0000 7f69357fa640 1 -- 172.21.15.63:0/4195949481 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6924032d40 con 0x7f69380d3cd0 2023-12-04T10:44:58.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.439+0000 7f69357fa640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f691c06ae40 0x7f691c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.439+0000 7f69357fa640 1 -- 172.21.15.63:0/4195949481 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f69240ab8e0 con 0x7f69380d3cd0 2023-12-04T10:44:58.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.439+0000 7f693ce30640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f691c06ae40 0x7f691c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.440+0000 7f693ce30640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f691c06ae40 0x7f691c06d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f692c0011e0 tx=0x7f692c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:58.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.443+0000 7f69357fa640 1 -- 172.21.15.63:0/4195949481 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f69240765b0 con 0x7f69380d3cd0 2023-12-04T10:44:58.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.639+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f693804e840 con 0x7f69380d3cd0 2023-12-04T10:44:58.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.642+0000 7f69357fa640 1 -- 172.21.15.63:0/4195949481 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f6924079bd0 con 0x7f69380d3cd0 2023-12-04T10:44:58.644 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:44:58.645 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:44:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f691c06ae40 msgr2=0x7f691c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f691c06ae40 0x7f691c06d300 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f692c0011e0 tx=0x7f692c009040 comp rx=0 tx=0).stop 2023-12-04T10:44:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69380d3cd0 msgr2=0x7f693815eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69380d3cd0 0x7f693815eb00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f6924009890 tx=0x7f69240046c0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 shutdown_connections 2023-12-04T10:44:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f691c06ae40 0x7f691c06d300 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f693815d710 0x7f69381f2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f69380d3cd0 0x7f693815eb00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.644+0000 7f693de32640 1 --2- 172.21.15.63:0/4195949481 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f69380d16b0 0x7f693815db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.645+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 >> 172.21.15.63:0/4195949481 conn(0x7f69380d30d0 msgr2=0x7f693806c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.645+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 shutdown_connections 2023-12-04T10:44:58.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.645+0000 7f693de32640 1 -- 172.21.15.63:0/4195949481 wait complete. 2023-12-04T10:44:58.664 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:44:58.665 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:44:58.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.888+0000 7fdadbfff640 1 Processor -- start 2023-12-04T10:44:58.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.888+0000 7fdadbfff640 1 -- start start 2023-12-04T10:44:58.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadbfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdadc15d0c0 0x7fdadc0b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadbfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdadc070c30 0x7fdadc0acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadbfff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdadc0ac890 con 0x7fdadc070090 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadbfff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc0b2b60 con 0x7fdadc070c30 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadbfff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdadc0b2e40 con 0x7fdadc15d0c0 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadb7fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdadc070c30 0x7fdadc0acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadb7fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdadc070c30 0x7fdadc0acd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47806/0 (socket says 172.21.15.63:47806) 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadb7fe640 1 -- 172.21.15.63:0/1014863569 learned_addr learned my addr 172.21.15.63:0/1014863569 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.890+0000 7fdadaffd640 1 --2- 172.21.15.63:0/1014863569 >> v2:172.21.15.66:3300/0 conn(0x7fdadc15d0c0 0x7fdadc0b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.891+0000 7fdadb7fe640 1 -- 172.21.15.63:0/1014863569 >> v2:172.21.15.66:3300/0 conn(0x7fdadc15d0c0 msgr2=0x7fdadc0b36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.891+0000 7fdadb7fe640 1 --2- 172.21.15.63:0/1014863569 >> v2:172.21.15.66:3300/0 conn(0x7fdadc15d0c0 0x7fdadc0b36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.891+0000 7fdadb7fe640 1 -- 172.21.15.63:0/1014863569 >> v1:172.21.15.66:6789/0 conn(0x7fdadc070090 legacy=0x7fdadc070520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:58.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.891+0000 7fdadb7fe640 1 -- 172.21.15.63:0/1014863569 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdadc0b3120 con 0x7fdadc070c30 2023-12-04T10:44:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.892+0000 7fdadb7fe640 1 --2- 172.21.15.63:0/1014863569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc070c30 0x7fdadc0acd20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdadc161e60 tx=0x7fdad402b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4c0264dd3286744 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.892+0000 7fdad9ffb640 1 -- 172.21.15.63:0/1014863569 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4031890 con 0x7fdadc070c30 2023-12-04T10:44:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.892+0000 7fdad9ffb640 1 -- 172.21.15.63:0/1014863569 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40319f0 con 0x7fdadc070c30 2023-12-04T10:44:58.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.892+0000 7fdad9ffb640 1 -- 172.21.15.63:0/1014863569 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad4031d80 con 0x7fdadc070c30 2023-12-04T10:44:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.893+0000 7fdadbfff640 1 -- 172.21.15.63:0/1014863569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc070c30 msgr2=0x7fdadc0acd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.893+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1014863569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc070c30 0x7fdadc0acd20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdadc161e60 tx=0x7fdad402b930 comp rx=0 tx=0).stop 2023-12-04T10:44:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.893+0000 7fdadbfff640 1 -- 172.21.15.63:0/1014863569 shutdown_connections 2023-12-04T10:44:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.893+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1014863569 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc070c30 0x7fdadc0acd20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.893+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1014863569 >> v2:172.21.15.66:3300/0 conn(0x7fdadc15d0c0 0x7fdadc0b36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.893+0000 7fdadbfff640 1 -- 172.21.15.63:0/1014863569 >> 172.21.15.63:0/1014863569 conn(0x7fdadc0b0860 msgr2=0x7fdadc0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.893+0000 7fdadbfff640 1 -- 172.21.15.63:0/1014863569 shutdown_connections 2023-12-04T10:44:58.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.893+0000 7fdadbfff640 1 -- 172.21.15.63:0/1014863569 wait complete. 2023-12-04T10:44:58.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.895+0000 7fdadbfff640 1 Processor -- start 2023-12-04T10:44:58.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.895+0000 7fdadbfff640 1 -- start start 2023-12-04T10:44:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc070090 0x7fdadc15b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc070c30 0x7fdadc143220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc15d0c0 0x7fdadc143760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadbfff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc1e75e0 con 0x7fdadc15d0c0 2023-12-04T10:44:58.899 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadbfff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc143ca0 con 0x7fdadc070c30 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadbfff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdadc157400 con 0x7fdadc070090 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc15d0c0 0x7fdadc143760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc15d0c0 0x7fdadc143760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47808/0 (socket says 172.21.15.63:47808) 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.896+0000 7fdadb7fe640 1 -- 172.21.15.63:0/1457522942 learned_addr learned my addr 172.21.15.63:0/1457522942 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadaffd640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc070090 0x7fdadc15b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdada7fc640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc070c30 0x7fdadc143220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadb7fe640 1 -- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc070090 msgr2=0x7fdadc15b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadb7fe640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc070090 0x7fdadc15b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadb7fe640 1 -- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc070c30 msgr2=0x7fdadc143220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadb7fe640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc070c30 0x7fdadc143220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadb7fe640 1 -- 172.21.15.63:0/1457522942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40094d0 con 0x7fdadc15d0c0 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadaffd640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc070090 0x7fdadc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdada7fc640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc070c30 0x7fdadc143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadb7fe640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc15d0c0 0x7fdadc143760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009960 tx=0x7fdad40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdad3fff640 1 -- 172.21.15.63:0/1457522942 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad403ad20 con 0x7fdadc15d0c0 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdad3fff640 1 -- 172.21.15.63:0/1457522942 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad40443f0 con 0x7fdadc15d0c0 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.897+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdadc1e6c80 con 0x7fdadc15d0c0 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.898+0000 7fdad3fff640 1 -- 172.21.15.63:0/1457522942 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad403aea0 con 0x7fdadc15d0c0 2023-12-04T10:44:58.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.898+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdadc1e7200 con 0x7fdadc15d0c0 2023-12-04T10:44:58.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.899+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdadc1e7720 con 0x7fdadc15d0c0 2023-12-04T10:44:58.902 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.900+0000 7fdad3fff640 1 -- 172.21.15.63:0/1457522942 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdad40447a0 con 0x7fdadc15d0c0 2023-12-04T10:44:58.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.901+0000 7fdad3fff640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdabc06ae40 0x7fdabc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:58.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.901+0000 7fdad3fff640 1 -- 172.21.15.63:0/1457522942 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdad40ac0d0 con 0x7fdadc15d0c0 2023-12-04T10:44:58.903 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.902+0000 7fdadaffd640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdabc06ae40 0x7fdabc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:58.904 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.902+0000 7fdadaffd640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdabc06ae40 0x7fdabc06d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009f50 tx=0x7fdacc00b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:58.908 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:58.906+0000 7fdad3fff640 1 -- 172.21.15.63:0/1457522942 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdad4076ed0 con 0x7fdadc15d0c0 2023-12-04T10:44:59.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.090+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdadc04e840 con 0x7fdadc15d0c0 2023-12-04T10:44:59.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.090+0000 7fdad3fff640 1 -- 172.21.15.63:0/1457522942 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdad40350a0 con 0x7fdadc15d0c0 2023-12-04T10:44:59.092 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.092+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdabc06ae40 msgr2=0x7fdabc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.092+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdabc06ae40 0x7fdabc06d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fdacc009f50 tx=0x7fdacc00b040 comp rx=0 tx=0).stop 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.092+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc15d0c0 msgr2=0x7fdadc143760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.092+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc15d0c0 0x7fdadc143760 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdad4009960 tx=0x7fdad40046c0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.093+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 shutdown_connections 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.093+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdabc06ae40 0x7fdabc06d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.093+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdadc15d0c0 0x7fdadc143760 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.093+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdadc070c30 0x7fdadc143220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.093+0000 7fdadbfff640 1 --2- 172.21.15.63:0/1457522942 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdadc070090 0x7fdadc15b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.093+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 >> 172.21.15.63:0/1457522942 conn(0x7fdadc0b0860 msgr2=0x7fdadc0b1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:59.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.093+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 shutdown_connections 2023-12-04T10:44:59.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.093+0000 7fdadbfff640 1 -- 172.21.15.63:0/1457522942 wait complete. 2023-12-04T10:44:59.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:44:59.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.339+0000 7fb912a71640 1 Processor -- start 2023-12-04T10:44:59.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.339+0000 7fb912a71640 1 -- start start 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.341+0000 7fb912a71640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb90c144370 0x7fb90c06be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.341+0000 7fb912a71640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c06c760 con 0x7fb90c143ca0 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.341+0000 7fb912a71640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb90c0cb800 con 0x7fb90c06c350 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.341+0000 7fb912a71640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb90c0cbae0 con 0x7fb90c144370 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.341+0000 7fb911a6f640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fb90c143ca0 0x7fb90c0b2e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37688/0 (socket says 172.21.15.63:37688) 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.341+0000 7fb911a6f640 1 -- 172.21.15.63:0/3967686475 learned_addr learned my addr 172.21.15.63:0/3967686475 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.341+0000 7fb91126e640 1 --2- 172.21.15.63:0/3967686475 >> v2:172.21.15.63:3300/0 conn(0x7fb90c144370 0x7fb90c06be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120772916 0 0) 0x7fb90c06c760 con 0x7fb90c143ca0 2023-12-04T10:44:59.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8f8003520 con 0x7fb90c143ca0 2023-12-04T10:44:59.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4122380051 0 0) 0x7fb8f8003520 con 0x7fb90c143ca0 2023-12-04T10:44:59.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 >> v2:172.21.15.63:3300/0 conn(0x7fb90c144370 msgr2=0x7fb90c06be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:59.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb910a6d640 1 --2- 172.21.15.63:0/3967686475 >> v2:172.21.15.63:3300/0 conn(0x7fb90c144370 0x7fb90c06be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 >> v1:172.21.15.66:6789/0 conn(0x7fb90c06c350 legacy=0x7fb90c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0cbdc0 con 0x7fb90c143ca0 2023-12-04T10:44:59.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fb908001670 con 0x7fb90c143ca0 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.342+0000 7fb91126e640 1 --2- 172.21.15.63:0/3967686475 >> v2:172.21.15.63:3300/0 conn(0x7fb90c144370 0x7fb90c06be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 >> v1:172.21.15.63:6789/0 conn(0x7fb90c143ca0 legacy=0x7fb90c0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb910a6d640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8f8003970 0x7fb8f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb910a6d640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8f80047c0 0x7fb8f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb910a6d640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8005180 0x7fb8f800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0cbae0 con 0x7fb8f8003970 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f800c020 con 0x7fb8f8005180 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f800c1e0 con 0x7fb8f80047c0 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb911a6f640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8f8003970 0x7fb8f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.343+0000 7fb912270640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8005180 0x7fb8f800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.344+0000 7fb91126e640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8f80047c0 0x7fb8f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.344+0000 7fb911a6f640 1 -- 172.21.15.63:0/3967686475 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8f80047c0 msgr2=0x7fb8f8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:59.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.344+0000 7fb911a6f640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb8f80047c0 0x7fb8f8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.344+0000 7fb911a6f640 1 -- 172.21.15.63:0/3967686475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8005180 msgr2=0x7fb8f800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:59.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.344+0000 7fb911a6f640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8005180 0x7fb8f800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.344+0000 7fb912270640 1 -- 172.21.15.63:0/3967686475 reap_dead start 2023-12-04T10:44:59.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.344+0000 7fb911a6f640 1 -- 172.21.15.63:0/3967686475 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f8003520 con 0x7fb8f8003970 2023-12-04T10:44:59.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.345+0000 7fb911a6f640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8f8003970 0x7fb8f8003d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c240 tx=0x7fb8f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec3d67afb5d28bb0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:59.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.345+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb908005ad0 con 0x7fb8f8003970 2023-12-04T10:44:59.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.345+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb908005c30 con 0x7fb8f8003970 2023-12-04T10:44:59.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.346+0000 7fb910a6d640 1 -- 172.21.15.63:0/3967686475 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb90802c8b0 con 0x7fb8f8003970 2023-12-04T10:44:59.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.346+0000 7fb912a71640 1 -- 172.21.15.63:0/3967686475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8f8003970 msgr2=0x7fb8f8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.346+0000 7fb912a71640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8f8003970 0x7fb8f8003d90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fb90800c240 tx=0x7fb8f80057f0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.346+0000 7fb912a71640 1 -- 172.21.15.63:0/3967686475 shutdown_connections 2023-12-04T10:44:59.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.346+0000 7fb912a71640 1 --2- 172.21.15.63:0/3967686475 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb8f8003970 0x7fb8f8003d90 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.346+0000 7fb912a71640 1 -- 172.21.15.63:0/3967686475 >> 172.21.15.63:0/3967686475 conn(0x7fb90c0b0860 msgr2=0x7fb90c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:59.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.346+0000 7fb912a71640 1 -- 172.21.15.63:0/3967686475 shutdown_connections 2023-12-04T10:44:59.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.346+0000 7fb912a71640 1 -- 172.21.15.63:0/3967686475 wait complete. 2023-12-04T10:44:59.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.348+0000 7fb912a71640 1 Processor -- start 2023-12-04T10:44:59.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.348+0000 7fb912a71640 1 -- start start 2023-12-04T10:44:59.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.349+0000 7fb912a71640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8003970 0x7fb90c0afbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.349+0000 7fb912a71640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb90c0c9a40 0x7fb90c0c7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.349+0000 7fb912a71640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb90c0c8420 0x7fb90c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.349+0000 7fb912a71640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0b00f0 con 0x7fb90c0c9a40 2023-12-04T10:44:59.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.349+0000 7fb912a71640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0c89a0 con 0x7fb8f8003970 2023-12-04T10:44:59.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.349+0000 7fb912a71640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb90c0c8c80 con 0x7fb90c0c8420 2023-12-04T10:44:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb90c0c9a40 0x7fb90c0c7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb90c0c9a40 0x7fb90c0c7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47826/0 (socket says 172.21.15.63:47826) 2023-12-04T10:44:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 -- 172.21.15.63:0/2194757062 learned_addr learned my addr 172.21.15.63:0/2194757062 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb911a6f640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8003970 0x7fb90c0afbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 -- 172.21.15.63:0/2194757062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb90c0c8420 msgr2=0x7fb90c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb90c0c8420 0x7fb90c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 -- 172.21.15.63:0/2194757062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8003970 msgr2=0x7fb90c0afbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8003970 0x7fb90c0afbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 -- 172.21.15.63:0/2194757062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb90c0c8f60 con 0x7fb90c0c9a40 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.350+0000 7fb91126e640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb90c0c9a40 0x7fb90c0c7ee0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc011800 tx=0x7fb8fc011cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.351+0000 7fb9027fc640 1 -- 172.21.15.63:0/2194757062 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00f9c0 con 0x7fb90c0c9a40 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.351+0000 7fb9027fc640 1 -- 172.21.15.63:0/2194757062 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8fc00fb20 con 0x7fb90c0c9a40 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.351+0000 7fb9027fc640 1 -- 172.21.15.63:0/2194757062 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8fc00feb0 con 0x7fb90c0c9a40 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.351+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb90c0c9240 con 0x7fb90c0c9a40 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.351+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb90c071f70 con 0x7fb90c0c9a40 2023-12-04T10:44:59.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.352+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90c04e840 con 0x7fb90c0c9a40 2023-12-04T10:44:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.353+0000 7fb9027fc640 1 -- 172.21.15.63:0/2194757062 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8fc015460 con 0x7fb90c0c9a40 2023-12-04T10:44:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.354+0000 7fb9027fc640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb8f006ae70 0x7fb8f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.354+0000 7fb9027fc640 1 -- 172.21.15.63:0/2194757062 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb8fc08a2c0 con 0x7fb90c0c9a40 2023-12-04T10:44:59.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.354+0000 7fb911a6f640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb8f006ae70 0x7fb8f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.355+0000 7fb911a6f640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb8f006ae70 0x7fb8f006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb908034000 tx=0x7fb908009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:59.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.359+0000 7fb9027fc640 1 -- 172.21.15.63:0/2194757062 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8fc054f10 con 0x7fb90c0c9a40 2023-12-04T10:44:59.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.552+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb90c06db90 con 0x7fb90c0c9a40 2023-12-04T10:44:59.555 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.553+0000 7fb9027fc640 1 -- 172.21.15.63:0/2194757062 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8fc058530 con 0x7fb90c0c9a40 2023-12-04T10:44:59.555 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:44:59.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb8f006ae70 msgr2=0x7fb8f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb8f006ae70 0x7fb8f006d330 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fb908034000 tx=0x7fb908009030 comp rx=0 tx=0).stop 2023-12-04T10:44:59.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb90c0c9a40 msgr2=0x7fb90c0c7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb90c0c9a40 0x7fb90c0c7ee0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb8fc011800 tx=0x7fb8fc011cc0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 shutdown_connections 2023-12-04T10:44:59.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb8f006ae70 0x7fb8f006d330 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb90c0c8420 0x7fb90c070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb90c0c9a40 0x7fb90c0c7ee0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 --2- 172.21.15.63:0/2194757062 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb8f8003970 0x7fb90c0afbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 >> 172.21.15.63:0/2194757062 conn(0x7fb90c0b0860 msgr2=0x7fb90c06d000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:59.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 shutdown_connections 2023-12-04T10:44:59.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.556+0000 7fb912a71640 1 -- 172.21.15.63:0/2194757062 wait complete. 2023-12-04T10:44:59.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:44:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.806+0000 7f3944e78640 1 Processor -- start 2023-12-04T10:44:59.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.806+0000 7f3944e78640 1 -- start start 2023-12-04T10:44:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.808+0000 7f3944e78640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 0x7f39400b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.808+0000 7f3944e78640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f39400b3350 0x7f394006be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.808+0000 7f3944e78640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39400cb800 con 0x7f3940144370 2023-12-04T10:44:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.808+0000 7f3944e78640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39400cbae0 con 0x7f39400b3350 2023-12-04T10:44:59.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.808+0000 7f3944e78640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39400cbdc0 con 0x7f3940143ca0 2023-12-04T10:44:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.809+0000 7f393effd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f39400b3350 0x7f394006be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.809+0000 7f393effd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f39400b3350 0x7f394006be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:56808/0 (socket says 172.21.15.63:56808) 2023-12-04T10:44:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.809+0000 7f393effd640 1 -- 172.21.15.63:0/3850577164 learned_addr learned my addr 172.21.15.63:0/3850577164 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:59.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.809+0000 7f393f7fe640 1 --2- 172.21.15.63:0/3850577164 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 0x7f39400b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.810+0000 7f393effd640 1 -- 172.21.15.63:0/3850577164 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 msgr2=0x7f39400b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:44:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.810+0000 7f393effd640 1 --2- 172.21.15.63:0/3850577164 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 0x7f39400b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.810+0000 7f393effd640 1 -- 172.21.15.63:0/3850577164 >> v1:172.21.15.66:6789/0 conn(0x7f3940144370 legacy=0x7f394015ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.810+0000 7f393effd640 1 -- 172.21.15.63:0/3850577164 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39400b2610 con 0x7f39400b3350 2023-12-04T10:44:59.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.811+0000 7f393effd640 1 --2- 172.21.15.63:0/3850577164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 0x7f394006be10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3934009850 tx=0x7f393402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=643c97697b00700f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:59.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.812+0000 7f393e7fc640 1 -- 172.21.15.63:0/3850577164 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934004230 con 0x7f39400b3350 2023-12-04T10:44:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.812+0000 7f393e7fc640 1 -- 172.21.15.63:0/3850577164 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3934004390 con 0x7f39400b3350 2023-12-04T10:44:59.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.812+0000 7f393e7fc640 1 -- 172.21.15.63:0/3850577164 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3934003810 con 0x7f39400b3350 2023-12-04T10:44:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.812+0000 7f3944e78640 1 -- 172.21.15.63:0/3850577164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 msgr2=0x7f394006be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.812+0000 7f3944e78640 1 --2- 172.21.15.63:0/3850577164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 0x7f394006be10 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3934009850 tx=0x7f393402b960 comp rx=0 tx=0).stop 2023-12-04T10:44:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.812+0000 7f3944e78640 1 -- 172.21.15.63:0/3850577164 shutdown_connections 2023-12-04T10:44:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.813+0000 7f3944e78640 1 --2- 172.21.15.63:0/3850577164 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 0x7f394006be10 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.813+0000 7f3944e78640 1 --2- 172.21.15.63:0/3850577164 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 0x7f39400b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.813+0000 7f3944e78640 1 -- 172.21.15.63:0/3850577164 >> 172.21.15.63:0/3850577164 conn(0x7f39400b0860 msgr2=0x7f39400b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:44:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.813+0000 7f3944e78640 1 -- 172.21.15.63:0/3850577164 shutdown_connections 2023-12-04T10:44:59.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.813+0000 7f3944e78640 1 -- 172.21.15.63:0/3850577164 wait complete. 2023-12-04T10:44:59.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.814+0000 7f3944e78640 1 Processor -- start 2023-12-04T10:44:59.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.815+0000 7f3944e78640 1 -- start start 2023-12-04T10:44:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.815+0000 7f3944e78640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 0x7f39401589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.815+0000 7f3944e78640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 0x7f394013e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.815+0000 7f3944e78640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3940144370 0x7f394013e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.815+0000 7f3944e78640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3940158f30 con 0x7f3940144370 2023-12-04T10:44:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f3944e78640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39401f2a70 con 0x7f39400b3350 2023-12-04T10:44:59.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f3944e78640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f394013ee20 con 0x7f3940143ca0 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3940144370 0x7f394013e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3940144370 0x7f394013e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47840/0 (socket says 172.21.15.63:47840) 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393ffff640 1 -- 172.21.15.63:0/659229097 learned_addr learned my addr 172.21.15.63:0/659229097 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393effd640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 0x7f394013e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393f7fe640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 0x7f39401589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393ffff640 1 -- 172.21.15.63:0/659229097 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 msgr2=0x7f394013e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393ffff640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 0x7f394013e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393ffff640 1 -- 172.21.15.63:0/659229097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 msgr2=0x7f39401589f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393ffff640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 0x7f39401589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:44:59.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.816+0000 7f393ffff640 1 -- 172.21.15.63:0/659229097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3934009460 con 0x7f3940144370 2023-12-04T10:44:59.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.817+0000 7f393ffff640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3940144370 0x7f394013e830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f393800c390 tx=0x7f393800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:59.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.817+0000 7f3927fff640 1 -- 172.21.15.63:0/659229097 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39380052d0 con 0x7f3940144370 2023-12-04T10:44:59.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.817+0000 7f3927fff640 1 -- 172.21.15.63:0/659229097 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3938005430 con 0x7f3940144370 2023-12-04T10:44:59.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.817+0000 7f3927fff640 1 -- 172.21.15.63:0/659229097 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3938003810 con 0x7f3940144370 2023-12-04T10:44:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.817+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39401f2d20 con 0x7f3940144370 2023-12-04T10:44:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.817+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39401f32e0 con 0x7f3940144370 2023-12-04T10:44:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.818+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39401f34d0 con 0x7f3940144370 2023-12-04T10:44:59.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.819+0000 7f3927fff640 1 -- 172.21.15.63:0/659229097 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3938003970 con 0x7f3940144370 2023-12-04T10:44:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.820+0000 7f3927fff640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f392c06ae40 0x7f392c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:44:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.820+0000 7f3927fff640 1 -- 172.21.15.63:0/659229097 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3938088fe0 con 0x7f3940144370 2023-12-04T10:44:59.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.820+0000 7f393f7fe640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f392c06ae40 0x7f392c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:44:59.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.821+0000 7f393f7fe640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f392c06ae40 0x7f392c06d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f39400ae4d0 tx=0x7f393000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:44:59.827 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:44:59.825+0000 7f3927fff640 1 -- 172.21.15.63:0/659229097 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3938053bd0 con 0x7f3940144370 2023-12-04T10:45:00.021 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.019+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f394004e840 con 0x7f3940144370 2023-12-04T10:45:00.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.020+0000 7f3927fff640 1 -- 172.21.15.63:0/659229097 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f39380571f0 con 0x7f3940144370 2023-12-04T10:45:00.022 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:45:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f392c06ae40 msgr2=0x7f392c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f392c06ae40 0x7f392c06d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f39400ae4d0 tx=0x7f393000b040 comp rx=0 tx=0).stop 2023-12-04T10:45:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3940144370 msgr2=0x7f394013e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3940144370 0x7f394013e830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f393800c390 tx=0x7f393800c850 comp rx=0 tx=0).stop 2023-12-04T10:45:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 shutdown_connections 2023-12-04T10:45:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f392c06ae40 0x7f392c06d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3940143ca0 0x7f394013e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.025 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3940144370 0x7f394013e830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 --2- 172.21.15.63:0/659229097 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f39400b3350 0x7f39401589f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 >> 172.21.15.63:0/659229097 conn(0x7f39400b0860 msgr2=0x7f39400cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 shutdown_connections 2023-12-04T10:45:00.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.023+0000 7f3944e78640 1 -- 172.21.15.63:0/659229097 wait complete. 2023-12-04T10:45:00.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:45:00.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.269+0000 7f044df8f640 1 Processor -- start 2023-12-04T10:45:00.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.270+0000 7f044df8f640 1 -- start start 2023-12-04T10:45:00.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.271+0000 7f044df8f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0448144370 0x7f044806be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.271+0000 7f044df8f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f044806c350 0x7f04480cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.271+0000 7f044df8f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04480cb800 con 0x7f0448143ca0 2023-12-04T10:45:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.271+0000 7f044df8f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f044806c7e0 con 0x7f044806c350 2023-12-04T10:45:00.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.271+0000 7f044df8f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04480cbae0 con 0x7f0448144370 2023-12-04T10:45:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.272+0000 7f044d78e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f044806c350 0x7f04480cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.272+0000 7f0447fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0448144370 0x7f044806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.272+0000 7f044d78e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f044806c350 0x7f04480cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:56830/0 (socket says 172.21.15.63:56830) 2023-12-04T10:45:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.272+0000 7f044d78e640 1 -- 172.21.15.63:0/2322385359 learned_addr learned my addr 172.21.15.63:0/2322385359 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.273+0000 7f044d78e640 1 -- 172.21.15.63:0/2322385359 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0448144370 msgr2=0x7f044806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.273+0000 7f044d78e640 1 --2- 172.21.15.63:0/2322385359 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0448144370 0x7f044806be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.273+0000 7f044d78e640 1 -- 172.21.15.63:0/2322385359 >> v1:172.21.15.66:6789/0 conn(0x7f0448143ca0 legacy=0x7f04480b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.273+0000 7f044d78e640 1 -- 172.21.15.63:0/2322385359 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04480cbdc0 con 0x7f044806c350 2023-12-04T10:45:00.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.274+0000 7f044d78e640 1 --2- 172.21.15.63:0/2322385359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f044806c350 0x7f04480cd370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0440009e50 tx=0x7f044002bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7de220a99a163883 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:00.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.275+0000 7f04477fe640 1 -- 172.21.15.63:0/2322385359 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044002cb00 con 0x7f044806c350 2023-12-04T10:45:00.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.275+0000 7f04477fe640 1 -- 172.21.15.63:0/2322385359 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044002cc60 con 0x7f044806c350 2023-12-04T10:45:00.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.275+0000 7f04477fe640 1 -- 172.21.15.63:0/2322385359 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04400343f0 con 0x7f044806c350 2023-12-04T10:45:00.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.276+0000 7f044df8f640 1 -- 172.21.15.63:0/2322385359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f044806c350 msgr2=0x7f04480cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.276+0000 7f044df8f640 1 --2- 172.21.15.63:0/2322385359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f044806c350 0x7f04480cd370 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0440009e50 tx=0x7f044002bf60 comp rx=0 tx=0).stop 2023-12-04T10:45:00.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.276+0000 7f044df8f640 1 -- 172.21.15.63:0/2322385359 shutdown_connections 2023-12-04T10:45:00.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.276+0000 7f044df8f640 1 --2- 172.21.15.63:0/2322385359 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f044806c350 0x7f04480cd370 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.276+0000 7f044df8f640 1 --2- 172.21.15.63:0/2322385359 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0448144370 0x7f044806be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.276+0000 7f044df8f640 1 -- 172.21.15.63:0/2322385359 >> 172.21.15.63:0/2322385359 conn(0x7f04480b0860 msgr2=0x7f04480b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:00.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.276+0000 7f044df8f640 1 -- 172.21.15.63:0/2322385359 shutdown_connections 2023-12-04T10:45:00.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.276+0000 7f044df8f640 1 -- 172.21.15.63:0/2322385359 wait complete. 2023-12-04T10:45:00.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.278+0000 7f044df8f640 1 Processor -- start 2023-12-04T10:45:00.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.279+0000 7f044df8f640 1 -- start start 2023-12-04T10:45:00.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044df8f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044806c350 0x7f044814fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044df8f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0448143ca0 0x7f04481e5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044df8f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448144370 0x7f04481e56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044df8f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448070c50 con 0x7f0448144370 2023-12-04T10:45:00.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044df8f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0448070390 con 0x7f0448143ca0 2023-12-04T10:45:00.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044df8f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04481501e0 con 0x7f044806c350 2023-12-04T10:45:00.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044d78e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448144370 0x7f04481e56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044d78e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448144370 0x7f04481e56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47856/0 (socket says 172.21.15.63:47856) 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.280+0000 7f044d78e640 1 -- 172.21.15.63:0/293269747 learned_addr learned my addr 172.21.15.63:0/293269747 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.281+0000 7f0447fff640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0448143ca0 0x7f04481e5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.281+0000 7f044cf8d640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044806c350 0x7f044814fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.281+0000 7f044d78e640 1 -- 172.21.15.63:0/293269747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044806c350 msgr2=0x7f044814fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.281+0000 7f044d78e640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044806c350 0x7f044814fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.281+0000 7f044d78e640 1 -- 172.21.15.63:0/293269747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0448143ca0 msgr2=0x7f04481e5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.281+0000 7f044d78e640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0448143ca0 0x7f04481e5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.281+0000 7f044d78e640 1 -- 172.21.15.63:0/293269747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0440009b30 con 0x7f0448144370 2023-12-04T10:45:00.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.281+0000 7f044d78e640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448144370 0x7f04481e56d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0440009f70 tx=0x7f0440004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:00.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.282+0000 7f04457fa640 1 -- 172.21.15.63:0/293269747 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044003e450 con 0x7f0448144370 2023-12-04T10:45:00.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.282+0000 7f04457fa640 1 -- 172.21.15.63:0/293269747 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f044003e5b0 con 0x7f0448144370 2023-12-04T10:45:00.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.282+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0448070600 con 0x7f0448144370 2023-12-04T10:45:00.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.282+0000 7f04457fa640 1 -- 172.21.15.63:0/293269747 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044003e960 con 0x7f0448144370 2023-12-04T10:45:00.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.282+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044813c1d0 con 0x7f0448144370 2023-12-04T10:45:00.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.283+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0448070e00 con 0x7f0448144370 2023-12-04T10:45:00.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.284+0000 7f04457fa640 1 -- 172.21.15.63:0/293269747 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f044003eac0 con 0x7f0448144370 2023-12-04T10:45:00.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.286+0000 7f04457fa640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f042c06ae40 0x7f042c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.286+0000 7f04457fa640 1 -- 172.21.15.63:0/293269747 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f04400ac570 con 0x7f0448144370 2023-12-04T10:45:00.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.286+0000 7f044cf8d640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f042c06ae40 0x7f042c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.287+0000 7f044cf8d640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f042c06ae40 0x7f042c06d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f043c007fd0 tx=0x7f043c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:00.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.290+0000 7f04457fa640 1 -- 172.21.15.63:0/293269747 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0448070e00 con 0x7f0448144370 2023-12-04T10:45:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.482+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f0448070e00 con 0x7f0448144370 2023-12-04T10:45:00.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.483+0000 7f04457fa640 1 -- 172.21.15.63:0/293269747 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f0448070e00 con 0x7f0448144370 2023-12-04T10:45:00.485 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:00.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f042c06ae40 msgr2=0x7f042c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f042c06ae40 0x7f042c06d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f043c007fd0 tx=0x7f043c009040 comp rx=0 tx=0).stop 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448144370 msgr2=0x7f04481e56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448144370 0x7f04481e56d0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0440009f70 tx=0x7f0440004a40 comp rx=0 tx=0).stop 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 shutdown_connections 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f042c06ae40 0x7f042c06d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0448144370 0x7f04481e56d0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0448143ca0 0x7f04481e5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 --2- 172.21.15.63:0/293269747 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f044806c350 0x7f044814fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.486+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 >> 172.21.15.63:0/293269747 conn(0x7f04480b0860 msgr2=0x7f0448141830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.487+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 shutdown_connections 2023-12-04T10:45:00.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.487+0000 7f044df8f640 1 -- 172.21.15.63:0/293269747 wait complete. 2023-12-04T10:45:00.507 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-12-04T10:45:00.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.727+0000 7fa8c333c640 1 Processor -- start 2023-12-04T10:45:00.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.727+0000 7fa8c333c640 1 -- start start 2023-12-04T10:45:00.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.729+0000 7fa8c333c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8bc0ce240 0x7fa8bc0ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.729+0000 7fa8c333c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8bc0cebd0 con 0x7fa8bc071f00 2023-12-04T10:45:00.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.729+0000 7fa8c333c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8bc0ca820 con 0x7fa8bc15d500 2023-12-04T10:45:00.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.729+0000 7fa8c333c640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8bc0cbcb0 con 0x7fa8bc0ce240 2023-12-04T10:45:00.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.729+0000 7fa8c08d7640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fa8bc071f00 0x7fa8bc0cb5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37692/0 (socket says 172.21.15.63:37692) 2023-12-04T10:45:00.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.729+0000 7fa8c18d9640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa8bc0ce240 0x7fa8bc0ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.729+0000 7fa8c08d7640 1 -- 172.21.15.63:0/4238275313 learned_addr learned my addr 172.21.15.63:0/4238275313 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:00.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.730+0000 7fa8c18d9640 1 -- 172.21.15.63:0/4238275313 >> v1:172.21.15.66:6789/0 conn(0x7fa8bc15d500 legacy=0x7fa8bc06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.730+0000 7fa8c18d9640 1 -- 172.21.15.63:0/4238275313 >> v1:172.21.15.63:6789/0 conn(0x7fa8bc071f00 legacy=0x7fa8bc0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.730+0000 7fa8c18d9640 1 -- 172.21.15.63:0/4238275313 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc15d8e0 con 0x7fa8bc0ce240 2023-12-04T10:45:00.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.730+0000 7fa8b3fff640 1 -- 172.21.15.63:0/4238275313 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469292203 0 0) 0x7fa8ac001110 con 0x7fa8bc071f00 2023-12-04T10:45:00.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.731+0000 7fa8c18d9640 1 --2- 172.21.15.63:0/4238275313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc0ce240 0x7fa8bc0ce690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40097a0 tx=0x7fa8b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe7ecd7473f1bf3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:00.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.731+0000 7fa8b3fff640 1 -- 172.21.15.63:0/4238275313 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4031830 con 0x7fa8bc0ce240 2023-12-04T10:45:00.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.731+0000 7fa8b3fff640 1 -- 172.21.15.63:0/4238275313 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b4031990 con 0x7fa8bc0ce240 2023-12-04T10:45:00.733 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.731+0000 7fa8b3fff640 1 -- 172.21.15.63:0/4238275313 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b4031d20 con 0x7fa8bc0ce240 2023-12-04T10:45:00.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.732+0000 7fa8c333c640 1 -- 172.21.15.63:0/4238275313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc0ce240 msgr2=0x7fa8bc0ce690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.732+0000 7fa8c333c640 1 --2- 172.21.15.63:0/4238275313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc0ce240 0x7fa8bc0ce690 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40097a0 tx=0x7fa8b402b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.732+0000 7fa8c333c640 1 -- 172.21.15.63:0/4238275313 shutdown_connections 2023-12-04T10:45:00.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.732+0000 7fa8c333c640 1 --2- 172.21.15.63:0/4238275313 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc0ce240 0x7fa8bc0ce690 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.732+0000 7fa8c333c640 1 -- 172.21.15.63:0/4238275313 >> 172.21.15.63:0/4238275313 conn(0x7fa8bc0b1bb0 msgr2=0x7fa8bc0b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:00.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.732+0000 7fa8c333c640 1 -- 172.21.15.63:0/4238275313 shutdown_connections 2023-12-04T10:45:00.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.732+0000 7fa8c333c640 1 -- 172.21.15.63:0/4238275313 wait complete. 2023-12-04T10:45:00.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.734+0000 7fa8c333c640 1 Processor -- start 2023-12-04T10:45:00.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.734+0000 7fa8c333c640 1 -- start start 2023-12-04T10:45:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c333c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8bc071f00 0x7fa8bc0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c333c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8bc0ce240 0x7fa8bc0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c333c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc15d500 0x7fa8bc1f2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c333c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0c8f10 con 0x7fa8bc15d500 2023-12-04T10:45:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c333c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0c8300 con 0x7fa8bc071f00 2023-12-04T10:45:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c333c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8bc0c85e0 con 0x7fa8bc0ce240 2023-12-04T10:45:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c18d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc15d500 0x7fa8bc1f2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.737 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c18d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc15d500 0x7fa8bc1f2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47870/0 (socket says 172.21.15.63:47870) 2023-12-04T10:45:00.738 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.735+0000 7fa8c18d9640 1 -- 172.21.15.63:0/207319072 learned_addr learned my addr 172.21.15.63:0/207319072 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c10d8640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8bc071f00 0x7fa8bc0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c08d7640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8bc0ce240 0x7fa8bc0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c18d9640 1 -- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8bc0ce240 msgr2=0x7fa8bc0c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c18d9640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8bc0ce240 0x7fa8bc0c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c18d9640 1 -- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8bc071f00 msgr2=0x7fa8bc0c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c18d9640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8bc071f00 0x7fa8bc0c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c18d9640 1 -- 172.21.15.63:0/207319072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b4009400 con 0x7fa8bc15d500 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c10d8640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8bc071f00 0x7fa8bc0c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:00.739 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c08d7640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8bc0ce240 0x7fa8bc0c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8c18d9640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc15d500 0x7fa8bc1f2440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40098c0 tx=0x7fa8b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8b1ffb640 1 -- 172.21.15.63:0/207319072 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b403b9f0 con 0x7fa8bc15d500 2023-12-04T10:45:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.736+0000 7fa8b1ffb640 1 -- 172.21.15.63:0/207319072 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b403bb50 con 0x7fa8bc15d500 2023-12-04T10:45:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.737+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8bc0c88c0 con 0x7fa8bc15d500 2023-12-04T10:45:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.737+0000 7fa8b1ffb640 1 -- 172.21.15.63:0/207319072 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b40453f0 con 0x7fa8bc15d500 2023-12-04T10:45:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.737+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8bc0c7fa0 con 0x7fa8bc15d500 2023-12-04T10:45:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.738+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8bc0c90c0 con 0x7fa8bc15d500 2023-12-04T10:45:00.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.739+0000 7fa8b1ffb640 1 -- 172.21.15.63:0/207319072 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa8b4045550 con 0x7fa8bc15d500 2023-12-04T10:45:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.740+0000 7fa8b1ffb640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa8a006ae40 0x7fa8a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:00.741 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.740+0000 7fa8b1ffb640 1 -- 172.21.15.63:0/207319072 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa8b40abc30 con 0x7fa8bc15d500 2023-12-04T10:45:00.742 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.740+0000 7fa8c10d8640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa8a006ae40 0x7fa8a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:00.742 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.741+0000 7fa8c10d8640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa8a006ae40 0x7fa8a006d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80012e0 tx=0x7fa8b8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:00.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:00.744+0000 7fa8b1ffb640 1 -- 172.21.15.63:0/207319072 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa8bc0c90c0 con 0x7fa8bc15d500 2023-12-04T10:45:01.014 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.012+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fa8bc068710 con 0x7fa8bc15d500 2023-12-04T10:45:01.805 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.803+0000 7fa8b1ffb640 1 -- 172.21.15.63:0/207319072 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v82) v1 ==== 147+0+0 (secure 0 0 0) 0x7fa8b4035020 con 0x7fa8bc15d500 2023-12-04T10:45:01.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa8a006ae40 msgr2=0x7fa8a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:01.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa8a006ae40 0x7fa8a006d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80012e0 tx=0x7fa8b8009040 comp rx=0 tx=0).stop 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc15d500 msgr2=0x7fa8bc1f2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc15d500 0x7fa8bc1f2440 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa8b40098c0 tx=0x7fa8b40046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 shutdown_connections 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa8a006ae40 0x7fa8a006d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa8bc0ce240 0x7fa8bc0c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa8bc15d500 0x7fa8bc1f2440 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 --2- 172.21.15.63:0/207319072 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa8bc071f00 0x7fa8bc0c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 >> 172.21.15.63:0/207319072 conn(0x7fa8bc0b1bb0 msgr2=0x7fa8bc15cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 shutdown_connections 2023-12-04T10:45:01.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:01.807+0000 7fa8c333c640 1 -- 172.21.15.63:0/207319072 wait complete. 2023-12-04T10:45:01.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-04T10:45:02.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.062+0000 7feeebfff640 1 Processor -- start 2023-12-04T10:45:02.064 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.062+0000 7feeebfff640 1 -- start start 2023-12-04T10:45:02.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.064+0000 7feeebfff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7feeec15d250 0x7feeec0cc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.064+0000 7feeebfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feeec0cc8c0 0x7feeec15d630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.066 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.064+0000 7feeebfff640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeec0ccd20 con 0x7feeec15db70 2023-12-04T10:45:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.064+0000 7feeebfff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeec160e30 con 0x7feeec15d250 2023-12-04T10:45:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.064+0000 7feeebfff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec15e5e0 con 0x7feeec0cc8c0 2023-12-04T10:45:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.065+0000 7feeeb7fe640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7feeec15db70 0x7feeec070970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37700/0 (socket says 172.21.15.63:37700) 2023-12-04T10:45:02.067 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.065+0000 7feeeb7fe640 1 -- 172.21.15.63:0/3416191362 learned_addr learned my addr 172.21.15.63:0/3416191362 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.065+0000 7feeeaffd640 1 --2- 172.21.15.63:0/3416191362 >> v2:172.21.15.66:3300/0 conn(0x7feeec15d250 0x7feeec0cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.065+0000 7feeea7fc640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feeec0cc8c0 0x7feeec15d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.065+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 41584609 0 0) 0x7feeec0ccd20 con 0x7feeec15db70 2023-12-04T10:45:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.065+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed4003520 con 0x7feeec15db70 2023-12-04T10:45:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 689037425 0 0) 0x7feed4003520 con 0x7feeec15db70 2023-12-04T10:45:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feeec0cc8c0 msgr2=0x7feeec15d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feeec0cc8c0 0x7feeec15d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.069 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 >> v2:172.21.15.66:3300/0 conn(0x7feeec15d250 msgr2=0x7feeec0cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 --2- 172.21.15.63:0/3416191362 >> v2:172.21.15.66:3300/0 conn(0x7feeec15d250 0x7feeec0cc380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec161080 con 0x7feeec15db70 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7feee40019f0 con 0x7feeec15db70 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 >> v1:172.21.15.63:6789/0 conn(0x7feeec15db70 legacy=0x7feeec070970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feed4003970 0x7feed4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feed40047c0 0x7feed4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feeec0cc8c0 0x7feed4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec160e30 con 0x7feed40047c0 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec15e5e0 con 0x7feed4003970 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed400b980 con 0x7feeec0cc8c0 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.066+0000 7feeea7fc640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feed40047c0 0x7feed4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.070 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.067+0000 7feeeaffd640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feed4003970 0x7feed4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.067+0000 7feeea7fc640 1 -- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feeec0cc8c0 msgr2=0x7feed4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.067+0000 7feeeb7fe640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feeec0cc8c0 0x7feed4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.067+0000 7feeea7fc640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feeec0cc8c0 0x7feed4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.067+0000 7feeea7fc640 1 -- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feed4003970 msgr2=0x7feed4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.067+0000 7feeea7fc640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feed4003970 0x7feed4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.067+0000 7feeea7fc640 1 -- 172.21.15.63:0/3416191362 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feed4003520 con 0x7feed40047c0 2023-12-04T10:45:02.071 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.067+0000 7feeeaffd640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feed4003970 0x7feed4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:02.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.068+0000 7feeea7fc640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feed40047c0 0x7feed4004c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee0009ac0 tx=0x7feed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f5e340105d997d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:02.072 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.068+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee002c6b0 con 0x7feed40047c0 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.068+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee002c810 con 0x7feed40047c0 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.068+0000 7feee9ffb640 1 -- 172.21.15.63:0/3416191362 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee002cba0 con 0x7feed40047c0 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.069+0000 7feeebfff640 1 -- 172.21.15.63:0/3416191362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feed40047c0 msgr2=0x7feed4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.069+0000 7feeebfff640 1 --2- 172.21.15.63:0/3416191362 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feed40047c0 0x7feed4004c40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7feee0009ac0 tx=0x7feed40057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.069+0000 7feeeb7fe640 1 -- 172.21.15.63:0/3416191362 reap_dead start 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.069+0000 7feeebfff640 1 -- 172.21.15.63:0/3416191362 shutdown_connections 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.069+0000 7feeebfff640 1 -- 172.21.15.63:0/3416191362 >> 172.21.15.63:0/3416191362 conn(0x7feeec0b1570 msgr2=0x7feeec0b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.069+0000 7feeebfff640 1 -- 172.21.15.63:0/3416191362 shutdown_connections 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.069+0000 7feeebfff640 1 -- 172.21.15.63:0/3416191362 wait complete. 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.071+0000 7feeebfff640 1 Processor -- start 2023-12-04T10:45:02.073 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.071+0000 7feeebfff640 1 -- start start 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeebfff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feed40047c0 0x7feeec14f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeebfff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeec142e10 0x7feeec14dd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeec14e270 0x7feeec0ada10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeebfff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec14e7b0 con 0x7feeec14e270 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeebfff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeec14ea90 con 0x7feeec142e10 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeebfff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeec14ed70 con 0x7feed40047c0 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeeb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeec14e270 0x7feeec0ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeeb7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeec14e270 0x7feeec0ada10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47884/0 (socket says 172.21.15.63:47884) 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeeb7fe640 1 -- 172.21.15.63:0/3214962178 learned_addr learned my addr 172.21.15.63:0/3214962178 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeea7fc640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeec142e10 0x7feeec14dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.076 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.072+0000 7feeeaffd640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feed40047c0 0x7feeec14f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeeb7fe640 1 -- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feed40047c0 msgr2=0x7feeec14f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeeb7fe640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feed40047c0 0x7feeec14f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeeb7fe640 1 -- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeec142e10 msgr2=0x7feeec14dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeeb7fe640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeec142e10 0x7feeec14dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeeb7fe640 1 -- 172.21.15.63:0/3214962178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeec14f050 con 0x7feeec14e270 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeea7fc640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeec142e10 0x7feeec14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeeaffd640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feed40047c0 0x7feeec14f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeeb7fe640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeec14e270 0x7feeec0ada10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feeec15df50 tx=0x7feee400b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feed3fff640 1 -- 172.21.15.63:0/3214962178 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400b8d0 con 0x7feeec14e270 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feed3fff640 1 -- 172.21.15.63:0/3214962178 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee400ba70 con 0x7feeec14e270 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeec14f330 con 0x7feeec14e270 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feed3fff640 1 -- 172.21.15.63:0/3214962178 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee400be20 con 0x7feeec14e270 2023-12-04T10:45:02.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.073+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeec143270 con 0x7feeec14e270 2023-12-04T10:45:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.075+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeec14f520 con 0x7feeec14e270 2023-12-04T10:45:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.076+0000 7feed3fff640 1 -- 172.21.15.63:0/3214962178 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feee4007070 con 0x7feeec14e270 2023-12-04T10:45:02.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.076+0000 7feed3fff640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7feed806ae70 0x7feed806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.076+0000 7feed3fff640 1 -- 172.21.15.63:0/3214962178 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7feee4089cb0 con 0x7feeec14e270 2023-12-04T10:45:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.077+0000 7feeeaffd640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7feed806ae70 0x7feed806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.079 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.077+0000 7feeeaffd640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7feed806ae70 0x7feed806d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feedc009b20 tx=0x7feedc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:02.083 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.081+0000 7feed3fff640 1 -- 172.21.15.63:0/3214962178 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feee40549a0 con 0x7feeec14e270 2023-12-04T10:45:02.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.284+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7feeec04e840 con 0x7feeec14e270 2023-12-04T10:45:02.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.289+0000 7feed3fff640 1 -- 172.21.15.63:0/3214962178 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7feee4057fc0 con 0x7feeec14e270 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7feed806ae70 msgr2=0x7feed806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7feed806ae70 0x7feed806d330 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7feedc009b20 tx=0x7feedc008040 comp rx=0 tx=0).stop 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeec14e270 msgr2=0x7feeec0ada10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeec14e270 0x7feeec0ada10 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7feeec15df50 tx=0x7feee400b0d0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 shutdown_connections 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7feed806ae70 0x7feed806d330 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7feeec14e270 0x7feeec0ada10 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feeec142e10 0x7feeec14dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 --2- 172.21.15.63:0/3214962178 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7feed40047c0 0x7feeec14f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.292+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 >> 172.21.15.63:0/3214962178 conn(0x7feeec0b1570 msgr2=0x7feeec0af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.293+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 shutdown_connections 2023-12-04T10:45:02.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.293+0000 7feeebfff640 1 -- 172.21.15.63:0/3214962178 wait complete. 2023-12-04T10:45:02.313 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-04T10:45:02.313 DEBUG:teuthology.orchestra.run.smithi063:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T10:45:02.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-04T10:45:02.577 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-04T10:45:02.577 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:45:02.577 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:02.641 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:45:02.641 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:02.698 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:45:02.698 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:02.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:02.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.989+0000 7f9e3ecb4640 1 Processor -- start 2023-12-04T10:45:02.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.990+0000 7f9e3ecb4640 1 -- start start 2023-12-04T10:45:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.991+0000 7f9e3ecb4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9e3806c330 0x7f9e380b0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.991+0000 7f9e3ecb4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806b560 0x7f9e380b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.991+0000 7f9e3ecb4640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e380cfb50 con 0x7f9e38160920 2023-12-04T10:45:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.991+0000 7f9e3ecb4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e38160d00 con 0x7f9e3806c330 2023-12-04T10:45:02.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.991+0000 7f9e3ecb4640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b0840 con 0x7f9e3806b560 2023-12-04T10:45:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.992+0000 7f9e3dcb2640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9e38160920 0x7f9e3806bc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37716/0 (socket says 172.21.15.63:37716) 2023-12-04T10:45:02.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.992+0000 7f9e3dcb2640 1 -- 172.21.15.63:0/849563293 learned_addr learned my addr 172.21.15.63:0/849563293 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.992+0000 7f9e3d4b1640 1 --2- 172.21.15.63:0/849563293 >> v2:172.21.15.66:3300/0 conn(0x7f9e3806c330 0x7f9e380b0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.992+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1231088710 0 0) 0x7f9e380cfb50 con 0x7f9e38160920 2023-12-04T10:45:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.992+0000 7f9e3e4b3640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806b560 0x7f9e380b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.992+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e24003520 con 0x7f9e38160920 2023-12-04T10:45:02.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3403975597 0 0) 0x7f9e24003520 con 0x7f9e38160920 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806b560 msgr2=0x7f9e380b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806b560 0x7f9e380b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 >> v2:172.21.15.66:3300/0 conn(0x7f9e3806c330 msgr2=0x7f9e380b0fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 --2- 172.21.15.63:0/849563293 >> v2:172.21.15.66:3300/0 conn(0x7f9e3806c330 0x7f9e380b0fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e380cfda0 con 0x7f9e38160920 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f9e34001670 con 0x7f9e38160920 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 >> v1:172.21.15.63:6789/0 conn(0x7f9e38160920 legacy=0x7f9e3806bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e24003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e240047c0 0x7f9e24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806b560 0x7f9e24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e38160d00 con 0x7f9e24003970 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e380b0840 con 0x7f9e240047c0 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2400b980 con 0x7f9e3806b560 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.993+0000 7f9e3dcb2640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e24003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.997 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.994+0000 7f9e3d4b1640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e240047c0 0x7f9e24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.994+0000 7f9e3e4b3640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806b560 0x7f9e24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.994+0000 7f9e3dcb2640 1 -- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806b560 msgr2=0x7f9e24005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.994+0000 7f9e3dcb2640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806b560 0x7f9e24005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.994+0000 7f9e3dcb2640 1 -- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e240047c0 msgr2=0x7f9e24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.994+0000 7f9e3dcb2640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e240047c0 0x7f9e24004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.994+0000 7f9e3dcb2640 1 -- 172.21.15.63:0/849563293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e24003520 con 0x7f9e24003970 2023-12-04T10:45:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.995+0000 7f9e3dcb2640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e24003d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400c160 tx=0x7f9e240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3fd644f31b09b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.995+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34005ad0 con 0x7f9e24003970 2023-12-04T10:45:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.995+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34005c30 con 0x7f9e24003970 2023-12-04T10:45:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.995+0000 7f9e3ccb0640 1 -- 172.21.15.63:0/849563293 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3402c810 con 0x7f9e24003970 2023-12-04T10:45:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.996+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/849563293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 msgr2=0x7f9e24003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.996+0000 7f9e3ecb4640 1 --2- 172.21.15.63:0/849563293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e24003d90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400c160 tx=0x7f9e240057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:02.999 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.996+0000 7f9e3e4b3640 1 -- 172.21.15.63:0/849563293 reap_dead start 2023-12-04T10:45:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.996+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/849563293 shutdown_connections 2023-12-04T10:45:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.996+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/849563293 >> 172.21.15.63:0/849563293 conn(0x7f9e380d0e40 msgr2=0x7f9e380d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.996+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/849563293 shutdown_connections 2023-12-04T10:45:03.000 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.996+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/849563293 wait complete. 2023-12-04T10:45:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.998+0000 7f9e3ecb4640 1 Processor -- start 2023-12-04T10:45:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.998+0000 7f9e3ecb4640 1 -- start start 2023-12-04T10:45:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3ecb4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e3809ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3ecb4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3815b2f0 0x7f9e3806ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.001 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3ecb4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806f160 0x7f9e380b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3ecb4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e381f72e0 con 0x7f9e24003970 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3ecb4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3806f610 con 0x7f9e3815b2f0 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3ecb4640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e381f6660 con 0x7f9e3806f160 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3dcb2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e3809ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3dcb2640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e3809ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47900/0 (socket says 172.21.15.63:47900) 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3dcb2640 1 -- 172.21.15.63:0/2526053235 learned_addr learned my addr 172.21.15.63:0/2526053235 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3e4b3640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806f160 0x7f9e380b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3d4b1640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3815b2f0 0x7f9e3806ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3dcb2640 1 -- 172.21.15.63:0/2526053235 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806f160 msgr2=0x7f9e380b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3dcb2640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806f160 0x7f9e380b53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3dcb2640 1 -- 172.21.15.63:0/2526053235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3815b2f0 msgr2=0x7f9e3806ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3dcb2640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3815b2f0 0x7f9e3806ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.002 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:02.999+0000 7f9e3dcb2640 1 -- 172.21.15.63:0/2526053235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e381f6940 con 0x7f9e24003970 2023-12-04T10:45:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.000+0000 7f9e3dcb2640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e3809ac00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000fb0 tx=0x7f9e34000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.000+0000 7f9e2e7fc640 1 -- 172.21.15.63:0/2526053235 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34039070 con 0x7f9e24003970 2023-12-04T10:45:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.000+0000 7f9e2e7fc640 1 -- 172.21.15.63:0/2526053235 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3402dcb0 con 0x7f9e24003970 2023-12-04T10:45:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.000+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e381f6c20 con 0x7f9e24003970 2023-12-04T10:45:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.000+0000 7f9e2e7fc640 1 -- 172.21.15.63:0/2526053235 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e340072b0 con 0x7f9e24003970 2023-12-04T10:45:03.003 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.000+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3815b770 con 0x7f9e24003970 2023-12-04T10:45:03.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.002+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3815b930 con 0x7f9e24003970 2023-12-04T10:45:03.004 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.002+0000 7f9e2e7fc640 1 -- 172.21.15.63:0/2526053235 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9e34032070 con 0x7f9e24003970 2023-12-04T10:45:03.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.003+0000 7f9e2e7fc640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9e1c06ae90 0x7f9e1c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.003+0000 7f9e2e7fc640 1 -- 172.21.15.63:0/2526053235 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f9e3403c040 con 0x7f9e24003970 2023-12-04T10:45:03.005 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.004+0000 7f9e3d4b1640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9e1c06ae90 0x7f9e1c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.006 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.004+0000 7f9e3d4b1640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9e1c06ae90 0x7f9e1c06d350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e381600b0 tx=0x7f9e28008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:03.010 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.008+0000 7f9e2e7fc640 1 -- 172.21.15.63:0/2526053235 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9e3815b930 con 0x7f9e24003970 2023-12-04T10:45:03.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.206+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e3815b930 con 0x7f9e24003970 2023-12-04T10:45:03.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.209+0000 7f9e2e7fc640 1 -- 172.21.15.63:0/2526053235 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f9e3815b930 con 0x7f9e24003970 2023-12-04T10:45:03.212 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:03.212 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:03.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9e1c06ae90 msgr2=0x7f9e1c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9e1c06ae90 0x7f9e1c06d350 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9e381600b0 tx=0x7f9e28008040 comp rx=0 tx=0).stop 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 msgr2=0x7f9e3809ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e3809ac00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e34000fb0 tx=0x7f9e34000fe0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 shutdown_connections 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9e1c06ae90 0x7f9e1c06d350 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9e3806f160 0x7f9e380b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9e3815b2f0 0x7f9e3806ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 --2- 172.21.15.63:0/2526053235 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9e24003970 0x7f9e3809ac00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 >> 172.21.15.63:0/2526053235 conn(0x7f9e380d0e40 msgr2=0x7f9e380cd6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 shutdown_connections 2023-12-04T10:45:03.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.212+0000 7f9e3ecb4640 1 -- 172.21.15.63:0/2526053235 wait complete. 2023-12-04T10:45:03.234 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:45:03.235 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:45:03.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.458+0000 7f8031e2e640 1 Processor -- start 2023-12-04T10:45:03.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.459+0000 7f8031e2e640 1 -- start start 2023-12-04T10:45:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.460+0000 7f8031e2e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c06c520 0x7f802c165f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.460+0000 7f8031e2e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c0cb800 con 0x7f802c143ca0 2023-12-04T10:45:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.460+0000 7f8031e2e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c0cbae0 con 0x7f802c144370 2023-12-04T10:45:03.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.460+0000 7f8031e2e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0cbdc0 con 0x7f802c06c520 2023-12-04T10:45:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.460+0000 7f8030e2c640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f802c143ca0 0x7f802c0b2e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:37724/0 (socket says 172.21.15.63:37724) 2023-12-04T10:45:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.460+0000 7f8030e2c640 1 -- 172.21.15.63:0/1004427916 learned_addr learned my addr 172.21.15.63:0/1004427916 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f803162d640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c06c520 0x7f802c165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231682321 0 0) 0x7f802c0cb800 con 0x7f802c143ca0 2023-12-04T10:45:03.467 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8018003520 con 0x7f802c143ca0 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1705786208 0 0) 0x7f8018003520 con 0x7f802c143ca0 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c06c520 msgr2=0x7f802c165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c06c520 0x7f802c165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 >> v1:172.21.15.66:6789/0 conn(0x7f802c144370 legacy=0x7f802c06be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0b2610 con 0x7f802c143ca0 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f801c0019f0 con 0x7f802c143ca0 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 >> v1:172.21.15.63:6789/0 conn(0x7f802c143ca0 legacy=0x7f802c0b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.461+0000 7f802b7fe640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80180039a0 0x7f8018003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802b7fe640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f8018004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802b7fe640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c06c520 0x7f8018005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0cbdc0 con 0x7f80180047c0 2023-12-04T10:45:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801800ba60 con 0x7f80180039a0 2023-12-04T10:45:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801800bc20 con 0x7f802c06c520 2023-12-04T10:45:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802bfff640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f8018004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f8030e2c640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80180039a0 0x7f8018003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f803162d640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c06c520 0x7f8018005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802bfff640 1 -- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c06c520 msgr2=0x7f8018005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802bfff640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c06c520 0x7f8018005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802bfff640 1 -- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80180039a0 msgr2=0x7f8018003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802bfff640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f80180039a0 0x7f8018003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.462+0000 7f802bfff640 1 -- 172.21.15.63:0/1004427916 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8018003520 con 0x7f80180047c0 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.463+0000 7f802bfff640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f8018004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8014007fd0 tx=0x7f80180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0b67c66566be01e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.464+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80140052d0 con 0x7f80180047c0 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.464+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801402e050 con 0x7f80180047c0 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.464+0000 7f802b7fe640 1 -- 172.21.15.63:0/1004427916 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8014003640 con 0x7f80180047c0 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.464+0000 7f8031e2e640 1 -- 172.21.15.63:0/1004427916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 msgr2=0x7f8018004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.464+0000 7f8031e2e640 1 --2- 172.21.15.63:0/1004427916 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f8018004c40 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f8014007fd0 tx=0x7f80180057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.464+0000 7f803162d640 1 -- 172.21.15.63:0/1004427916 reap_dead start 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.464+0000 7f8031e2e640 1 -- 172.21.15.63:0/1004427916 shutdown_connections 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.464+0000 7f8031e2e640 1 -- 172.21.15.63:0/1004427916 >> 172.21.15.63:0/1004427916 conn(0x7f802c0b0860 msgr2=0x7f802c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:03.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.465+0000 7f8031e2e640 1 -- 172.21.15.63:0/1004427916 shutdown_connections 2023-12-04T10:45:03.471 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.465+0000 7f8031e2e640 1 -- 172.21.15.63:0/1004427916 wait complete. 2023-12-04T10:45:03.472 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.466+0000 7f8031e2e640 1 Processor -- start 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.466+0000 7f8031e2e640 1 -- start start 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.467+0000 7f8031e2e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f802c0ca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.467+0000 7f8031e2e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f802c15a820 0x7f802c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8031e2e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c0c6100 0x7f802c0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8031e2e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1495f0 con 0x7f80180047c0 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8031e2e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0cae10 con 0x7f802c15a820 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8031e2e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0c6ac0 con 0x7f802c0c6100 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8030e2c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f802c0ca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8030e2c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f802c0ca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:47910/0 (socket says 172.21.15.63:47910) 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8030e2c640 1 -- 172.21.15.63:0/1100351865 learned_addr learned my addr 172.21.15.63:0/1100351865 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f802bfff640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f802c15a820 0x7f802c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8030e2c640 1 -- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c0c6100 msgr2=0x7f802c0c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f803162d640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c0c6100 0x7f802c0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8030e2c640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c0c6100 0x7f802c0c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.473 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8030e2c640 1 -- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f802c15a820 msgr2=0x7f802c15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8030e2c640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f802c15a820 0x7f802c15c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f8030e2c640 1 -- 172.21.15.63:0/1100351865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c15cae0 con 0x7f80180047c0 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f803162d640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c0c6100 0x7f802c0c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.468+0000 7f802bfff640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f802c15a820 0x7f802c15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.469+0000 7f8030e2c640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f802c0ca8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f801c002030 tx=0x7f801c00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.469+0000 7f80297fa640 1 -- 172.21.15.63:0/1100351865 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c00ee50 con 0x7f80180047c0 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.469+0000 7f80297fa640 1 -- 172.21.15.63:0/1100351865 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c013420 con 0x7f80180047c0 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.469+0000 7f80297fa640 1 -- 172.21.15.63:0/1100351865 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c0137d0 con 0x7f80180047c0 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.469+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c15cdc0 con 0x7f80180047c0 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.469+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c149840 con 0x7f80180047c0 2023-12-04T10:45:03.474 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.470+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c0b3a40 con 0x7f80180047c0 2023-12-04T10:45:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.471+0000 7f80297fa640 1 -- 172.21.15.63:0/1100351865 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f801c013930 con 0x7f80180047c0 2023-12-04T10:45:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.472+0000 7f80297fa640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f800c06ae70 0x7f800c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.472+0000 7f80297fa640 1 -- 172.21.15.63:0/1100351865 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f801c08a220 con 0x7f80180047c0 2023-12-04T10:45:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.472+0000 7f802bfff640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f800c06ae70 0x7f800c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.475 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.473+0000 7f802bfff640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f800c06ae70 0x7f800c06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8014033000 tx=0x7f8014009030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:03.478 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.477+0000 7f80297fa640 1 -- 172.21.15.63:0/1100351865 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f801c058900 con 0x7f80180047c0 2023-12-04T10:45:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.673+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f802c04e840 con 0x7f80180047c0 2023-12-04T10:45:03.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.674+0000 7f80297fa640 1 -- 172.21.15.63:0/1100351865 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f801c001940 con 0x7f80180047c0 2023-12-04T10:45:03.676 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.676+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f800c06ae70 msgr2=0x7f800c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.676+0000 7f8031e2e640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f800c06ae70 0x7f800c06d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8014033000 tx=0x7f8014009030 comp rx=0 tx=0).stop 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.676+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 msgr2=0x7f802c0ca8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.676+0000 7f8031e2e640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f802c0ca8d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f801c002030 tx=0x7f801c00e530 comp rx=0 tx=0).stop 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.677+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 shutdown_connections 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.677+0000 7f8031e2e640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f800c06ae70 0x7f800c06d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.677+0000 7f8031e2e640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f802c0c6100 0x7f802c0c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.677+0000 7f8031e2e640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f802c15a820 0x7f802c15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.677+0000 7f8031e2e640 1 --2- 172.21.15.63:0/1100351865 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f80180047c0 0x7f802c0ca8d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.677+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 >> 172.21.15.63:0/1100351865 conn(0x7f802c0b0860 msgr2=0x7f802c0cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:03.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.677+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 shutdown_connections 2023-12-04T10:45:03.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.677+0000 7f8031e2e640 1 -- 172.21.15.63:0/1100351865 wait complete. 2023-12-04T10:45:03.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:45:03.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.926+0000 7fa976975640 1 Processor -- start 2023-12-04T10:45:03.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.927+0000 7fa976975640 1 -- start start 2023-12-04T10:45:03.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.928+0000 7fa976975640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa97014ae80 0x7fa9700703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.928+0000 7fa976975640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa970161b60 0x7fa9700b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.928+0000 7fa976975640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa9700b20a0 0x7fa970165070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.928+0000 7fa976975640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9700b24a0 con 0x7fa97014ae80 2023-12-04T10:45:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa976975640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa970070bf0 con 0x7fa9700b20a0 2023-12-04T10:45:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa976975640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa970070ed0 con 0x7fa970161b60 2023-12-04T10:45:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975973640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa97014ae80 0x7fa9700703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975973640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fa97014ae80 0x7fa9700703c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36834/0 (socket says 172.21.15.63:36834) 2023-12-04T10:45:03.931 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975973640 1 -- 172.21.15.63:0/3335332041 learned_addr learned my addr 172.21.15.63:0/3335332041 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa976174640 1 --2- 172.21.15.63:0/3335332041 >> v2:172.21.15.66:3300/0 conn(0x7fa9700b20a0 0x7fa970165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975973640 1 -- 172.21.15.63:0/3335332041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa970161b60 msgr2=0x7fa9700b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975172640 1 --2- 172.21.15.63:0/3335332041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa970161b60 0x7fa9700b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975973640 1 --2- 172.21.15.63:0/3335332041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa970161b60 0x7fa9700b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975973640 1 -- 172.21.15.63:0/3335332041 >> v2:172.21.15.66:3300/0 conn(0x7fa9700b20a0 msgr2=0x7fa970165070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975973640 1 --2- 172.21.15.63:0/3335332041 >> v2:172.21.15.66:3300/0 conn(0x7fa9700b20a0 0x7fa970165070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975973640 1 -- 172.21.15.63:0/3335332041 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9700711b0 con 0x7fa97014ae80 2023-12-04T10:45:03.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa976174640 1 --2- 172.21.15.63:0/3335332041 >> v2:172.21.15.66:3300/0 conn(0x7fa9700b20a0 0x7fa970165070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.929+0000 7fa975172640 1 --2- 172.21.15.63:0/3335332041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa970161b60 0x7fa9700b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.931+0000 7fa975973640 1 --2- 172.21.15.63:0/3335332041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa97014ae80 0x7fa9700703c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa97006b7f0 tx=0x7fa96c02b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=810b0bb5f43192df server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.931+0000 7fa974971640 1 -- 172.21.15.63:0/3335332041 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c031880 con 0x7fa97014ae80 2023-12-04T10:45:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.931+0000 7fa974971640 1 -- 172.21.15.63:0/3335332041 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96c0319e0 con 0x7fa97014ae80 2023-12-04T10:45:03.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.931+0000 7fa974971640 1 -- 172.21.15.63:0/3335332041 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96c031d70 con 0x7fa97014ae80 2023-12-04T10:45:03.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 -- 172.21.15.63:0/3335332041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa97014ae80 msgr2=0x7fa9700703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 --2- 172.21.15.63:0/3335332041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa97014ae80 0x7fa9700703c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fa97006b7f0 tx=0x7fa96c02b920 comp rx=0 tx=0).stop 2023-12-04T10:45:03.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 -- 172.21.15.63:0/3335332041 shutdown_connections 2023-12-04T10:45:03.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 --2- 172.21.15.63:0/3335332041 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa970161b60 0x7fa9700b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 --2- 172.21.15.63:0/3335332041 >> v2:172.21.15.66:3300/0 conn(0x7fa9700b20a0 0x7fa970165070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 --2- 172.21.15.63:0/3335332041 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa97014ae80 0x7fa9700703c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 -- 172.21.15.63:0/3335332041 >> 172.21.15.63:0/3335332041 conn(0x7fa9700b0860 msgr2=0x7fa9700b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:03.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 -- 172.21.15.63:0/3335332041 shutdown_connections 2023-12-04T10:45:03.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.932+0000 7fa976975640 1 -- 172.21.15.63:0/3335332041 wait complete. 2023-12-04T10:45:03.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.934+0000 7fa976975640 1 Processor -- start 2023-12-04T10:45:03.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.934+0000 7fa976975640 1 -- start start 2023-12-04T10:45:03.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976975640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9700b20a0 0x7fa970162920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976975640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa97014ae80 0x7fa97013f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976975640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa970161b60 0x7fa970141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976975640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9701423a0 con 0x7fa970161b60 2023-12-04T10:45:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976975640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9701425b0 con 0x7fa97014ae80 2023-12-04T10:45:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976975640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa970142890 con 0x7fa9700b20a0 2023-12-04T10:45:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976174640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa970161b60 0x7fa970141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976174640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa970161b60 0x7fa970141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36842/0 (socket says 172.21.15.63:36842) 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.935+0000 7fa976174640 1 -- 172.21.15.63:0/2577853995 learned_addr learned my addr 172.21.15.63:0/2577853995 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa975172640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa97014ae80 0x7fa97013f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa975973640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9700b20a0 0x7fa970162920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa976174640 1 -- 172.21.15.63:0/2577853995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9700b20a0 msgr2=0x7fa970162920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa976174640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9700b20a0 0x7fa970162920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa976174640 1 -- 172.21.15.63:0/2577853995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa97014ae80 msgr2=0x7fa97013f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa976174640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa97014ae80 0x7fa97013f0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa976174640 1 -- 172.21.15.63:0/2577853995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa96c0094d0 con 0x7fa970161b60 2023-12-04T10:45:03.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa976174640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa970161b60 0x7fa970141e60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa96800cef0 tx=0x7fa96800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa9667fc640 1 -- 172.21.15.63:0/2577853995 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96800d840 con 0x7fa970161b60 2023-12-04T10:45:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa9667fc640 1 -- 172.21.15.63:0/2577853995 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96800d9c0 con 0x7fa970161b60 2023-12-04T10:45:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa9667fc640 1 -- 172.21.15.63:0/2577853995 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96800dd70 con 0x7fa970161b60 2023-12-04T10:45:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.936+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa970142b70 con 0x7fa970161b60 2023-12-04T10:45:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.937+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa970164210 con 0x7fa970161b60 2023-12-04T10:45:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.938+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa970164490 con 0x7fa970161b60 2023-12-04T10:45:03.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.939+0000 7fa9667fc640 1 -- 172.21.15.63:0/2577853995 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa96801e3b0 con 0x7fa970161b60 2023-12-04T10:45:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.940+0000 7fa9667fc640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa95406ae40 0x7fa95406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.940+0000 7fa9667fc640 1 -- 172.21.15.63:0/2577853995 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fa96808a550 con 0x7fa970161b60 2023-12-04T10:45:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.940+0000 7fa975973640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa95406ae40 0x7fa95406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:03.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.941+0000 7fa975973640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa95406ae40 0x7fa95406d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa96c036000 tx=0x7fa96c03c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:03.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:03.944+0000 7fa9667fc640 1 -- 172.21.15.63:0/2577853995 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa968055260 con 0x7fa970161b60 2023-12-04T10:45:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.138+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa97004e840 con 0x7fa970161b60 2023-12-04T10:45:04.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.139+0000 7fa9667fc640 1 -- 172.21.15.63:0/2577853995 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa968058880 con 0x7fa970161b60 2023-12-04T10:45:04.141 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:04.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa95406ae40 msgr2=0x7fa95406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.143 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa95406ae40 0x7fa95406d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa96c036000 tx=0x7fa96c03c040 comp rx=0 tx=0).stop 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa970161b60 msgr2=0x7fa970141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa970161b60 0x7fa970141e60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fa96800cef0 tx=0x7fa96800a710 comp rx=0 tx=0).stop 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 shutdown_connections 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fa95406ae40 0x7fa95406d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fa970161b60 0x7fa970141e60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa97014ae80 0x7fa97013f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 --2- 172.21.15.63:0/2577853995 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fa9700b20a0 0x7fa970162920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.141+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 >> 172.21.15.63:0/2577853995 conn(0x7fa9700b0860 msgr2=0x7fa9700b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.142+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 shutdown_connections 2023-12-04T10:45:04.144 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.142+0000 7fa976975640 1 -- 172.21.15.63:0/2577853995 wait complete. 2023-12-04T10:45:04.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:45:04.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.381+0000 7f022442b640 1 Processor -- start 2023-12-04T10:45:04.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.381+0000 7f022442b640 1 -- start start 2023-12-04T10:45:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.383+0000 7f022442b640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f021c0ce8e0 0x7f021c0d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.383+0000 7f022442b640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0b2710 con 0x7f021c0d1de0 2023-12-04T10:45:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.383+0000 7f022442b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f021c0d4150 con 0x7f021c15d5d0 2023-12-04T10:45:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.383+0000 7f022442b640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f021c0d2290 con 0x7f021c0ce8e0 2023-12-04T10:45:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.383+0000 7f02219c6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f021c0ce8e0 0x7f021c0d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.383+0000 7f02229c8640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f021c0d1de0 0x7f021c0b3160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58072/0 (socket says 172.21.15.63:58072) 2023-12-04T10:45:04.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.383+0000 7f02229c8640 1 -- 172.21.15.63:0/3871251295 learned_addr learned my addr 172.21.15.63:0/3871251295 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:04.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.384+0000 7f02219c6640 1 -- 172.21.15.63:0/3871251295 >> v1:172.21.15.66:6789/0 conn(0x7f021c15d5d0 legacy=0x7f021c0d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:04.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.384+0000 7f02219c6640 1 -- 172.21.15.63:0/3871251295 >> v1:172.21.15.63:6789/0 conn(0x7f021c0d1de0 legacy=0x7f021c0b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.384+0000 7f02219c6640 1 -- 172.21.15.63:0/3871251295 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c0ced70 con 0x7f021c0ce8e0 2023-12-04T10:45:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.385+0000 7f02219c6640 1 --2- 172.21.15.63:0/3871251295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c0ce8e0 0x7f021c0d18a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f020c0097a0 tx=0x7f020c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8c818f64ec40c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.385+0000 7f02211c5640 1 -- 172.21.15.63:0/3871251295 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c031830 con 0x7f021c0ce8e0 2023-12-04T10:45:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.385+0000 7f02211c5640 1 -- 172.21.15.63:0/3871251295 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c031990 con 0x7f021c0ce8e0 2023-12-04T10:45:04.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.385+0000 7f02211c5640 1 -- 172.21.15.63:0/3871251295 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c031d20 con 0x7f021c0ce8e0 2023-12-04T10:45:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.386+0000 7f022442b640 1 -- 172.21.15.63:0/3871251295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c0ce8e0 msgr2=0x7f021c0d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.386+0000 7f022442b640 1 --2- 172.21.15.63:0/3871251295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c0ce8e0 0x7f021c0d18a0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f020c0097a0 tx=0x7f020c02b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.386+0000 7f022442b640 1 -- 172.21.15.63:0/3871251295 shutdown_connections 2023-12-04T10:45:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.386+0000 7f022442b640 1 --2- 172.21.15.63:0/3871251295 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c0ce8e0 0x7f021c0d18a0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.386+0000 7f022442b640 1 -- 172.21.15.63:0/3871251295 >> 172.21.15.63:0/3871251295 conn(0x7f021c09c600 msgr2=0x7f021c0d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.386+0000 7f022442b640 1 -- 172.21.15.63:0/3871251295 shutdown_connections 2023-12-04T10:45:04.388 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.386+0000 7f022442b640 1 -- 172.21.15.63:0/3871251295 wait complete. 2023-12-04T10:45:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.387+0000 7f022442b640 1 Processor -- start 2023-12-04T10:45:04.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.388+0000 7f022442b640 1 -- start start 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.388+0000 7f022442b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f021c0d1de0 0x7f021c150d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.388+0000 7f022442b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c15d5d0 0x7f021c0b6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f022442b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f021c151ae0 0x7f021c0cc560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f022442b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c151250 con 0x7f021c15d5d0 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f022442b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f021c0b7210 con 0x7f021c151ae0 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f022442b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f021c15ed90 con 0x7f021c0d1de0 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c15d5d0 0x7f021c0b6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c15d5d0 0x7f021c0b6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36864/0 (socket says 172.21.15.63:36864) 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 -- 172.21.15.63:0/1695650205 learned_addr learned my addr 172.21.15.63:0/1695650205 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:04.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 -- 172.21.15.63:0/1695650205 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f021c0d1de0 msgr2=0x7f021c150d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f021c0d1de0 0x7f021c150d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 -- 172.21.15.63:0/1695650205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f021c151ae0 msgr2=0x7f021c0cc560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f021c151ae0 0x7f021c0cc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 -- 172.21.15.63:0/1695650205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f020c009400 con 0x7f021c15d5d0 2023-12-04T10:45:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.389+0000 7f02219c6640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c15d5d0 0x7f021c0b6830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f020c034040 tx=0x7f020c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.390+0000 7f0212ffd640 1 -- 172.21.15.63:0/1695650205 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c03aa60 con 0x7f021c15d5d0 2023-12-04T10:45:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.390+0000 7f0212ffd640 1 -- 172.21.15.63:0/1695650205 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f020c03abe0 con 0x7f021c15d5d0 2023-12-04T10:45:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.390+0000 7f0212ffd640 1 -- 172.21.15.63:0/1695650205 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f020c044400 con 0x7f021c15d5d0 2023-12-04T10:45:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.390+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f021c15f070 con 0x7f021c15d5d0 2023-12-04T10:45:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.390+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f021c15f630 con 0x7f021c15d5d0 2023-12-04T10:45:04.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.391+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f021c068710 con 0x7f021c15d5d0 2023-12-04T10:45:04.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.392+0000 7f0212ffd640 1 -- 172.21.15.63:0/1695650205 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f020c04d440 con 0x7f021c15d5d0 2023-12-04T10:45:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.393+0000 7f0212ffd640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f020006ae40 0x7f020006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.393+0000 7f0212ffd640 1 -- 172.21.15.63:0/1695650205 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f020c0abda0 con 0x7f021c15d5d0 2023-12-04T10:45:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.393+0000 7f02221c7640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f020006ae40 0x7f020006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:04.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.394+0000 7f02221c7640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f020006ae40 0x7f020006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0218003cc0 tx=0x7f02180079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:04.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.398+0000 7f0212ffd640 1 -- 172.21.15.63:0/1695650205 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f020c076960 con 0x7f021c15d5d0 2023-12-04T10:45:04.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.581+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f021c068710 con 0x7f021c15d5d0 2023-12-04T10:45:04.584 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.582+0000 7f0212ffd640 1 -- 172.21.15.63:0/1695650205 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f020c035070 con 0x7f021c15d5d0 2023-12-04T10:45:04.584 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:45:04.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f020006ae40 msgr2=0x7f020006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f020006ae40 0x7f020006d300 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0218003cc0 tx=0x7f02180079b0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c15d5d0 msgr2=0x7f021c0b6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c15d5d0 0x7f021c0b6830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f020c034040 tx=0x7f020c0046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 shutdown_connections 2023-12-04T10:45:04.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f020006ae40 0x7f020006d300 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f021c151ae0 0x7f021c0cc560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f021c15d5d0 0x7f021c0b6830 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 --2- 172.21.15.63:0/1695650205 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f021c0d1de0 0x7f021c150d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.584+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 >> 172.21.15.63:0/1695650205 conn(0x7f021c09c600 msgr2=0x7f021c06c640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:04.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.585+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 shutdown_connections 2023-12-04T10:45:04.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.585+0000 7f022442b640 1 -- 172.21.15.63:0/1695650205 wait complete. 2023-12-04T10:45:04.605 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:45:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.827+0000 7fce4097c640 1 Processor -- start 2023-12-04T10:45:04.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.827+0000 7fce4097c640 1 -- start start 2023-12-04T10:45:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce4097c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fce3c161b60 0x7fce3c0b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce4097c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce3c0b20a0 0x7fce3c06bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.832 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce4097c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce3c070bf0 con 0x7fce3c14ae80 2023-12-04T10:45:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce4097c640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c0b2510 con 0x7fce3c0b20a0 2023-12-04T10:45:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce4097c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3c070ed0 con 0x7fce3c161b60 2023-12-04T10:45:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce3bfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce3c0b20a0 0x7fce3c06bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce3bfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fce3c0b20a0 0x7fce3c06bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36880/0 (socket says 172.21.15.63:36880) 2023-12-04T10:45:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce3bfff640 1 -- 172.21.15.63:0/328366812 learned_addr learned my addr 172.21.15.63:0/328366812 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.829+0000 7fce3affd640 1 --2- 172.21.15.63:0/328366812 >> v2:172.21.15.66:3300/0 conn(0x7fce3c161b60 0x7fce3c0b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.830+0000 7fce3bfff640 1 -- 172.21.15.63:0/328366812 >> v2:172.21.15.66:3300/0 conn(0x7fce3c161b60 msgr2=0x7fce3c0b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:04.833 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.830+0000 7fce3bfff640 1 --2- 172.21.15.63:0/328366812 >> v2:172.21.15.66:3300/0 conn(0x7fce3c161b60 0x7fce3c0b1b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.830+0000 7fce3bfff640 1 -- 172.21.15.63:0/328366812 >> v1:172.21.15.66:6789/0 conn(0x7fce3c14ae80 legacy=0x7fce3c0703c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:04.834 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.830+0000 7fce3bfff640 1 -- 172.21.15.63:0/328366812 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3c0711b0 con 0x7fce3c0b20a0 2023-12-04T10:45:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.831+0000 7fce3bfff640 1 --2- 172.21.15.63:0/328366812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c0b20a0 0x7fce3c06bef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0b1490 tx=0x7fce3402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82260b5616ce99e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce3a7fc640 1 -- 172.21.15.63:0/328366812 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34031870 con 0x7fce3c0b20a0 2023-12-04T10:45:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce3a7fc640 1 -- 172.21.15.63:0/328366812 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce340319d0 con 0x7fce3c0b20a0 2023-12-04T10:45:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce3a7fc640 1 -- 172.21.15.63:0/328366812 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce34031d60 con 0x7fce3c0b20a0 2023-12-04T10:45:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce4097c640 1 -- 172.21.15.63:0/328366812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c0b20a0 msgr2=0x7fce3c06bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce4097c640 1 --2- 172.21.15.63:0/328366812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c0b20a0 0x7fce3c06bef0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fce3c0b1490 tx=0x7fce3402b910 comp rx=0 tx=0).stop 2023-12-04T10:45:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce4097c640 1 -- 172.21.15.63:0/328366812 shutdown_connections 2023-12-04T10:45:04.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce4097c640 1 --2- 172.21.15.63:0/328366812 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c0b20a0 0x7fce3c06bef0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce4097c640 1 --2- 172.21.15.63:0/328366812 >> v2:172.21.15.66:3300/0 conn(0x7fce3c161b60 0x7fce3c0b1b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce4097c640 1 -- 172.21.15.63:0/328366812 >> 172.21.15.63:0/328366812 conn(0x7fce3c0b0860 msgr2=0x7fce3c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce4097c640 1 -- 172.21.15.63:0/328366812 shutdown_connections 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.832+0000 7fce4097c640 1 -- 172.21.15.63:0/328366812 wait complete. 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.834+0000 7fce4097c640 1 Processor -- start 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.834+0000 7fce4097c640 1 -- start start 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.835+0000 7fce4097c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c0b20a0 0x7fce3c1420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.835+0000 7fce4097c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c14ae80 0x7fce3c0aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.835+0000 7fce4097c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c161b60 0x7fce3c06c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.835+0000 7fce4097c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c142600 con 0x7fce3c14ae80 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.835+0000 7fce4097c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0a8880 con 0x7fce3c0b20a0 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.835+0000 7fce4097c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce3c0a8b60 con 0x7fce3c161b60 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c14ae80 0x7fce3c0aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c14ae80 0x7fce3c0aab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36888/0 (socket says 172.21.15.63:36888) 2023-12-04T10:45:04.840 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 -- 172.21.15.63:0/2675300713 learned_addr learned my addr 172.21.15.63:0/2675300713 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3b7fe640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c0b20a0 0x7fce3c1420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 -- 172.21.15.63:0/2675300713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c161b60 msgr2=0x7fce3c06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c161b60 0x7fce3c06c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 -- 172.21.15.63:0/2675300713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c0b20a0 msgr2=0x7fce3c1420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c0b20a0 0x7fce3c1420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 -- 172.21.15.63:0/2675300713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce340094d0 con 0x7fce3c14ae80 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3b7fe640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c0b20a0 0x7fce3c1420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.836+0000 7fce3affd640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c14ae80 0x7fce3c0aab30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fce2400d800 tx=0x7fce2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.837+0000 7fce33fff640 1 -- 172.21.15.63:0/2675300713 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce24018070 con 0x7fce3c14ae80 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.837+0000 7fce33fff640 1 -- 172.21.15.63:0/2675300713 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce24004020 con 0x7fce3c14ae80 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.837+0000 7fce33fff640 1 -- 172.21.15.63:0/2675300713 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce240041b0 con 0x7fce3c14ae80 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.837+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce3c0a8e40 con 0x7fce3c14ae80 2023-12-04T10:45:04.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.837+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce3c0a9400 con 0x7fce3c14ae80 2023-12-04T10:45:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.838+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce3c04e840 con 0x7fce3c14ae80 2023-12-04T10:45:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.839+0000 7fce33fff640 1 -- 172.21.15.63:0/2675300713 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce24004310 con 0x7fce3c14ae80 2023-12-04T10:45:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.840+0000 7fce33fff640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fce1c06ae40 0x7fce1c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:04.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.840+0000 7fce33fff640 1 -- 172.21.15.63:0/2675300713 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fce240895e0 con 0x7fce3c14ae80 2023-12-04T10:45:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.840+0000 7fce3b7fe640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fce1c06ae40 0x7fce1c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:04.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.840+0000 7fce3b7fe640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fce1c06ae40 0x7fce1c06d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce2c004520 tx=0x7fce2c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:04.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:04.844+0000 7fce33fff640 1 -- 172.21.15.63:0/2675300713 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce240542d0 con 0x7fce3c14ae80 2023-12-04T10:45:05.044 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.042+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fce3c06ddf0 con 0x7fce3c14ae80 2023-12-04T10:45:05.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.043+0000 7fce33fff640 1 -- 172.21.15.63:0/2675300713 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fce240578f0 con 0x7fce3c14ae80 2023-12-04T10:45:05.045 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fce1c06ae40 msgr2=0x7fce1c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fce1c06ae40 0x7fce1c06d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce2c004520 tx=0x7fce2c009040 comp rx=0 tx=0).stop 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c14ae80 msgr2=0x7fce3c0aab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c14ae80 0x7fce3c0aab30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fce2400d800 tx=0x7fce2400dcc0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 shutdown_connections 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fce1c06ae40 0x7fce1c06d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fce3c161b60 0x7fce3c06c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fce3c14ae80 0x7fce3c0aab30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.048 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 --2- 172.21.15.63:0/2675300713 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce3c0b20a0 0x7fce3c1420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 >> 172.21.15.63:0/2675300713 conn(0x7fce3c0b0860 msgr2=0x7fce3c15f680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:05.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 shutdown_connections 2023-12-04T10:45:05.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.046+0000 7fce4097c640 1 -- 172.21.15.63:0/2675300713 wait complete. 2023-12-04T10:45:05.067 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T10:45:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.286+0000 7f1062bac640 1 Processor -- start 2023-12-04T10:45:05.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.286+0000 7f1062bac640 1 -- start start 2023-12-04T10:45:05.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.287+0000 7f1062bac640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f105c1621f0 0x7f105c162680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:05.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.287+0000 7f1062bac640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0ca0f0 con 0x7f105c0c9270 2023-12-04T10:45:05.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.287+0000 7f1062bac640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f105c0c9850 con 0x7f105c15bb10 2023-12-04T10:45:05.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.288+0000 7f1062bac640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f105c070a70 con 0x7f105c1621f0 2023-12-04T10:45:05.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.288+0000 7f10613a9640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f105c0c9270 0x7f105c165120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58086/0 (socket says 172.21.15.63:58086) 2023-12-04T10:45:05.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.288+0000 7f10613a9640 1 -- 172.21.15.63:0/1336501836 learned_addr learned my addr 172.21.15.63:0/1336501836 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.288+0000 7f10623ab640 1 --2- 172.21.15.63:0/1336501836 >> v2:172.21.15.66:3300/0 conn(0x7f105c1621f0 0x7f105c162680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.288+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1048149707 0 0) 0x7f105c0ca0f0 con 0x7f105c0c9270 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1048003520 con 0x7f105c0c9270 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2645919416 0 0) 0x7f1048003520 con 0x7f105c0c9270 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 >> v2:172.21.15.66:3300/0 conn(0x7f105c1621f0 msgr2=0x7f105c162680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 --2- 172.21.15.63:0/1336501836 >> v2:172.21.15.66:3300/0 conn(0x7f105c1621f0 0x7f105c162680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 >> v1:172.21.15.66:6789/0 conn(0x7f105c15bb10 legacy=0x7f105c0ce470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0c9b30 con 0x7f105c0c9270 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f1050001670 con 0x7f105c0c9270 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 >> v1:172.21.15.63:6789/0 conn(0x7f105c0c9270 legacy=0x7f105c165120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048003970 0x7f1048003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:05.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10480047c0 0x7f1048004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480052a0 0x7f104800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104800c140 con 0x7f10480047c0 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104800c2b0 con 0x7f1048003970 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.289+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104800c470 con 0x7f10480052a0 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f10613a9640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10480047c0 0x7f1048004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f1061baa640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048003970 0x7f1048003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f10623ab640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480052a0 0x7f104800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f10613a9640 1 -- 172.21.15.63:0/1336501836 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480052a0 msgr2=0x7f104800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f10613a9640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480052a0 0x7f104800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f10613a9640 1 -- 172.21.15.63:0/1336501836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048003970 msgr2=0x7f1048003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f10613a9640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1048003970 0x7f1048003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f10613a9640 1 -- 172.21.15.63:0/1336501836 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1048003520 con 0x7f10480047c0 2023-12-04T10:45:05.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.290+0000 7f10623ab640 1 -- 172.21.15.63:0/1336501836 reap_dead start 2023-12-04T10:45:05.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.291+0000 7f10613a9640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10480047c0 0x7f1048004c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f105000c210 tx=0x7f10480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4115482eb417f24c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:05.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.292+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1050005ad0 con 0x7f10480047c0 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.292+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1050005c50 con 0x7f10480047c0 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.292+0000 7f1060ba8640 1 -- 172.21.15.63:0/1336501836 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105002c770 con 0x7f10480047c0 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.292+0000 7f1062bac640 1 -- 172.21.15.63:0/1336501836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10480047c0 msgr2=0x7f1048004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.292+0000 7f1062bac640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10480047c0 0x7f1048004c40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f105000c210 tx=0x7f10480057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.292+0000 7f1062bac640 1 -- 172.21.15.63:0/1336501836 shutdown_connections 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.292+0000 7f1062bac640 1 --2- 172.21.15.63:0/1336501836 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f10480047c0 0x7f1048004c40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.292+0000 7f1062bac640 1 -- 172.21.15.63:0/1336501836 >> 172.21.15.63:0/1336501836 conn(0x7f105c0b07f0 msgr2=0x7f105c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.293+0000 7f1062bac640 1 -- 172.21.15.63:0/1336501836 shutdown_connections 2023-12-04T10:45:05.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.293+0000 7f1062bac640 1 -- 172.21.15.63:0/1336501836 wait complete. 2023-12-04T10:45:05.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.294+0000 7f1062bac640 1 Processor -- start 2023-12-04T10:45:05.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.295+0000 7f1062bac640 1 -- start start 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f1062bac640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480047c0 0x7f105c15a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f1062bac640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105c163e00 0x7f105c15db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f1062bac640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f105c164280 0x7f105c15e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f1062bac640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c1639e0 con 0x7f105c164280 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f1062bac640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f105c15a600 con 0x7f105c163e00 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f1062bac640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f105c162ac0 con 0x7f10480047c0 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f10623ab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f105c164280 0x7f105c15e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f10623ab640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f105c164280 0x7f105c15e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36914/0 (socket says 172.21.15.63:36914) 2023-12-04T10:45:05.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f10623ab640 1 -- 172.21.15.63:0/3397671903 learned_addr learned my addr 172.21.15.63:0/3397671903 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:05.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f1061baa640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480047c0 0x7f105c15a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f10623ab640 1 -- 172.21.15.63:0/3397671903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480047c0 msgr2=0x7f105c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f10623ab640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480047c0 0x7f105c15a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f10623ab640 1 -- 172.21.15.63:0/3397671903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105c163e00 msgr2=0x7f105c15db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f10623ab640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105c163e00 0x7f105c15db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.296+0000 7f10623ab640 1 -- 172.21.15.63:0/3397671903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c162d60 con 0x7f105c164280 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.297+0000 7f10623ab640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f105c164280 0x7f105c15e0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cab30 tx=0x7f105400f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.297+0000 7f104e7fc640 1 -- 172.21.15.63:0/3397671903 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054016620 con 0x7f105c164280 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.297+0000 7f104e7fc640 1 -- 172.21.15.63:0/3397671903 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10540167a0 con 0x7f105c164280 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.297+0000 7f104e7fc640 1 -- 172.21.15.63:0/3397671903 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1054016b50 con 0x7f105c164280 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.297+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f105c163040 con 0x7f105c164280 2023-12-04T10:45:05.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.297+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f105c163600 con 0x7f105c164280 2023-12-04T10:45:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.298+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f105c04e840 con 0x7f105c164280 2023-12-04T10:45:05.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.299+0000 7f104e7fc640 1 -- 172.21.15.63:0/3397671903 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1054016cb0 con 0x7f105c164280 2023-12-04T10:45:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.300+0000 7f104e7fc640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f104006ae70 0x7f104006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.300+0000 7f104e7fc640 1 -- 172.21.15.63:0/3397671903 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f105408a550 con 0x7f105c164280 2023-12-04T10:45:05.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.301+0000 7f1061baa640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f104006ae70 0x7f104006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:05.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.301+0000 7f1061baa640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f104006ae70 0x7f104006d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1058007fd0 tx=0x7f1058009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:05.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.305+0000 7f104e7fc640 1 -- 172.21.15.63:0/3397671903 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1054055230 con 0x7f105c164280 2023-12-04T10:45:05.517 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.515+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f105c15a900 con 0x7f105c164280 2023-12-04T10:45:05.518 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.516+0000 7f104e7fc640 1 -- 172.21.15.63:0/3397671903 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1054058850 con 0x7f105c164280 2023-12-04T10:45:05.518 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f104006ae70 msgr2=0x7f104006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f104006ae70 0x7f104006d330 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1058007fd0 tx=0x7f1058009040 comp rx=0 tx=0).stop 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f105c164280 msgr2=0x7f105c15e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f105c164280 0x7f105c15e0a0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f105c0cab30 tx=0x7f105400f520 comp rx=0 tx=0).stop 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 shutdown_connections 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f104006ae70 0x7f104006d330 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f105c164280 0x7f105c15e0a0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f105c163e00 0x7f105c15db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 --2- 172.21.15.63:0/3397671903 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f10480047c0 0x7f105c15a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 >> 172.21.15.63:0/3397671903 conn(0x7f105c0b07f0 msgr2=0x7f105c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 shutdown_connections 2023-12-04T10:45:05.523 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:05.519+0000 7f1062bac640 1 -- 172.21.15.63:0/3397671903 wait complete. 2023-12-04T10:45:05.539 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-04T10:45:05.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:05.539 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-04T10:45:05.641 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:45:05.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:05.642 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-04T10:45:05.696 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:45:05.696 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:05.759 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:45:05.759 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:05.815 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:45:05.815 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:05.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.106+0000 7f8a2b59e640 1 Processor -- start 2023-12-04T10:45:06.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.106+0000 7f8a2b59e640 1 -- start start 2023-12-04T10:45:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.108+0000 7f8a2b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8a2c0cad70 0x7f8a2c0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.108+0000 7f8a2b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0cbb70 0x7f8a2c06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.108+0000 7f8a2b59e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a2c15a300 con 0x7f8a2c159f20 2023-12-04T10:45:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.108+0000 7f8a2b59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a2c0723f0 con 0x7f8a2c0cad70 2023-12-04T10:45:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.108+0000 7f8a2b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0cbfe0 con 0x7f8a2c0cbb70 2023-12-04T10:45:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.108+0000 7f8a2a59c640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8a2c159f20 0x7f8a2c070df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58102/0 (socket says 172.21.15.63:58102) 2023-12-04T10:45:06.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.108+0000 7f8a2a59c640 1 -- 172.21.15.63:0/104028609 learned_addr learned my addr 172.21.15.63:0/104028609 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 691122872 0 0) 0x7f8a2c15a300 con 0x7f8a2c159f20 2023-12-04T10:45:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a14005730 con 0x7f8a2c159f20 2023-12-04T10:45:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a29d9b640 1 --2- 172.21.15.63:0/104028609 >> v2:172.21.15.66:3300/0 conn(0x7f8a2c0cad70 0x7f8a2c0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2ad9d640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0cbb70 0x7f8a2c06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3506424852 0 0) 0x7f8a14005730 con 0x7f8a2c159f20 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0cbb70 msgr2=0x7f8a2c06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0cbb70 0x7f8a2c06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 >> v2:172.21.15.66:3300/0 conn(0x7f8a2c0cad70 msgr2=0x7f8a2c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 --2- 172.21.15.63:0/104028609 >> v2:172.21.15.66:3300/0 conn(0x7f8a2c0cad70 0x7f8a2c0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0ca040 con 0x7f8a2c159f20 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f8a1c0019f0 con 0x7f8a2c159f20 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 >> v1:172.21.15.63:6789/0 conn(0x7f8a2c159f20 legacy=0x7f8a2c070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a14005bb0 0x7f8a14005fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a140069d0 0x7f8a14006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0cbb70 0x7f8a14007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0cbfe0 con 0x7f8a14005bb0 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1400dc40 con 0x7f8a140069d0 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.109+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1400de00 con 0x7f8a2c0cbb70 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.110+0000 7f8a2a59c640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a14005bb0 0x7f8a14005fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.110+0000 7f8a2a59c640 1 -- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0cbb70 msgr2=0x7f8a14007390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:06.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.110+0000 7f8a2a59c640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0cbb70 0x7f8a14007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.110+0000 7f8a2a59c640 1 -- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a140069d0 msgr2=0x7f8a14006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:06.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.110+0000 7f8a2a59c640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a140069d0 0x7f8a14006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.110+0000 7f8a2a59c640 1 -- 172.21.15.63:0/104028609 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14005730 con 0x7f8a14005bb0 2023-12-04T10:45:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.111+0000 7f8a2a59c640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a14005bb0 0x7f8a14005fd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c002230 tx=0x7f8a14007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5c33e03f3655ff server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.111+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c034630 con 0x7f8a14005bb0 2023-12-04T10:45:06.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.111+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c02f070 con 0x7f8a14005bb0 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.111+0000 7f8a2959a640 1 -- 172.21.15.63:0/104028609 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c034a10 con 0x7f8a14005bb0 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.112+0000 7f8a2b59e640 1 -- 172.21.15.63:0/104028609 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a14005bb0 msgr2=0x7f8a14005fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.112+0000 7f8a2b59e640 1 --2- 172.21.15.63:0/104028609 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a14005bb0 0x7f8a14005fd0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c002230 tx=0x7f8a14007a00 comp rx=0 tx=0).stop 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.112+0000 7f8a2ad9d640 1 -- 172.21.15.63:0/104028609 reap_dead start 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.112+0000 7f8a2b59e640 1 -- 172.21.15.63:0/104028609 shutdown_connections 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.112+0000 7f8a2b59e640 1 -- 172.21.15.63:0/104028609 >> 172.21.15.63:0/104028609 conn(0x7f8a2c0b07f0 msgr2=0x7f8a2c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.112+0000 7f8a2b59e640 1 -- 172.21.15.63:0/104028609 shutdown_connections 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.112+0000 7f8a2b59e640 1 -- 172.21.15.63:0/104028609 wait complete. 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.114+0000 7f8a2b59e640 1 Processor -- start 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.114+0000 7f8a2b59e640 1 -- start start 2023-12-04T10:45:06.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a14005bb0 0x7f8a2c0c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0c7f90 0x7f8a2c151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a2c0c4960 0x7f8a2c0c4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2b59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0c5320 con 0x7f8a2c0c4960 2023-12-04T10:45:06.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2b59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c152a20 con 0x7f8a14005bb0 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2c0c8410 con 0x7f8a2c0c7f90 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a2c0c4960 0x7f8a2c0c4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2ad9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a2c0c4960 0x7f8a2c0c4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36932/0 (socket says 172.21.15.63:36932) 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.115+0000 7f8a2ad9d640 1 -- 172.21.15.63:0/1106567568 learned_addr learned my addr 172.21.15.63:0/1106567568 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a2a59c640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a14005bb0 0x7f8a2c0c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a2ad9d640 1 -- 172.21.15.63:0/1106567568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0c7f90 msgr2=0x7f8a2c151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a2ad9d640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0c7f90 0x7f8a2c151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a2ad9d640 1 -- 172.21.15.63:0/1106567568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a14005bb0 msgr2=0x7f8a2c0c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a2ad9d640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a14005bb0 0x7f8a2c0c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a2ad9d640 1 -- 172.21.15.63:0/1106567568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a2c0c6380 con 0x7f8a2c0c4960 2023-12-04T10:45:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a2ad9d640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a2c0c4960 0x7f8a2c0c4de0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c06c460 tx=0x7f8a2400d8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a1affd640 1 -- 172.21.15.63:0/1106567568 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a24004030 con 0x7f8a2c0c4960 2023-12-04T10:45:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a1affd640 1 -- 172.21.15.63:0/1106567568 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a240041b0 con 0x7f8a2c0c4960 2023-12-04T10:45:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.116+0000 7f8a1affd640 1 -- 172.21.15.63:0/1106567568 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a240126b0 con 0x7f8a2c0c4960 2023-12-04T10:45:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.117+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2c0c6660 con 0x7f8a2c0c4960 2023-12-04T10:45:06.123 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.117+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c0c6c20 con 0x7f8a2c0c4960 2023-12-04T10:45:06.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.118+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a2c152bb0 con 0x7f8a2c0c4960 2023-12-04T10:45:06.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.119+0000 7f8a1affd640 1 -- 172.21.15.63:0/1106567568 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8a24012810 con 0x7f8a2c0c4960 2023-12-04T10:45:06.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.120+0000 7f8a1affd640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8a0c06ae70 0x7f8a0c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.120+0000 7f8a1affd640 1 -- 172.21.15.63:0/1106567568 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8a24089710 con 0x7f8a2c0c4960 2023-12-04T10:45:06.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.121+0000 7f8a2a59c640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8a0c06ae70 0x7f8a0c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.121+0000 7f8a2a59c640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8a0c06ae70 0x7f8a0c06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c034000 tx=0x7f8a1c02f000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:06.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.125+0000 7f8a1affd640 1 -- 172.21.15.63:0/1106567568 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8a24054490 con 0x7f8a2c0c4960 2023-12-04T10:45:06.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.320+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a2c04e840 con 0x7f8a2c0c4960 2023-12-04T10:45:06.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.322+0000 7f8a1affd640 1 -- 172.21.15.63:0/1106567568 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f8a24057ab0 con 0x7f8a2c0c4960 2023-12-04T10:45:06.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:06.324 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:06.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8a0c06ae70 msgr2=0x7f8a0c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8a0c06ae70 0x7f8a0c06d330 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c034000 tx=0x7f8a1c02f000 comp rx=0 tx=0).stop 2023-12-04T10:45:06.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a2c0c4960 msgr2=0x7f8a2c0c4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a2c0c4960 0x7f8a2c0c4de0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c06c460 tx=0x7f8a2400d8a0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 shutdown_connections 2023-12-04T10:45:06.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8a0c06ae70 0x7f8a0c06d330 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8a2c0c7f90 0x7f8a2c151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8a2c0c4960 0x7f8a2c0c4de0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 --2- 172.21.15.63:0/1106567568 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8a14005bb0 0x7f8a2c0c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 >> 172.21.15.63:0/1106567568 conn(0x7f8a2c0b07f0 msgr2=0x7f8a2c06d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:06.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 shutdown_connections 2023-12-04T10:45:06.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.325+0000 7f8a2b59e640 1 -- 172.21.15.63:0/1106567568 wait complete. 2023-12-04T10:45:06.346 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:45:06.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:45:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.558+0000 7f40fdd7c640 1 Processor -- start 2023-12-04T10:45:06.561 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.558+0000 7f40fdd7c640 1 -- start start 2023-12-04T10:45:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.560+0000 7f40fdd7c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f40f8144a00 0x7f40f80b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.560+0000 7f40fdd7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 0x7f40f80705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.560+0000 7f40fdd7c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40f80b2370 con 0x7f40f80ca290 2023-12-04T10:45:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.560+0000 7f40fdd7c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40f8070b00 con 0x7f40f8144a00 2023-12-04T10:45:06.562 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.560+0000 7f40fdd7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f80cae80 con 0x7f40f80701b0 2023-12-04T10:45:06.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.561+0000 7f40f6ffd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 0x7f40f80705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.561+0000 7f40f77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f40f8144a00 0x7f40f80b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.561+0000 7f40f77fe640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f40f8144a00 0x7f40f80b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:43260/0 (socket says 172.21.15.63:43260) 2023-12-04T10:45:06.563 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.561+0000 7f40f77fe640 1 -- 172.21.15.63:0/241947619 learned_addr learned my addr 172.21.15.63:0/241947619 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.562+0000 7f40f77fe640 1 -- 172.21.15.63:0/241947619 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 msgr2=0x7f40f80705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.562+0000 7f40f77fe640 1 --2- 172.21.15.63:0/241947619 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 0x7f40f80705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.562+0000 7f40f77fe640 1 -- 172.21.15.63:0/241947619 >> v1:172.21.15.66:6789/0 conn(0x7f40f80ca290 legacy=0x7f40f806d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:06.564 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.562+0000 7f40f77fe640 1 -- 172.21.15.63:0/241947619 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f806c460 con 0x7f40f8144a00 2023-12-04T10:45:06.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.563+0000 7f40f77fe640 1 --2- 172.21.15.63:0/241947619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f8144a00 0x7f40f80b1e30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009870 tx=0x7f40e802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49d597bc246462ad server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40f67fc640 1 -- 172.21.15.63:0/241947619 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8031640 con 0x7f40f8144a00 2023-12-04T10:45:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40f67fc640 1 -- 172.21.15.63:0/241947619 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e80317a0 con 0x7f40f8144a00 2023-12-04T10:45:06.566 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40f67fc640 1 -- 172.21.15.63:0/241947619 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e8031b30 con 0x7f40f8144a00 2023-12-04T10:45:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40fdd7c640 1 -- 172.21.15.63:0/241947619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f8144a00 msgr2=0x7f40f80b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/241947619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f8144a00 0x7f40f80b1e30 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f40e8009870 tx=0x7f40e802b8f0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40fdd7c640 1 -- 172.21.15.63:0/241947619 shutdown_connections 2023-12-04T10:45:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/241947619 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 0x7f40f80705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/241947619 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f8144a00 0x7f40f80b1e30 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.564+0000 7f40fdd7c640 1 -- 172.21.15.63:0/241947619 >> 172.21.15.63:0/241947619 conn(0x7f40f80cee80 msgr2=0x7f40f80cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.565+0000 7f40fdd7c640 1 -- 172.21.15.63:0/241947619 shutdown_connections 2023-12-04T10:45:06.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.565+0000 7f40fdd7c640 1 -- 172.21.15.63:0/241947619 wait complete. 2023-12-04T10:45:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.566+0000 7f40fdd7c640 1 Processor -- start 2023-12-04T10:45:06.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.566+0000 7f40fdd7c640 1 -- start start 2023-12-04T10:45:06.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.567+0000 7f40fdd7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 0x7f40f813fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.567+0000 7f40fdd7c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f80ca290 0x7f40f81e5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.567+0000 7f40fdd7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40f8144a00 0x7f40f81e4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.567+0000 7f40fdd7c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f81e6360 con 0x7f40f8144a00 2023-12-04T10:45:06.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.567+0000 7f40fdd7c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40f81e4ab0 con 0x7f40f80ca290 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.567+0000 7f40fdd7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40f81e4d80 con 0x7f40f80701b0 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40f8144a00 0x7f40f81e4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40f8144a00 0x7f40f81e4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36944/0 (socket says 172.21.15.63:36944) 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f7fff640 1 -- 172.21.15.63:0/3931590583 learned_addr learned my addr 172.21.15.63:0/3931590583 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f77fe640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 0x7f40f813fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f6ffd640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f80ca290 0x7f40f81e5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f7fff640 1 -- 172.21.15.63:0/3931590583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 msgr2=0x7f40f813fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f7fff640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 0x7f40f813fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f7fff640 1 -- 172.21.15.63:0/3931590583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f80ca290 msgr2=0x7f40f81e5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f7fff640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f80ca290 0x7f40f81e5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.571 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.568+0000 7f40f7fff640 1 -- 172.21.15.63:0/3931590583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e80094d0 con 0x7f40f8144a00 2023-12-04T10:45:06.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.569+0000 7f40f7fff640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40f8144a00 0x7f40f81e4570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c780 tx=0x7f40f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:06.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.569+0000 7f40dffff640 1 -- 172.21.15.63:0/3931590583 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0004b60 con 0x7f40f8144a00 2023-12-04T10:45:06.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.569+0000 7f40dffff640 1 -- 172.21.15.63:0/3931590583 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f000ce90 con 0x7f40f8144a00 2023-12-04T10:45:06.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.569+0000 7f40dffff640 1 -- 172.21.15.63:0/3931590583 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f000a850 con 0x7f40f8144a00 2023-12-04T10:45:06.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.569+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40f81e5060 con 0x7f40f8144a00 2023-12-04T10:45:06.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.569+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40f81e5620 con 0x7f40f8144a00 2023-12-04T10:45:06.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.571+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40f8068710 con 0x7f40f8144a00 2023-12-04T10:45:06.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.571+0000 7f40dffff640 1 -- 172.21.15.63:0/3931590583 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f40f000a9b0 con 0x7f40f8144a00 2023-12-04T10:45:06.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.572+0000 7f40dffff640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f40e406ae40 0x7f40e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.573+0000 7f40dffff640 1 -- 172.21.15.63:0/3931590583 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f40f0089cc0 con 0x7f40f8144a00 2023-12-04T10:45:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.573+0000 7f40f77fe640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f40e406ae40 0x7f40e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:06.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.574+0000 7f40f77fe640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f40e406ae40 0x7f40e406d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40e8036000 tx=0x7f40e803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:06.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.577+0000 7f40dffff640 1 -- 172.21.15.63:0/3931590583 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f40f0090080 con 0x7f40f8144a00 2023-12-04T10:45:06.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.772+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40f806e2a0 con 0x7f40f8144a00 2023-12-04T10:45:06.774 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.773+0000 7f40dffff640 1 -- 172.21.15.63:0/3931590583 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40f0054880 con 0x7f40f8144a00 2023-12-04T10:45:06.775 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:45:06.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f40e406ae40 msgr2=0x7f40e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f40e406ae40 0x7f40e406d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f40e8036000 tx=0x7f40e803c040 comp rx=0 tx=0).stop 2023-12-04T10:45:06.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40f8144a00 msgr2=0x7f40f81e4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:06.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40f8144a00 0x7f40f81e4570 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c780 tx=0x7f40f000cc40 comp rx=0 tx=0).stop 2023-12-04T10:45:06.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 shutdown_connections 2023-12-04T10:45:06.777 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f40e406ae40 0x7f40e406d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f40f8144a00 0x7f40f81e4570 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f40f80ca290 0x7f40f81e5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 --2- 172.21.15.63:0/3931590583 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f40f80701b0 0x7f40f813fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:06.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 >> 172.21.15.63:0/3931590583 conn(0x7f40f80cee80 msgr2=0x7f40f80cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:06.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 shutdown_connections 2023-12-04T10:45:06.778 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:06.775+0000 7f40fdd7c640 1 -- 172.21.15.63:0/3931590583 wait complete. 2023-12-04T10:45:06.796 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:45:07.022 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.020+0000 7f65a3fff640 1 Processor -- start 2023-12-04T10:45:07.023 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.021+0000 7f65a3fff640 1 -- start start 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.023+0000 7f65a3fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f65a4144370 0x7f65a406be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.023+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.023+0000 7f65a3fff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a406c780 con 0x7f65a4143ca0 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.023+0000 7f65a3fff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a40cb800 con 0x7f65a4144370 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.023+0000 7f65a3fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a40cbae0 con 0x7f65a406c350 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.023+0000 7f659bfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f65a4144370 0x7f65a406be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.023+0000 7f659bfff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f65a4144370 0x7f65a406be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36956/0 (socket says 172.21.15.63:36956) 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.023+0000 7f659bfff640 1 -- 172.21.15.63:0/1012639965 learned_addr learned my addr 172.21.15.63:0/1012639965 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.024+0000 7f65a37fe640 1 --2- 172.21.15.63:0/1012639965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.026 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.024+0000 7f659bfff640 1 -- 172.21.15.63:0/1012639965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 msgr2=0x7f65a40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:07.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.024+0000 7f659bfff640 1 --2- 172.21.15.63:0/1012639965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a40cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.024+0000 7f659bfff640 1 -- 172.21.15.63:0/1012639965 >> v1:172.21.15.66:6789/0 conn(0x7f65a4143ca0 legacy=0x7f65a40b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:07.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.024+0000 7f659bfff640 1 -- 172.21.15.63:0/1012639965 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a40cbdc0 con 0x7f65a4144370 2023-12-04T10:45:07.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.024+0000 7f65a37fe640 1 --2- 172.21.15.63:0/1012639965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a40cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:07.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.025+0000 7f659bfff640 1 --2- 172.21.15.63:0/1012639965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4144370 0x7f65a406be10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f658c009860 tx=0x7f658c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=305d8e445ad8e236 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.025+0000 7f65a27fc640 1 -- 172.21.15.63:0/1012639965 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c031640 con 0x7f65a4144370 2023-12-04T10:45:07.027 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.026+0000 7f65a27fc640 1 -- 172.21.15.63:0/1012639965 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c0317a0 con 0x7f65a4144370 2023-12-04T10:45:07.028 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.026+0000 7f65a27fc640 1 -- 172.21.15.63:0/1012639965 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c031b30 con 0x7f65a4144370 2023-12-04T10:45:07.028 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.026+0000 7f65a3fff640 1 -- 172.21.15.63:0/1012639965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4144370 msgr2=0x7f65a406be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.026+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1012639965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4144370 0x7f65a406be10 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f658c009860 tx=0x7f658c02b8f0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.026+0000 7f65a3fff640 1 -- 172.21.15.63:0/1012639965 shutdown_connections 2023-12-04T10:45:07.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.026+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1012639965 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a40cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.026+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1012639965 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4144370 0x7f65a406be10 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.026+0000 7f65a3fff640 1 -- 172.21.15.63:0/1012639965 >> 172.21.15.63:0/1012639965 conn(0x7f65a40b0860 msgr2=0x7f65a40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:07.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.027+0000 7f65a3fff640 1 -- 172.21.15.63:0/1012639965 shutdown_connections 2023-12-04T10:45:07.029 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.027+0000 7f65a3fff640 1 -- 172.21.15.63:0/1012639965 wait complete. 2023-12-04T10:45:07.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.029+0000 7f65a3fff640 1 Processor -- start 2023-12-04T10:45:07.031 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.030+0000 7f65a3fff640 1 -- start start 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.031+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a413bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.031+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4143ca0 0x7f65a415cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.031+0000 7f65a3fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a4144370 0x7f65a4159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.031+0000 7f65a3fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a415aa70 con 0x7f65a4143ca0 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.031+0000 7f65a3fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a413aee0 con 0x7f65a4144370 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.031+0000 7f65a3fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a413b1c0 con 0x7f65a406c350 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.031+0000 7f659bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4143ca0 0x7f65a415cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f659bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4143ca0 0x7f65a415cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36970/0 (socket says 172.21.15.63:36970) 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f659bfff640 1 -- 172.21.15.63:0/1047457140 learned_addr learned my addr 172.21.15.63:0/1047457140 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f65a2ffd640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a413bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f659bfff640 1 -- 172.21.15.63:0/1047457140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 msgr2=0x7f65a413bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f65a37fe640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a4144370 0x7f65a4159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f659bfff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a413bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f659bfff640 1 -- 172.21.15.63:0/1047457140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a4144370 msgr2=0x7f65a4159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f659bfff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a4144370 0x7f65a4159c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.035 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f659bfff640 1 -- 172.21.15.63:0/1047457140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f658c009470 con 0x7f65a4143ca0 2023-12-04T10:45:07.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.032+0000 7f659bfff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4143ca0 0x7f65a415cbf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f658c0090b0 tx=0x7f658c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.033+0000 7f65a0ff9640 1 -- 172.21.15.63:0/1047457140 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c03bc70 con 0x7f65a4143ca0 2023-12-04T10:45:07.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.033+0000 7f65a0ff9640 1 -- 172.21.15.63:0/1047457140 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f658c03bdd0 con 0x7f65a4143ca0 2023-12-04T10:45:07.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.033+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a413b4a0 con 0x7f65a4143ca0 2023-12-04T10:45:07.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.033+0000 7f65a0ff9640 1 -- 172.21.15.63:0/1047457140 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f658c045630 con 0x7f65a4143ca0 2023-12-04T10:45:07.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.033+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a413ba60 con 0x7f65a4143ca0 2023-12-04T10:45:07.036 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.034+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a413bc50 con 0x7f65a4143ca0 2023-12-04T10:45:07.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.035+0000 7f65a0ff9640 1 -- 172.21.15.63:0/1047457140 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f658c02f050 con 0x7f65a4143ca0 2023-12-04T10:45:07.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.036+0000 7f65a0ff9640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f658406ae40 0x7f658406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.036+0000 7f65a0ff9640 1 -- 172.21.15.63:0/1047457140 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f658c0abaa0 con 0x7f65a4143ca0 2023-12-04T10:45:07.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.036+0000 7f65a2ffd640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f658406ae40 0x7f658406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.039 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.037+0000 7f65a2ffd640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f658406ae40 0x7f658406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6594004ea0 tx=0x7f6594009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.042 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.040+0000 7f65a0ff9640 1 -- 172.21.15.63:0/1047457140 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f658c076780 con 0x7f65a4143ca0 2023-12-04T10:45:07.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.233+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f65a404e840 con 0x7f65a4143ca0 2023-12-04T10:45:07.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.233+0000 7f65a0ff9640 1 -- 172.21.15.63:0/1047457140 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7f658c079da0 con 0x7f65a4143ca0 2023-12-04T10:45:07.235 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:07.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f658406ae40 msgr2=0x7f658406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f658406ae40 0x7f658406d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6594004ea0 tx=0x7f6594009040 comp rx=0 tx=0).stop 2023-12-04T10:45:07.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4143ca0 msgr2=0x7f65a415cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4143ca0 0x7f65a415cbf0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f658c0090b0 tx=0x7f658c0046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 shutdown_connections 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f658406ae40 0x7f658406d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f65a4144370 0x7f65a4159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f65a4143ca0 0x7f65a415cbf0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 --2- 172.21.15.63:0/1047457140 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f65a406c350 0x7f65a413bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 >> 172.21.15.63:0/1047457140 conn(0x7f65a40b0860 msgr2=0x7f65a40ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 shutdown_connections 2023-12-04T10:45:07.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.236+0000 7f65a3fff640 1 -- 172.21.15.63:0/1047457140 wait complete. 2023-12-04T10:45:07.255 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:45:07.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.478+0000 7ff3fabb6640 1 Processor -- start 2023-12-04T10:45:07.480 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.478+0000 7ff3fabb6640 1 -- start start 2023-12-04T10:45:07.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3fabb6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff3f4144a00 0x7ff3f40b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3fabb6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 0x7ff3f40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3fabb6640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3f40b2370 con 0x7ff3f40ca290 2023-12-04T10:45:07.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3fabb6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3f4070b00 con 0x7ff3f4144a00 2023-12-04T10:45:07.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3fabb6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f40cae80 con 0x7ff3f40701b0 2023-12-04T10:45:07.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3f9153640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff3f40ca290 0x7ff3f406d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58106/0 (socket says 172.21.15.63:58106) 2023-12-04T10:45:07.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3f9153640 1 -- 172.21.15.63:0/91710452 learned_addr learned my addr 172.21.15.63:0/91710452 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:07.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3f8952640 1 --2- 172.21.15.63:0/91710452 >> v2:172.21.15.63:3300/0 conn(0x7ff3f4144a00 0x7ff3f40b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3ebfff640 1 --2- 172.21.15.63:0/91710452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 0x7ff3f40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.480+0000 7ff3eb7fe640 1 -- 172.21.15.63:0/91710452 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466130177 0 0) 0x7ff3f40b2370 con 0x7ff3f40ca290 2023-12-04T10:45:07.483 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.481+0000 7ff3eb7fe640 1 -- 172.21.15.63:0/91710452 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff3dc003520 con 0x7ff3f40ca290 2023-12-04T10:45:07.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.481+0000 7ff3f8952640 1 -- 172.21.15.63:0/91710452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 msgr2=0x7ff3f40705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:07.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.481+0000 7ff3f8952640 1 --2- 172.21.15.63:0/91710452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 0x7ff3f40705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.481+0000 7ff3f8952640 1 -- 172.21.15.63:0/91710452 >> v1:172.21.15.63:6789/0 conn(0x7ff3f40ca290 legacy=0x7ff3f406d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.481+0000 7ff3f8952640 1 -- 172.21.15.63:0/91710452 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f406c460 con 0x7ff3f4144a00 2023-12-04T10:45:07.484 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.482+0000 7ff3f8952640 1 --2- 172.21.15.63:0/91710452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f4144a00 0x7ff3f40b1e30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009d90 tx=0x7ff3f002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ace182cd5f3b9cf server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.482+0000 7ff3eb7fe640 1 -- 172.21.15.63:0/91710452 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f002cc60 con 0x7ff3f4144a00 2023-12-04T10:45:07.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.482+0000 7ff3eb7fe640 1 -- 172.21.15.63:0/91710452 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3f002cdc0 con 0x7ff3f4144a00 2023-12-04T10:45:07.485 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.482+0000 7ff3eb7fe640 1 -- 172.21.15.63:0/91710452 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3f0034640 con 0x7ff3f4144a00 2023-12-04T10:45:07.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.483+0000 7ff3fabb6640 1 -- 172.21.15.63:0/91710452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f4144a00 msgr2=0x7ff3f40b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.483+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/91710452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f4144a00 0x7ff3f40b1e30 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0009d90 tx=0x7ff3f002beb0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.483+0000 7ff3fabb6640 1 -- 172.21.15.63:0/91710452 shutdown_connections 2023-12-04T10:45:07.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.483+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/91710452 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 0x7ff3f40705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.483+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/91710452 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f4144a00 0x7ff3f40b1e30 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.483+0000 7ff3fabb6640 1 -- 172.21.15.63:0/91710452 >> 172.21.15.63:0/91710452 conn(0x7ff3f40cee80 msgr2=0x7ff3f40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:07.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.483+0000 7ff3fabb6640 1 -- 172.21.15.63:0/91710452 shutdown_connections 2023-12-04T10:45:07.486 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.483+0000 7ff3fabb6640 1 -- 172.21.15.63:0/91710452 wait complete. 2023-12-04T10:45:07.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.484+0000 7ff3fabb6640 1 Processor -- start 2023-12-04T10:45:07.487 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.485+0000 7ff3fabb6640 1 -- start start 2023-12-04T10:45:07.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.485+0000 7ff3fabb6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 0x7ff3f413f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3fabb6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f40ca290 0x7ff3f4142bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.488 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3fabb6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3f4144a00 0x7ff3f415da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3fabb6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f4141c00 con 0x7ff3f40ca290 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3fabb6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f4141e10 con 0x7ff3f4144a00 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3fabb6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3f41420f0 con 0x7ff3f40701b0 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3ebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f40ca290 0x7ff3f4142bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3ebfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f40ca290 0x7ff3f4142bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:36992/0 (socket says 172.21.15.63:36992) 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3ebfff640 1 -- 172.21.15.63:0/2337164172 learned_addr learned my addr 172.21.15.63:0/2337164172 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3f8952640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 0x7ff3f413f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3ebfff640 1 -- 172.21.15.63:0/2337164172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 msgr2=0x7ff3f413f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3ebfff640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 0x7ff3f413f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3ebfff640 1 -- 172.21.15.63:0/2337164172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3f4144a00 msgr2=0x7ff3f415da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3ebfff640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3f4144a00 0x7ff3f415da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.486+0000 7ff3ebfff640 1 -- 172.21.15.63:0/2337164172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f0009a70 con 0x7ff3f40ca290 2023-12-04T10:45:07.489 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.487+0000 7ff3ebfff640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f40ca290 0x7ff3f4142bd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400d800 tx=0x7ff3e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.487+0000 7ff3e97fa640 1 -- 172.21.15.63:0/2337164172 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400b6c0 con 0x7ff3f40ca290 2023-12-04T10:45:07.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.487+0000 7ff3e97fa640 1 -- 172.21.15.63:0/2337164172 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3e400b820 con 0x7ff3f40ca290 2023-12-04T10:45:07.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.487+0000 7ff3e97fa640 1 -- 172.21.15.63:0/2337164172 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3e400bbb0 con 0x7ff3f40ca290 2023-12-04T10:45:07.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.487+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3f41423d0 con 0x7ff3f40ca290 2023-12-04T10:45:07.490 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.487+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3f413f910 con 0x7ff3f40ca290 2023-12-04T10:45:07.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.488+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3f4068710 con 0x7ff3f40ca290 2023-12-04T10:45:07.491 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.489+0000 7ff3e97fa640 1 -- 172.21.15.63:0/2337164172 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff3e400bd10 con 0x7ff3f40ca290 2023-12-04T10:45:07.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.490+0000 7ff3e97fa640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff3e006ae40 0x7ff3e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.490+0000 7ff3e97fa640 1 -- 172.21.15.63:0/2337164172 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7ff3e4089ff0 con 0x7ff3f40ca290 2023-12-04T10:45:07.492 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.490+0000 7ff3f8952640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff3e006ae40 0x7ff3e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.493 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.491+0000 7ff3f8952640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff3e006ae40 0x7ff3e006d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0036000 tx=0x7ff3f0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.497 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.494+0000 7ff3e97fa640 1 -- 172.21.15.63:0/2337164172 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff3e40bce90 con 0x7ff3f40ca290 2023-12-04T10:45:07.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.684+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3f406e2a0 con 0x7ff3f40ca290 2023-12-04T10:45:07.687 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.685+0000 7ff3e97fa640 1 -- 172.21.15.63:0/2337164172 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff3e4054c60 con 0x7ff3f40ca290 2023-12-04T10:45:07.688 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:45:07.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff3e006ae40 msgr2=0x7ff3e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.690 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff3e006ae40 0x7ff3e006d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff3f0036000 tx=0x7ff3f0030000 comp rx=0 tx=0).stop 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f40ca290 msgr2=0x7ff3f4142bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f40ca290 0x7ff3f4142bd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff3e400d800 tx=0x7ff3e400dcc0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 shutdown_connections 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff3e006ae40 0x7ff3e006d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3f4144a00 0x7ff3f415da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff3f40ca290 0x7ff3f4142bd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 --2- 172.21.15.63:0/2337164172 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff3f40701b0 0x7ff3f413f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 >> 172.21.15.63:0/2337164172 conn(0x7ff3f40cee80 msgr2=0x7ff3f40ce1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 shutdown_connections 2023-12-04T10:45:07.691 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.688+0000 7ff3fabb6640 1 -- 172.21.15.63:0/2337164172 wait complete. 2023-12-04T10:45:07.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:45:07.937 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.935+0000 7fd4b359e640 1 Processor -- start 2023-12-04T10:45:07.938 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.935+0000 7fd4b359e640 1 -- start start 2023-12-04T10:45:07.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.937+0000 7fd4b359e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd4b40cdd90 0x7fd4b40d1800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.937+0000 7fd4b359e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd4b40d1d40 0x7fd4b40b2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.937+0000 7fd4b359e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4b40ceef0 con 0x7fd4b415d5b0 2023-12-04T10:45:07.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.937+0000 7fd4b359e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b40d21d0 con 0x7fd4b40cdd90 2023-12-04T10:45:07.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.937+0000 7fd4b359e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b40d1600 con 0x7fd4b40d1d40 2023-12-04T10:45:07.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4b259c640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd4b415d5b0 0x7fd4b40b2650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58114/0 (socket says 172.21.15.63:58114) 2023-12-04T10:45:07.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4b259c640 1 -- 172.21.15.63:0/2777632798 learned_addr learned my addr 172.21.15.63:0/2777632798 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:07.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4abfff640 1 --2- 172.21.15.63:0/2777632798 >> v2:172.21.15.63:3300/0 conn(0x7fd4b40cdd90 0x7fd4b40d1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4b2d9d640 1 --2- 172.21.15.63:0/2777632798 >> v2:172.21.15.66:3300/0 conn(0x7fd4b40d1d40 0x7fd4b40b2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4abfff640 1 -- 172.21.15.63:0/2777632798 >> v2:172.21.15.66:3300/0 conn(0x7fd4b40d1d40 msgr2=0x7fd4b40b2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:07.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4abfff640 1 --2- 172.21.15.63:0/2777632798 >> v2:172.21.15.66:3300/0 conn(0x7fd4b40d1d40 0x7fd4b40b2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4abfff640 1 -- 172.21.15.63:0/2777632798 >> v1:172.21.15.63:6789/0 conn(0x7fd4b415d5b0 legacy=0x7fd4b40b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4abfff640 1 -- 172.21.15.63:0/2777632798 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b40ce2e0 con 0x7fd4b40cdd90 2023-12-04T10:45:07.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.938+0000 7fd4b1d9b640 1 -- 172.21.15.63:0/2777632798 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731765938 0 0) 0x7fd4b40ceef0 con 0x7fd4b415d5b0 2023-12-04T10:45:07.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.940+0000 7fd4abfff640 1 --2- 172.21.15.63:0/2777632798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b40cdd90 0x7fd4b40d1800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd4b408b9c0 tx=0x7fd49c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=912d4401a0e4cd64 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.940+0000 7fd4b1d9b640 1 -- 172.21.15.63:0/2777632798 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c031830 con 0x7fd4b40cdd90 2023-12-04T10:45:07.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.940+0000 7fd4b1d9b640 1 -- 172.21.15.63:0/2777632798 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd49c031990 con 0x7fd4b40cdd90 2023-12-04T10:45:07.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.940+0000 7fd4b1d9b640 1 -- 172.21.15.63:0/2777632798 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd49c031d20 con 0x7fd4b40cdd90 2023-12-04T10:45:07.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.940+0000 7fd4b359e640 1 -- 172.21.15.63:0/2777632798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b40cdd90 msgr2=0x7fd4b40d1800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.940+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2777632798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b40cdd90 0x7fd4b40d1800 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fd4b408b9c0 tx=0x7fd49c02b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.941+0000 7fd4b359e640 1 -- 172.21.15.63:0/2777632798 shutdown_connections 2023-12-04T10:45:07.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.941+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2777632798 >> v2:172.21.15.66:3300/0 conn(0x7fd4b40d1d40 0x7fd4b40b2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.941+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2777632798 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b40cdd90 0x7fd4b40d1800 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.941+0000 7fd4b359e640 1 -- 172.21.15.63:0/2777632798 >> 172.21.15.63:0/2777632798 conn(0x7fd4b408cbb0 msgr2=0x7fd4b409c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:07.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.941+0000 7fd4b359e640 1 -- 172.21.15.63:0/2777632798 shutdown_connections 2023-12-04T10:45:07.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.941+0000 7fd4b359e640 1 -- 172.21.15.63:0/2777632798 wait complete. 2023-12-04T10:45:07.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.942+0000 7fd4b359e640 1 Processor -- start 2023-12-04T10:45:07.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.943+0000 7fd4b359e640 1 -- start start 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b359e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b40cdd90 0x7fd4b414ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b40d1d40 0x7fd4b415eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b415d5b0 0x7fd4b415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b359e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b415dd80 con 0x7fd4b415d5b0 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b359e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b415f830 con 0x7fd4b40d1d40 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b359e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b415fb10 con 0x7fd4b40cdd90 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b415d5b0 0x7fd4b415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b2d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b415d5b0 0x7fd4b415eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37006/0 (socket says 172.21.15.63:37006) 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b2d9d640 1 -- 172.21.15.63:0/2062922401 learned_addr learned my addr 172.21.15.63:0/2062922401 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4abfff640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b40d1d40 0x7fd4b415eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b259c640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b40cdd90 0x7fd4b414ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b2d9d640 1 -- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b40cdd90 msgr2=0x7fd4b414ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b2d9d640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b40cdd90 0x7fd4b414ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b2d9d640 1 -- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b40d1d40 msgr2=0x7fd4b415eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b2d9d640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b40d1d40 0x7fd4b415eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4b2d9d640 1 -- 172.21.15.63:0/2062922401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd49c009400 con 0x7fd4b415d5b0 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.944+0000 7fd4abfff640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b40d1d40 0x7fd4b415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.945+0000 7fd4b2d9d640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b415d5b0 0x7fd4b415eff0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00efc0 tx=0x7fd4ac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.945+0000 7fd4aaffd640 1 -- 172.21.15.63:0/2062922401 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac014480 con 0x7fd4b415d5b0 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.945+0000 7fd4aaffd640 1 -- 172.21.15.63:0/2062922401 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4ac00f040 con 0x7fd4b415d5b0 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.945+0000 7fd4aaffd640 1 -- 172.21.15.63:0/2062922401 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4ac014820 con 0x7fd4b415d5b0 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.945+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b415fdf0 con 0x7fd4b415d5b0 2023-12-04T10:45:07.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.945+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b41603b0 con 0x7fd4b415d5b0 2023-12-04T10:45:07.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.946+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b41605a0 con 0x7fd4b415d5b0 2023-12-04T10:45:07.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.948+0000 7fd4aaffd640 1 -- 172.21.15.63:0/2062922401 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd4ac014980 con 0x7fd4b415d5b0 2023-12-04T10:45:07.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.948+0000 7fd4aaffd640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd49406ae70 0x7fd49406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:07.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.949+0000 7fd4aaffd640 1 -- 172.21.15.63:0/2062922401 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd4ac08a650 con 0x7fd4b415d5b0 2023-12-04T10:45:07.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.949+0000 7fd4b259c640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd49406ae70 0x7fd49406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:07.951 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.949+0000 7fd4b259c640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd49406ae70 0x7fd49406d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4000f60 tx=0x7fd4a4007c00 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:07.955 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:07.953+0000 7fd4aaffd640 1 -- 172.21.15.63:0/2062922401 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd4ac0552a0 con 0x7fd4b415d5b0 2023-12-04T10:45:08.148 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.146+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fd4b404e840 con 0x7fd4b415d5b0 2023-12-04T10:45:08.149 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.147+0000 7fd4aaffd640 1 -- 172.21.15.63:0/2062922401 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fd4ac0588c0 con 0x7fd4b415d5b0 2023-12-04T10:45:08.150 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd49406ae70 msgr2=0x7fd49406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd49406ae70 0x7fd49406d330 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4000f60 tx=0x7fd4a4007c00 comp rx=0 tx=0).stop 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b415d5b0 msgr2=0x7fd4b415eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b415d5b0 0x7fd4b415eff0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac00efc0 tx=0x7fd4ac00c490 comp rx=0 tx=0).stop 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 shutdown_connections 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd49406ae70 0x7fd49406d330 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd4b415d5b0 0x7fd4b415eff0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd4b40d1d40 0x7fd4b415eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 --2- 172.21.15.63:0/2062922401 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd4b40cdd90 0x7fd4b414ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 >> 172.21.15.63:0/2062922401 conn(0x7fd4b408cbb0 msgr2=0x7fd4b40cf380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:08.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 shutdown_connections 2023-12-04T10:45:08.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.151+0000 7fd4b359e640 1 -- 172.21.15.63:0/2062922401 wait complete. 2023-12-04T10:45:08.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T10:45:08.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.397+0000 7efe54e27640 1 Processor -- start 2023-12-04T10:45:08.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.397+0000 7efe54e27640 1 -- start start 2023-12-04T10:45:08.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.398+0000 7efe54e27640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe500cad70 0x7efe500cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:08.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.398+0000 7efe54e27640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe500cbb70 0x7efe5006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.398+0000 7efe54e27640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe5015a300 con 0x7efe50159f20 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.398+0000 7efe54e27640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe500723f0 con 0x7efe500cad70 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.398+0000 7efe54e27640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe500cbfe0 con 0x7efe500cbb70 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.399+0000 7efe4effd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe500cad70 0x7efe500cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.399+0000 7efe4effd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7efe500cad70 0x7efe500cb630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37014/0 (socket says 172.21.15.63:37014) 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.399+0000 7efe4effd640 1 -- 172.21.15.63:0/1469446948 learned_addr learned my addr 172.21.15.63:0/1469446948 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.399+0000 7efe4ffff640 1 --2- 172.21.15.63:0/1469446948 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe500cbb70 0x7efe5006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.399+0000 7efe4effd640 1 -- 172.21.15.63:0/1469446948 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe500cbb70 msgr2=0x7efe5006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.399+0000 7efe4effd640 1 --2- 172.21.15.63:0/1469446948 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe500cbb70 0x7efe5006c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.399+0000 7efe4effd640 1 -- 172.21.15.63:0/1469446948 >> v1:172.21.15.66:6789/0 conn(0x7efe50159f20 legacy=0x7efe50070df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:08.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.399+0000 7efe4effd640 1 -- 172.21.15.63:0/1469446948 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe500ca040 con 0x7efe500cad70 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.401+0000 7efe4effd640 1 --2- 172.21.15.63:0/1469446948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe500cb630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe38009e80 tx=0x7efe3802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4c9dc8aee389dff server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.401+0000 7efe4e7fc640 1 -- 172.21.15.63:0/1469446948 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3802ca50 con 0x7efe500cad70 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.401+0000 7efe4e7fc640 1 -- 172.21.15.63:0/1469446948 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3802cbb0 con 0x7efe500cad70 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.401+0000 7efe4e7fc640 1 -- 172.21.15.63:0/1469446948 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe380343f0 con 0x7efe500cad70 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.402+0000 7efe54e27640 1 -- 172.21.15.63:0/1469446948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 msgr2=0x7efe500cb630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.402+0000 7efe54e27640 1 --2- 172.21.15.63:0/1469446948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe500cb630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7efe38009e80 tx=0x7efe3802beb0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.402+0000 7efe54e27640 1 -- 172.21.15.63:0/1469446948 shutdown_connections 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.402+0000 7efe54e27640 1 --2- 172.21.15.63:0/1469446948 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe500cbb70 0x7efe5006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.402+0000 7efe54e27640 1 --2- 172.21.15.63:0/1469446948 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe500cb630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.402+0000 7efe54e27640 1 -- 172.21.15.63:0/1469446948 >> 172.21.15.63:0/1469446948 conn(0x7efe500b07f0 msgr2=0x7efe500b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:08.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.402+0000 7efe54e27640 1 -- 172.21.15.63:0/1469446948 shutdown_connections 2023-12-04T10:45:08.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.402+0000 7efe54e27640 1 -- 172.21.15.63:0/1469446948 wait complete. 2023-12-04T10:45:08.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.404+0000 7efe54e27640 1 Processor -- start 2023-12-04T10:45:08.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.404+0000 7efe54e27640 1 -- start start 2023-12-04T10:45:08.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe54e27640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe5014d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:08.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe54e27640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe500cbb70 0x7efe500c2b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:08.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe54e27640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe50159f20 0x7efe500c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe54e27640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500c85f0 con 0x7efe500cad70 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe54e27640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe500c8a10 con 0x7efe500cbb70 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe54e27640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe500c3500 con 0x7efe50159f20 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe4f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe5014d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe4f7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe5014d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37020/0 (socket says 172.21.15.63:37020) 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe4f7fe640 1 -- 172.21.15.63:0/602132280 learned_addr learned my addr 172.21.15.63:0/602132280 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe4ffff640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe50159f20 0x7efe500c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe4f7fe640 1 -- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe50159f20 msgr2=0x7efe500c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe4f7fe640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe50159f20 0x7efe500c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe4effd640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe500cbb70 0x7efe500c2b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.405+0000 7efe4f7fe640 1 -- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe500cbb70 msgr2=0x7efe500c2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe4f7fe640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe500cbb70 0x7efe500c2b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe4f7fe640 1 -- 172.21.15.63:0/602132280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe38009b30 con 0x7efe500cad70 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe4ffff640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe50159f20 0x7efe500c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:08.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe4effd640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe500cbb70 0x7efe500c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:08.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe4f7fe640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe5014d560 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efe4000c430 tx=0x7efe4000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:08.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe47fff640 1 -- 172.21.15.63:0/602132280 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40011790 con 0x7efe500cad70 2023-12-04T10:45:08.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe47fff640 1 -- 172.21.15.63:0/602132280 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe400118f0 con 0x7efe500cad70 2023-12-04T10:45:08.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe5014ee50 con 0x7efe500cad70 2023-12-04T10:45:08.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe47fff640 1 -- 172.21.15.63:0/602132280 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe40011ce0 con 0x7efe500cad70 2023-12-04T10:45:08.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.406+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe5014f3d0 con 0x7efe500cad70 2023-12-04T10:45:08.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.408+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe500c8730 con 0x7efe500cad70 2023-12-04T10:45:08.410 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.408+0000 7efe47fff640 1 -- 172.21.15.63:0/602132280 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe4001c460 con 0x7efe500cad70 2023-12-04T10:45:08.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.409+0000 7efe47fff640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efe3006ae40 0x7efe3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:08.411 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.410+0000 7efe47fff640 1 -- 172.21.15.63:0/602132280 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7efe40089890 con 0x7efe500cad70 2023-12-04T10:45:08.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.410+0000 7efe4effd640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efe3006ae40 0x7efe3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:08.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.410+0000 7efe4effd640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efe3006ae40 0x7efe3006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe38035000 tx=0x7efe38030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:08.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.414+0000 7efe47fff640 1 -- 172.21.15.63:0/602132280 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe500c8730 con 0x7efe500cad70 2023-12-04T10:45:08.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.622+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efe500c8730 con 0x7efe500cad70 2023-12-04T10:45:08.624 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.623+0000 7efe47fff640 1 -- 172.21.15.63:0/602132280 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7efe500c8730 con 0x7efe500cad70 2023-12-04T10:45:08.625 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efe3006ae40 msgr2=0x7efe3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efe3006ae40 0x7efe3006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7efe38035000 tx=0x7efe38030000 comp rx=0 tx=0).stop 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 msgr2=0x7efe5014d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe5014d560 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7efe4000c430 tx=0x7efe4000c8f0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 shutdown_connections 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7efe3006ae40 0x7efe3006d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7efe50159f20 0x7efe500c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7efe500cbb70 0x7efe500c2b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.628 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 --2- 172.21.15.63:0/602132280 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7efe500cad70 0x7efe5014d560 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:08.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 >> 172.21.15.63:0/602132280 conn(0x7efe500b07f0 msgr2=0x7efe500cca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:08.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 shutdown_connections 2023-12-04T10:45:08.629 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:08.626+0000 7efe54e27640 1 -- 172.21.15.63:0/602132280 wait complete. 2023-12-04T10:45:08.645 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-04T10:45:08.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:08.646 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-04T10:45:08.772 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T10:45:08.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:08.772 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T10:45:08.838 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:45:08.838 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:08.903 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:45:08.903 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:08.962 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:45:08.962 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:09.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:09.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.246+0000 7f89bc3b6640 1 Processor -- start 2023-12-04T10:45:09.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.246+0000 7f89bc3b6640 1 -- start start 2023-12-04T10:45:09.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89bc3b6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b4143b60 0x7f89b40ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89bc3b6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f89b40724e0 0x7f89b40cdb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89bc3b6640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b40ca930 con 0x7f89b40c81b0 2023-12-04T10:45:09.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89bc3b6640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b40cb5b0 con 0x7f89b40724e0 2023-12-04T10:45:09.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89bc3b6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b40cac10 con 0x7f89b4143b60 2023-12-04T10:45:09.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89ba953640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f89b40c81b0 0x7f89b40cca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58120/0 (socket says 172.21.15.63:58120) 2023-12-04T10:45:09.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89ba953640 1 -- 172.21.15.63:0/4004692361 learned_addr learned my addr 172.21.15.63:0/4004692361 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:09.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89b9951640 1 --2- 172.21.15.63:0/4004692361 >> v2:172.21.15.63:3300/0 conn(0x7f89b40724e0 0x7f89b40cdb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89ba152640 1 --2- 172.21.15.63:0/4004692361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b4143b60 0x7f89b40ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89b9150640 1 -- 172.21.15.63:0/4004692361 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235608290 0 0) 0x7f89b40ca930 con 0x7f89b40c81b0 2023-12-04T10:45:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89b9951640 1 -- 172.21.15.63:0/4004692361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b4143b60 msgr2=0x7f89b40ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89b9951640 1 --2- 172.21.15.63:0/4004692361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b4143b60 0x7f89b40ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89b9951640 1 -- 172.21.15.63:0/4004692361 >> v1:172.21.15.63:6789/0 conn(0x7f89b40c81b0 legacy=0x7f89b40cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.249+0000 7f89b9951640 1 -- 172.21.15.63:0/4004692361 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b40caef0 con 0x7f89b40724e0 2023-12-04T10:45:09.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.250+0000 7f89b9951640 1 --2- 172.21.15.63:0/4004692361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b40724e0 0x7f89b40cdb00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f89a80097a0 tx=0x7f89a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5130b5e765661ed server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:09.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.251+0000 7f89b9150640 1 -- 172.21.15.63:0/4004692361 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8031830 con 0x7f89b40724e0 2023-12-04T10:45:09.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.251+0000 7f89b9150640 1 -- 172.21.15.63:0/4004692361 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a8031990 con 0x7f89b40724e0 2023-12-04T10:45:09.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.251+0000 7f89b9150640 1 -- 172.21.15.63:0/4004692361 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a8031d20 con 0x7f89b40724e0 2023-12-04T10:45:09.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.251+0000 7f89bc3b6640 1 -- 172.21.15.63:0/4004692361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b40724e0 msgr2=0x7f89b40cdb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.251+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/4004692361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b40724e0 0x7f89b40cdb00 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f89a80097a0 tx=0x7f89a802b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.251+0000 7f89bc3b6640 1 -- 172.21.15.63:0/4004692361 shutdown_connections 2023-12-04T10:45:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.251+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/4004692361 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b40724e0 0x7f89b40cdb00 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.252+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/4004692361 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b4143b60 0x7f89b40ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.252+0000 7f89bc3b6640 1 -- 172.21.15.63:0/4004692361 >> 172.21.15.63:0/4004692361 conn(0x7f89b40cee80 msgr2=0x7f89b40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.252+0000 7f89bc3b6640 1 -- 172.21.15.63:0/4004692361 shutdown_connections 2023-12-04T10:45:09.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.252+0000 7f89bc3b6640 1 -- 172.21.15.63:0/4004692361 wait complete. 2023-12-04T10:45:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.253+0000 7f89bc3b6640 1 Processor -- start 2023-12-04T10:45:09.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.254+0000 7f89bc3b6640 1 -- start start 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89bc3b6640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b40c81b0 0x7f89b40b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89bc3b6640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b4143b60 0x7f89b4155a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89bc3b6640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b40b2470 0x7f89b4133930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89bc3b6640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b40b2930 con 0x7f89b4143b60 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89bc3b6640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b40b2c10 con 0x7f89b40b2470 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89bc3b6640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b40b2ef0 con 0x7f89b40c81b0 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89b9951640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b4143b60 0x7f89b4155a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89b9951640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b4143b60 0x7f89b4155a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37040/0 (socket says 172.21.15.63:37040) 2023-12-04T10:45:09.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89b9951640 1 -- 172.21.15.63:0/3132271018 learned_addr learned my addr 172.21.15.63:0/3132271018 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:09.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89b9951640 1 -- 172.21.15.63:0/3132271018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b40c81b0 msgr2=0x7f89b40b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89ba152640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b40c81b0 0x7f89b40b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89ba953640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b40b2470 0x7f89b4133930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89b9951640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b40c81b0 0x7f89b40b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89b9951640 1 -- 172.21.15.63:0/3132271018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b40b2470 msgr2=0x7f89b4133930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89b9951640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b40b2470 0x7f89b4133930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.255+0000 7f89b9951640 1 -- 172.21.15.63:0/3132271018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a8009400 con 0x7f89b4143b60 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.256+0000 7f89b9951640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b4143b60 0x7f89b4155a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89a802bee0 tx=0x7f89a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.256+0000 7f89b2ffd640 1 -- 172.21.15.63:0/3132271018 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a803a6f0 con 0x7f89b4143b60 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.256+0000 7f89b2ffd640 1 -- 172.21.15.63:0/3132271018 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a803a870 con 0x7f89b4143b60 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.256+0000 7f89b2ffd640 1 -- 172.21.15.63:0/3132271018 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a803ac20 con 0x7f89b4143b60 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.256+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b40b31d0 con 0x7f89b4143b60 2023-12-04T10:45:09.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.256+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b4142c10 con 0x7f89b4143b60 2023-12-04T10:45:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.258+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b40b3f10 con 0x7f89b4143b60 2023-12-04T10:45:09.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.258+0000 7f89b2ffd640 1 -- 172.21.15.63:0/3132271018 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89a8030380 con 0x7f89b4143b60 2023-12-04T10:45:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.259+0000 7f89b2ffd640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f89a006ae70 0x7f89a006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.259+0000 7f89b2ffd640 1 -- 172.21.15.63:0/3132271018 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f89a80ab360 con 0x7f89b4143b60 2023-12-04T10:45:09.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.260+0000 7f89ba152640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f89a006ae70 0x7f89a006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.260+0000 7f89ba152640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f89a006ae70 0x7f89a006d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009e90 tx=0x7f89a400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:09.265 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.264+0000 7f89b2ffd640 1 -- 172.21.15.63:0/3132271018 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89a8076050 con 0x7f89b4143b60 2023-12-04T10:45:09.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.461+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89b4068710 con 0x7f89b4143b60 2023-12-04T10:45:09.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.464+0000 7f89b2ffd640 1 -- 172.21.15.63:0/3132271018 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f89a8079670 con 0x7f89b4143b60 2023-12-04T10:45:09.467 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:09.467 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:09.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f89a006ae70 msgr2=0x7f89a006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f89a006ae70 0x7f89a006d330 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f89a4009e90 tx=0x7f89a400b040 comp rx=0 tx=0).stop 2023-12-04T10:45:09.469 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b4143b60 msgr2=0x7f89b4155a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b4143b60 0x7f89b4155a80 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f89a802bee0 tx=0x7f89a80046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 shutdown_connections 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f89a006ae70 0x7f89a006d330 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f89b40b2470 0x7f89b4133930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f89b4143b60 0x7f89b4155a80 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 --2- 172.21.15.63:0/3132271018 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f89b40c81b0 0x7f89b40b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 >> 172.21.15.63:0/3132271018 conn(0x7f89b40cee80 msgr2=0x7f89b41563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 shutdown_connections 2023-12-04T10:45:09.470 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.468+0000 7f89bc3b6640 1 -- 172.21.15.63:0/3132271018 wait complete. 2023-12-04T10:45:09.491 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:45:09.491 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:45:09.717 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.716+0000 7fd889e7c640 1 Processor -- start 2023-12-04T10:45:09.718 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.716+0000 7fd889e7c640 1 -- start start 2023-12-04T10:45:09.719 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd889e7c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd8840724e0 0x7fd8840ca330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd889e7c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8840ca930 con 0x7fd8840ce210 2023-12-04T10:45:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd889e7c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8840cac10 con 0x7fd884143b60 2023-12-04T10:45:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd889e7c640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8840cb5b0 con 0x7fd8840724e0 2023-12-04T10:45:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd883fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd8840ce210 0x7fd88406c560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58128/0 (socket says 172.21.15.63:58128) 2023-12-04T10:45:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd883fff640 1 -- 172.21.15.63:0/3072930437 learned_addr learned my addr 172.21.15.63:0/3072930437 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:09.720 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd882ffd640 1 --2- 172.21.15.63:0/3072930437 >> v2:172.21.15.63:3300/0 conn(0x7fd8840724e0 0x7fd8840ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd882ffd640 1 -- 172.21.15.63:0/3072930437 >> v1:172.21.15.66:6789/0 conn(0x7fd884143b60 legacy=0x7fd8840cdb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:09.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd882ffd640 1 -- 172.21.15.63:0/3072930437 >> v1:172.21.15.63:6789/0 conn(0x7fd8840ce210 legacy=0x7fd88406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd882ffd640 1 -- 172.21.15.63:0/3072930437 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8840caef0 con 0x7fd8840724e0 2023-12-04T10:45:09.721 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.718+0000 7fd8827fc640 1 -- 172.21.15.63:0/3072930437 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3907141911 0 0) 0x7fd8840ca930 con 0x7fd8840ce210 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.719+0000 7fd882ffd640 1 --2- 172.21.15.63:0/3072930437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8840724e0 0x7fd8840ca330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd8780097a0 tx=0x7fd87802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbee478de194b4c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.720+0000 7fd8827fc640 1 -- 172.21.15.63:0/3072930437 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878031830 con 0x7fd8840724e0 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.720+0000 7fd8827fc640 1 -- 172.21.15.63:0/3072930437 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878031990 con 0x7fd8840724e0 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.720+0000 7fd8827fc640 1 -- 172.21.15.63:0/3072930437 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878031d20 con 0x7fd8840724e0 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.720+0000 7fd889e7c640 1 -- 172.21.15.63:0/3072930437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8840724e0 msgr2=0x7fd8840ca330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.720+0000 7fd889e7c640 1 --2- 172.21.15.63:0/3072930437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8840724e0 0x7fd8840ca330 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd8780097a0 tx=0x7fd87802b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.720+0000 7fd889e7c640 1 -- 172.21.15.63:0/3072930437 shutdown_connections 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.720+0000 7fd889e7c640 1 --2- 172.21.15.63:0/3072930437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd8840724e0 0x7fd8840ca330 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.725 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.720+0000 7fd889e7c640 1 -- 172.21.15.63:0/3072930437 >> 172.21.15.63:0/3072930437 conn(0x7fd8840cee80 msgr2=0x7fd8840cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:09.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.721+0000 7fd889e7c640 1 -- 172.21.15.63:0/3072930437 shutdown_connections 2023-12-04T10:45:09.726 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.721+0000 7fd889e7c640 1 -- 172.21.15.63:0/3072930437 wait complete. 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.722+0000 7fd889e7c640 1 Processor -- start 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.722+0000 7fd889e7c640 1 -- start start 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.723+0000 7fd889e7c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8840ce210 0x7fd8840b3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.723+0000 7fd889e7c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd884143b60 0x7fd884153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.723+0000 7fd889e7c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88415c7f0 0x7fd884139520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.723+0000 7fd889e7c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8841393b0 con 0x7fd88415c7f0 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.723+0000 7fd889e7c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8840b45e0 con 0x7fd884143b60 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.723+0000 7fd889e7c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd88415cfb0 con 0x7fd8840ce210 2023-12-04T10:45:09.728 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd883fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88415c7f0 0x7fd884139520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd883fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88415c7f0 0x7fd884139520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37050/0 (socket says 172.21.15.63:37050) 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd883fff640 1 -- 172.21.15.63:0/1284687900 learned_addr learned my addr 172.21.15.63:0/1284687900 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd882ffd640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd884143b60 0x7fd884153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd8837fe640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8840ce210 0x7fd8840b3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd883fff640 1 -- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8840ce210 msgr2=0x7fd8840b3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd883fff640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8840ce210 0x7fd8840b3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd883fff640 1 -- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd884143b60 msgr2=0x7fd884153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd883fff640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd884143b60 0x7fd884153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd883fff640 1 -- 172.21.15.63:0/1284687900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd878009400 con 0x7fd88415c7f0 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.724+0000 7fd882ffd640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd884143b60 0x7fd884153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.725+0000 7fd883fff640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88415c7f0 0x7fd884139520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00c7e0 tx=0x7fd87c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.725+0000 7fd86bfff640 1 -- 172.21.15.63:0/1284687900 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00a640 con 0x7fd88415c7f0 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.725+0000 7fd86bfff640 1 -- 172.21.15.63:0/1284687900 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd87c00a7c0 con 0x7fd88415c7f0 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.725+0000 7fd86bfff640 1 -- 172.21.15.63:0/1284687900 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd87c00ab70 con 0x7fd88415c7f0 2023-12-04T10:45:09.729 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.725+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8840b3d40 con 0x7fd88415c7f0 2023-12-04T10:45:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.725+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8840b4300 con 0x7fd88415c7f0 2023-12-04T10:45:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.726+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd884068710 con 0x7fd88415c7f0 2023-12-04T10:45:09.730 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.727+0000 7fd86bfff640 1 -- 172.21.15.63:0/1284687900 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd87c00acd0 con 0x7fd88415c7f0 2023-12-04T10:45:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.728+0000 7fd86bfff640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87006ae40 0x7fd87006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.728+0000 7fd86bfff640 1 -- 172.21.15.63:0/1284687900 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd87c089090 con 0x7fd88415c7f0 2023-12-04T10:45:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.728+0000 7fd8837fe640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87006ae40 0x7fd87006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:09.731 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.729+0000 7fd8837fe640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87006ae40 0x7fd87006d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd87400a750 tx=0x7fd874008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:09.734 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.733+0000 7fd86bfff640 1 -- 172.21.15.63:0/1284687900 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd87c053ce0 con 0x7fd88415c7f0 2023-12-04T10:45:09.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.927+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8840cd8e0 con 0x7fd88415c7f0 2023-12-04T10:45:09.930 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.928+0000 7fd86bfff640 1 -- 172.21.15.63:0/1284687900 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd87c018020 con 0x7fd88415c7f0 2023-12-04T10:45:09.930 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:45:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87006ae40 msgr2=0x7fd87006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87006ae40 0x7fd87006d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd87400a750 tx=0x7fd874008040 comp rx=0 tx=0).stop 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88415c7f0 msgr2=0x7fd884139520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88415c7f0 0x7fd884139520 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd87c00c7e0 tx=0x7fd87c00cca0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 shutdown_connections 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87006ae40 0x7fd87006d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd88415c7f0 0x7fd884139520 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd884143b60 0x7fd884153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 --2- 172.21.15.63:0/1284687900 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd8840ce210 0x7fd8840b3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 >> 172.21.15.63:0/1284687900 conn(0x7fd8840cee80 msgr2=0x7fd8840aeaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 shutdown_connections 2023-12-04T10:45:09.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:09.931+0000 7fd889e7c640 1 -- 172.21.15.63:0/1284687900 wait complete. 2023-12-04T10:45:09.952 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:45:10.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.174+0000 7fd1894cf640 1 Processor -- start 2023-12-04T10:45:10.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.175+0000 7fd1894cf640 1 -- start start 2023-12-04T10:45:10.178 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.176+0000 7fd1894cf640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd184144a00 0x7fd1840b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.176+0000 7fd1894cf640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd1840ca290 0x7fd1840ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.176+0000 7fd1894cf640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1840b2370 con 0x7fd1840701b0 2023-12-04T10:45:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.176+0000 7fd1894cf640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1840cabe0 con 0x7fd1840ca290 2023-12-04T10:45:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.176+0000 7fd1894cf640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1840cae80 con 0x7fd184144a00 2023-12-04T10:45:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd1827fc640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd1840701b0 0x7fd1840705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58144/0 (socket says 172.21.15.63:58144) 2023-12-04T10:45:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd1827fc640 1 -- 172.21.15.63:0/2822879488 learned_addr learned my addr 172.21.15.63:0/2822879488 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:10.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd1837fe640 1 --2- 172.21.15.63:0/2822879488 >> v2:172.21.15.63:3300/0 conn(0x7fd1840ca290 0x7fd1840ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd182ffd640 1 --2- 172.21.15.63:0/2822879488 >> v2:172.21.15.66:3300/0 conn(0x7fd184144a00 0x7fd1840b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd181ffb640 1 -- 172.21.15.63:0/2822879488 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573196500 0 0) 0x7fd1840b2370 con 0x7fd1840701b0 2023-12-04T10:45:10.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd181ffb640 1 -- 172.21.15.63:0/2822879488 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd170003520 con 0x7fd1840701b0 2023-12-04T10:45:10.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd1837fe640 1 -- 172.21.15.63:0/2822879488 >> v2:172.21.15.66:3300/0 conn(0x7fd184144a00 msgr2=0x7fd1840b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:10.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd1837fe640 1 --2- 172.21.15.63:0/2822879488 >> v2:172.21.15.66:3300/0 conn(0x7fd184144a00 0x7fd1840b1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd1837fe640 1 -- 172.21.15.63:0/2822879488 >> v1:172.21.15.63:6789/0 conn(0x7fd1840701b0 legacy=0x7fd1840705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.177+0000 7fd1837fe640 1 -- 172.21.15.63:0/2822879488 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18406c460 con 0x7fd1840ca290 2023-12-04T10:45:10.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.179+0000 7fd1837fe640 1 --2- 172.21.15.63:0/2822879488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1840ca290 0x7fd1840ca6a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd184074670 tx=0x7fd17c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ee7e8339ae308f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:10.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.179+0000 7fd181ffb640 1 -- 172.21.15.63:0/2822879488 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c031830 con 0x7fd1840ca290 2023-12-04T10:45:10.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.179+0000 7fd181ffb640 1 -- 172.21.15.63:0/2822879488 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c031990 con 0x7fd1840ca290 2023-12-04T10:45:10.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.179+0000 7fd181ffb640 1 -- 172.21.15.63:0/2822879488 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c031d20 con 0x7fd1840ca290 2023-12-04T10:45:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.179+0000 7fd1894cf640 1 -- 172.21.15.63:0/2822879488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1840ca290 msgr2=0x7fd1840ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.179+0000 7fd1894cf640 1 --2- 172.21.15.63:0/2822879488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1840ca290 0x7fd1840ca6a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd184074670 tx=0x7fd17c02b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.180+0000 7fd1894cf640 1 -- 172.21.15.63:0/2822879488 shutdown_connections 2023-12-04T10:45:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.180+0000 7fd1894cf640 1 --2- 172.21.15.63:0/2822879488 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd1840ca290 0x7fd1840ca6a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.180+0000 7fd1894cf640 1 --2- 172.21.15.63:0/2822879488 >> v2:172.21.15.66:3300/0 conn(0x7fd184144a00 0x7fd1840b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.180+0000 7fd1894cf640 1 -- 172.21.15.63:0/2822879488 >> 172.21.15.63:0/2822879488 conn(0x7fd1840cee80 msgr2=0x7fd1840cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.180+0000 7fd1894cf640 1 -- 172.21.15.63:0/2822879488 shutdown_connections 2023-12-04T10:45:10.182 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.180+0000 7fd1894cf640 1 -- 172.21.15.63:0/2822879488 wait complete. 2023-12-04T10:45:10.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.181+0000 7fd1894cf640 1 Processor -- start 2023-12-04T10:45:10.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.182+0000 7fd1894cf640 1 -- start start 2023-12-04T10:45:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.182+0000 7fd1894cf640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1840701b0 0x7fd1841f3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.182+0000 7fd1894cf640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1840ca290 0x7fd18413b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.182+0000 7fd1894cf640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd184144a00 0x7fd1840cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1894cf640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18413d360 con 0x7fd184144a00 2023-12-04T10:45:10.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1894cf640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18413d5b0 con 0x7fd1840701b0 2023-12-04T10:45:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1894cf640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18413d890 con 0x7fd1840ca290 2023-12-04T10:45:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd184144a00 0x7fd1840cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1837fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd184144a00 0x7fd1840cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37056/0 (socket says 172.21.15.63:37056) 2023-12-04T10:45:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1837fe640 1 -- 172.21.15.63:0/1092637715 learned_addr learned my addr 172.21.15.63:0/1092637715 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:10.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd182ffd640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1840701b0 0x7fd1841f3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1837fe640 1 -- 172.21.15.63:0/1092637715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1840ca290 msgr2=0x7fd18413b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1837fe640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1840ca290 0x7fd18413b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1837fe640 1 -- 172.21.15.63:0/1092637715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1840701b0 msgr2=0x7fd1841f3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1837fe640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1840701b0 0x7fd1841f3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.183+0000 7fd1837fe640 1 -- 172.21.15.63:0/1092637715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17c009400 con 0x7fd184144a00 2023-12-04T10:45:10.188 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.184+0000 7fd1837fe640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd184144a00 0x7fd1840cdc80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd17c02bee0 tx=0x7fd17c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.184+0000 7fd17b7fe640 1 -- 172.21.15.63:0/1092637715 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c03b970 con 0x7fd184144a00 2023-12-04T10:45:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.184+0000 7fd17b7fe640 1 -- 172.21.15.63:0/1092637715 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd17c03baf0 con 0x7fd184144a00 2023-12-04T10:45:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.184+0000 7fd17b7fe640 1 -- 172.21.15.63:0/1092637715 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17c03bea0 con 0x7fd184144a00 2023-12-04T10:45:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.184+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18413db70 con 0x7fd184144a00 2023-12-04T10:45:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.184+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18413e130 con 0x7fd184144a00 2023-12-04T10:45:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.185+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd184068710 con 0x7fd184144a00 2023-12-04T10:45:10.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.186+0000 7fd17b7fe640 1 -- 172.21.15.63:0/1092637715 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd17c04e440 con 0x7fd184144a00 2023-12-04T10:45:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.187+0000 7fd17b7fe640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd16406ae40 0x7fd16406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.187+0000 7fd17b7fe640 1 -- 172.21.15.63:0/1092637715 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fd17c0abb10 con 0x7fd184144a00 2023-12-04T10:45:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.188+0000 7fd182ffd640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd16406ae40 0x7fd16406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.190 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.188+0000 7fd182ffd640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd16406ae40 0x7fd16406d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd174009e90 tx=0x7fd17400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:10.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.192+0000 7fd17b7fe640 1 -- 172.21.15.63:0/1092637715 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd17c076800 con 0x7fd184144a00 2023-12-04T10:45:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.390+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd18406e2a0 con 0x7fd184144a00 2023-12-04T10:45:10.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.391+0000 7fd17b7fe640 1 -- 172.21.15.63:0/1092637715 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd17c035020 con 0x7fd184144a00 2023-12-04T10:45:10.393 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.393+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd16406ae40 msgr2=0x7fd16406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.393+0000 7fd1894cf640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd16406ae40 0x7fd16406d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd174009e90 tx=0x7fd17400b040 comp rx=0 tx=0).stop 2023-12-04T10:45:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.393+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd184144a00 msgr2=0x7fd1840cdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.393+0000 7fd1894cf640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd184144a00 0x7fd1840cdc80 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd17c02bee0 tx=0x7fd17c0046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.394+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 shutdown_connections 2023-12-04T10:45:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.394+0000 7fd1894cf640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd16406ae40 0x7fd16406d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.394+0000 7fd1894cf640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd1840ca290 0x7fd18413b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.394+0000 7fd1894cf640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd184144a00 0x7fd1840cdc80 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.394+0000 7fd1894cf640 1 --2- 172.21.15.63:0/1092637715 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1840701b0 0x7fd1841f3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.394+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 >> 172.21.15.63:0/1092637715 conn(0x7fd1840cee80 msgr2=0x7fd1840c3da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.394+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 shutdown_connections 2023-12-04T10:45:10.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.394+0000 7fd1894cf640 1 -- 172.21.15.63:0/1092637715 wait complete. 2023-12-04T10:45:10.416 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:45:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.648+0000 7fc2da5de640 1 Processor -- start 2023-12-04T10:45:10.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.648+0000 7fc2da5de640 1 -- start start 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2da5de640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc2d415d5d0 0x7fc2d40d3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2da5de640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc2d40ce8e0 0x7fc2d40d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2da5de640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2d40d1de0 0x7fc2d40cf8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2da5de640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d40d2290 con 0x7fc2d40ce8e0 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2da5de640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d40b2710 con 0x7fc2d415d5d0 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2da5de640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40ced70 con 0x7fc2d40d1de0 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2d37fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc2d40ce8e0 0x7fc2d40d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2d37fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc2d40ce8e0 0x7fc2d40d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37072/0 (socket says 172.21.15.63:37072) 2023-12-04T10:45:10.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.649+0000 7fc2d37fe640 1 -- 172.21.15.63:0/3141595442 learned_addr learned my addr 172.21.15.63:0/3141595442 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.650+0000 7fc2d3fff640 1 --2- 172.21.15.63:0/3141595442 >> v2:172.21.15.66:3300/0 conn(0x7fc2d415d5d0 0x7fc2d40d3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.650+0000 7fc2d37fe640 1 -- 172.21.15.63:0/3141595442 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2d40d1de0 msgr2=0x7fc2d40cf8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.650+0000 7fc2d37fe640 1 --2- 172.21.15.63:0/3141595442 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2d40d1de0 0x7fc2d40cf8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.650+0000 7fc2d37fe640 1 -- 172.21.15.63:0/3141595442 >> v2:172.21.15.66:3300/0 conn(0x7fc2d415d5d0 msgr2=0x7fc2d40d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.650+0000 7fc2d37fe640 1 --2- 172.21.15.63:0/3141595442 >> v2:172.21.15.66:3300/0 conn(0x7fc2d415d5d0 0x7fc2d40d3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.652 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.650+0000 7fc2d37fe640 1 -- 172.21.15.63:0/3141595442 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40cf050 con 0x7fc2d40ce8e0 2023-12-04T10:45:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.651+0000 7fc2d37fe640 1 --2- 172.21.15.63:0/3141595442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d40ce8e0 0x7fc2d40d18a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc2d408da80 tx=0x7fc2c802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195da4c840649721 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.651+0000 7fc2d2ffd640 1 -- 172.21.15.63:0/3141595442 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8031870 con 0x7fc2d40ce8e0 2023-12-04T10:45:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.651+0000 7fc2d2ffd640 1 -- 172.21.15.63:0/3141595442 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80319d0 con 0x7fc2d40ce8e0 2023-12-04T10:45:10.653 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.651+0000 7fc2d2ffd640 1 -- 172.21.15.63:0/3141595442 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8031d60 con 0x7fc2d40ce8e0 2023-12-04T10:45:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 -- 172.21.15.63:0/3141595442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d40ce8e0 msgr2=0x7fc2d40d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3141595442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d40ce8e0 0x7fc2d40d18a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc2d408da80 tx=0x7fc2c802b910 comp rx=0 tx=0).stop 2023-12-04T10:45:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 -- 172.21.15.63:0/3141595442 shutdown_connections 2023-12-04T10:45:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3141595442 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2d40d1de0 0x7fc2d40cf8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3141595442 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d40ce8e0 0x7fc2d40d18a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3141595442 >> v2:172.21.15.66:3300/0 conn(0x7fc2d415d5d0 0x7fc2d40d3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 -- 172.21.15.63:0/3141595442 >> 172.21.15.63:0/3141595442 conn(0x7fc2d409c600 msgr2=0x7fc2d40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 -- 172.21.15.63:0/3141595442 shutdown_connections 2023-12-04T10:45:10.655 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.652+0000 7fc2da5de640 1 -- 172.21.15.63:0/3141595442 wait complete. 2023-12-04T10:45:10.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.654+0000 7fc2da5de640 1 Processor -- start 2023-12-04T10:45:10.656 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.654+0000 7fc2da5de640 1 -- start start 2023-12-04T10:45:10.657 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2da5de640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d40d1de0 0x7fc2d415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2da5de640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d415d5d0 0x7fc2d40b8770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2da5de640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2d40cb3e0 0x7fc2d4153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2da5de640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40b5ec0 con 0x7fc2d415d5d0 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2da5de640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40b8cb0 con 0x7fc2d40d1de0 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2da5de640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40cb980 con 0x7fc2d40cb3e0 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d415d5d0 0x7fc2d40b8770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2d37fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d415d5d0 0x7fc2d40b8770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37086/0 (socket says 172.21.15.63:37086) 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.655+0000 7fc2d37fe640 1 -- 172.21.15.63:0/3966830257 learned_addr learned my addr 172.21.15.63:0/3966830257 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d37fe640 1 -- 172.21.15.63:0/3966830257 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2d40cb3e0 msgr2=0x7fc2d4153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d37fe640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2d40cb3e0 0x7fc2d4153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d37fe640 1 -- 172.21.15.63:0/3966830257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d40d1de0 msgr2=0x7fc2d415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d37fe640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d40d1de0 0x7fc2d415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.658 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d37fe640 1 -- 172.21.15.63:0/3966830257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c80094d0 con 0x7fc2d415d5d0 2023-12-04T10:45:10.659 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d37fe640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d415d5d0 0x7fc2d40b8770 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8000c00 tx=0x7fc2c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d0ff9640 1 -- 172.21.15.63:0/3966830257 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8031840 con 0x7fc2d415d5d0 2023-12-04T10:45:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d0ff9640 1 -- 172.21.15.63:0/3966830257 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80443f0 con 0x7fc2d415d5d0 2023-12-04T10:45:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2d0ff9640 1 -- 172.21.15.63:0/3966830257 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80447a0 con 0x7fc2d415d5d0 2023-12-04T10:45:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d40cbc60 con 0x7fc2d415d5d0 2023-12-04T10:45:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.656+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d40cc220 con 0x7fc2d415d5d0 2023-12-04T10:45:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.658+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d40b6030 con 0x7fc2d415d5d0 2023-12-04T10:45:10.660 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.659+0000 7fc2d0ff9640 1 -- 172.21.15.63:0/3966830257 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc2c804d450 con 0x7fc2d415d5d0 2023-12-04T10:45:10.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.659+0000 7fc2d0ff9640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc2c006ae40 0x7fc2c006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:10.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.660+0000 7fc2d0ff9640 1 -- 172.21.15.63:0/3966830257 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc2c802d040 con 0x7fc2d415d5d0 2023-12-04T10:45:10.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.660+0000 7fc2d3fff640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc2c006ae40 0x7fc2c006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:10.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.660+0000 7fc2d3fff640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc2c006ae40 0x7fc2c006d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4006fd0 tx=0x7fc2c4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:10.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.664+0000 7fc2d0ff9640 1 -- 172.21.15.63:0/3966830257 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc2c80dee90 con 0x7fc2d415d5d0 2023-12-04T10:45:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.858+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2d40cc3b0 con 0x7fc2d415d5d0 2023-12-04T10:45:10.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.859+0000 7fc2d0ff9640 1 -- 172.21.15.63:0/3966830257 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2c80350a0 con 0x7fc2d415d5d0 2023-12-04T10:45:10.861 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:45:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc2c006ae40 msgr2=0x7fc2c006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc2c006ae40 0x7fc2c006d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4006fd0 tx=0x7fc2c4008040 comp rx=0 tx=0).stop 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d415d5d0 msgr2=0x7fc2d40b8770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d415d5d0 0x7fc2d40b8770 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc2c8000c00 tx=0x7fc2c80046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 shutdown_connections 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc2c006ae40 0x7fc2c006d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc2d40cb3e0 0x7fc2d4153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc2d415d5d0 0x7fc2d40b8770 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 --2- 172.21.15.63:0/3966830257 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc2d40d1de0 0x7fc2d415eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.861+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 >> 172.21.15.63:0/3966830257 conn(0x7fc2d409c600 msgr2=0x7fc2d406bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.862+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 shutdown_connections 2023-12-04T10:45:10.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:10.862+0000 7fc2da5de640 1 -- 172.21.15.63:0/3966830257 wait complete. 2023-12-04T10:45:10.884 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:45:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.109+0000 7f975ffff640 1 Processor -- start 2023-12-04T10:45:11.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.110+0000 7f975ffff640 1 -- start start 2023-12-04T10:45:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975ffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f976006c520 0x7f9760165f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975ffff640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97600cb800 con 0x7f9760143ca0 2023-12-04T10:45:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975ffff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97600cbae0 con 0x7f9760144370 2023-12-04T10:45:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975ffff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97600cbdc0 con 0x7f976006c520 2023-12-04T10:45:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975effd640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9760143ca0 0x7f97600b2e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58158/0 (socket says 172.21.15.63:58158) 2023-12-04T10:45:11.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975effd640 1 -- 172.21.15.63:0/2186967071 learned_addr learned my addr 172.21.15.63:0/2186967071 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:11.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1639079324 0 0) 0x7f97600cb800 con 0x7f9760143ca0 2023-12-04T10:45:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9748003520 con 0x7f9760143ca0 2023-12-04T10:45:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.112+0000 7f975f7fe640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f976006c520 0x7f9760165f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 207466317 0 0) 0x7f9748003520 con 0x7f9760143ca0 2023-12-04T10:45:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f976006c520 msgr2=0x7f9760165f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f976006c520 0x7f9760165f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.117 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 >> v1:172.21.15.66:6789/0 conn(0x7f9760144370 legacy=0x7f976006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97600b2610 con 0x7f9760143ca0 2023-12-04T10:45:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f97500019f0 con 0x7f9760143ca0 2023-12-04T10:45:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 >> v1:172.21.15.63:6789/0 conn(0x7f9760143ca0 legacy=0x7f97600b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97480039a0 0x7f9748003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97480047c0 0x7f9748004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480051d0 0x7f974800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97600cbdc0 con 0x7f97480047c0 2023-12-04T10:45:11.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974800c080 con 0x7f97480039a0 2023-12-04T10:45:11.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974800c240 con 0x7f97480051d0 2023-12-04T10:45:11.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975f7fe640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f976006c520 0x7f9760165f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:45:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.113+0000 7f975e7fc640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97480047c0 0x7f9748004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.114+0000 7f975effd640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97480039a0 0x7f9748003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.114+0000 7f975f7fe640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480051d0 0x7f974800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.114+0000 7f975e7fc640 1 -- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480051d0 msgr2=0x7f974800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.114+0000 7f975e7fc640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480051d0 0x7f974800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.120 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.114+0000 7f975e7fc640 1 -- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97480039a0 msgr2=0x7f9748003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.114+0000 7f975e7fc640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f97480039a0 0x7f9748003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.114+0000 7f975e7fc640 1 -- 172.21.15.63:0/2186967071 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748003520 con 0x7f97480047c0 2023-12-04T10:45:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.114+0000 7f975f7fe640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480051d0 0x7f974800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.115+0000 7f975e7fc640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97480047c0 0x7f9748004c40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9754001770 tx=0x7f97480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcc006045299e032 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.115+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97540052d0 con 0x7f97480047c0 2023-12-04T10:45:11.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975402e050 con 0x7f97480047c0 2023-12-04T10:45:11.122 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975dffb640 1 -- 172.21.15.63:0/2186967071 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754003640 con 0x7f97480047c0 2023-12-04T10:45:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975ffff640 1 -- 172.21.15.63:0/2186967071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97480047c0 msgr2=0x7f9748004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.124 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975ffff640 1 --2- 172.21.15.63:0/2186967071 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f97480047c0 0x7f9748004c40 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9754001770 tx=0x7f97480057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975f7fe640 1 -- 172.21.15.63:0/2186967071 reap_dead start 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975ffff640 1 -- 172.21.15.63:0/2186967071 shutdown_connections 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975ffff640 1 -- 172.21.15.63:0/2186967071 >> 172.21.15.63:0/2186967071 conn(0x7f97600b0860 msgr2=0x7f97600b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975ffff640 1 -- 172.21.15.63:0/2186967071 shutdown_connections 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.116+0000 7f975ffff640 1 -- 172.21.15.63:0/2186967071 wait complete. 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.118+0000 7f975ffff640 1 Processor -- start 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.118+0000 7f975ffff640 1 -- start start 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.119+0000 7f975ffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480047c0 0x7f9760159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.119+0000 7f975ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9760138a90 0x7f9760138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.119+0000 7f975ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9760142570 0x7f9760142a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.119+0000 7f975ffff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9760139450 con 0x7f9760138a90 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.119+0000 7f975ffff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9760143180 con 0x7f9760142570 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.119+0000 7f975ffff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9760142f60 con 0x7f97480047c0 2023-12-04T10:45:11.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9760138a90 0x7f9760138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975e7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9760138a90 0x7f9760138f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37100/0 (socket says 172.21.15.63:37100) 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975e7fc640 1 -- 172.21.15.63:0/2426123161 learned_addr learned my addr 172.21.15.63:0/2426123161 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975effd640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480047c0 0x7f9760159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975e7fc640 1 -- 172.21.15.63:0/2426123161 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480047c0 msgr2=0x7f9760159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975e7fc640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480047c0 0x7f9760159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975e7fc640 1 -- 172.21.15.63:0/2426123161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9760142570 msgr2=0x7f9760142a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975e7fc640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9760142570 0x7f9760142a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.120+0000 7f975e7fc640 1 -- 172.21.15.63:0/2426123161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f976015adf0 con 0x7f9760138a90 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.121+0000 7f975e7fc640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9760138a90 0x7f9760138f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9754005040 tx=0x7f9754001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.121+0000 7f97477fe640 1 -- 172.21.15.63:0/2426123161 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754003a50 con 0x7f9760138a90 2023-12-04T10:45:11.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.121+0000 7f97477fe640 1 -- 172.21.15.63:0/2426123161 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9754003bb0 con 0x7f9760138a90 2023-12-04T10:45:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.121+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9760141430 con 0x7f9760138a90 2023-12-04T10:45:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.121+0000 7f97477fe640 1 -- 172.21.15.63:0/2426123161 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9754007a80 con 0x7f9760138a90 2023-12-04T10:45:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.121+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97601419b0 con 0x7f9760138a90 2023-12-04T10:45:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.123+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97600ce9f0 con 0x7f9760138a90 2023-12-04T10:45:11.127 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.124+0000 7f97477fe640 1 -- 172.21.15.63:0/2426123161 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f975403e480 con 0x7f9760138a90 2023-12-04T10:45:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.125+0000 7f97477fe640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f974c06ae70 0x7f974c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.125+0000 7f97477fe640 1 -- 172.21.15.63:0/2426123161 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f97540ab760 con 0x7f9760138a90 2023-12-04T10:45:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.126+0000 7f975effd640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f974c06ae70 0x7f974c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.126+0000 7f975effd640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f974c06ae70 0x7f974c06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f97500013d0 tx=0x7f9750009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:11.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.130+0000 7f97477fe640 1 -- 172.21.15.63:0/2426123161 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f97540763b0 con 0x7f9760138a90 2023-12-04T10:45:11.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.323+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f976004e840 con 0x7f9760138a90 2023-12-04T10:45:11.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.324+0000 7f97477fe640 1 -- 172.21.15.63:0/2426123161 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7f97540799d0 con 0x7f9760138a90 2023-12-04T10:45:11.325 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f974c06ae70 msgr2=0x7f974c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f974c06ae70 0x7f974c06d330 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f97500013d0 tx=0x7f9750009040 comp rx=0 tx=0).stop 2023-12-04T10:45:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9760138a90 msgr2=0x7f9760138f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9760138a90 0x7f9760138f10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f9754005040 tx=0x7f9754001170 comp rx=0 tx=0).stop 2023-12-04T10:45:11.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 shutdown_connections 2023-12-04T10:45:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f974c06ae70 0x7f974c06d330 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9760142570 0x7f9760142a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9760138a90 0x7f9760138f10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 --2- 172.21.15.63:0/2426123161 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f97480047c0 0x7f9760159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 >> 172.21.15.63:0/2426123161 conn(0x7f97600b0860 msgr2=0x7f97600ce2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 shutdown_connections 2023-12-04T10:45:11.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.327+0000 7f975ffff640 1 -- 172.21.15.63:0/2426123161 wait complete. 2023-12-04T10:45:11.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T10:45:11.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.575+0000 7f6d463bc640 1 Processor -- start 2023-12-04T10:45:11.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.575+0000 7f6d463bc640 1 -- start start 2023-12-04T10:45:11.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.576+0000 7f6d463bc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d16b0 0x7f6d400d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.576+0000 7f6d463bc640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f6d400d3cd0 0x7f6d400b3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.576+0000 7f6d463bc640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d400d1fd0 con 0x7f6d4015d710 2023-12-04T10:45:11.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.576+0000 7f6d463bc640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d400cef40 con 0x7f6d400d3cd0 2023-12-04T10:45:11.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.576+0000 7f6d463bc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400b25c0 con 0x7f6d400d16b0 2023-12-04T10:45:11.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.577+0000 7f6d44bb9640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f6d4015d710 0x7f6d400ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58172/0 (socket says 172.21.15.63:58172) 2023-12-04T10:45:11.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.577+0000 7f6d44bb9640 1 -- 172.21.15.63:0/411435494 learned_addr learned my addr 172.21.15.63:0/411435494 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:11.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.577+0000 7f6d45bbb640 1 --2- 172.21.15.63:0/411435494 >> v2:172.21.15.63:3300/0 conn(0x7f6d400d3cd0 0x7f6d400b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.577+0000 7f6d453ba640 1 --2- 172.21.15.63:0/411435494 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d16b0 0x7f6d400d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.577+0000 7f6d37fff640 1 -- 172.21.15.63:0/411435494 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1568471504 0 0) 0x7f6d400d1fd0 con 0x7f6d4015d710 2023-12-04T10:45:11.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.578+0000 7f6d37fff640 1 -- 172.21.15.63:0/411435494 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d2c003520 con 0x7f6d4015d710 2023-12-04T10:45:11.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.578+0000 7f6d45bbb640 1 -- 172.21.15.63:0/411435494 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d16b0 msgr2=0x7f6d400d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:11.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.578+0000 7f6d45bbb640 1 --2- 172.21.15.63:0/411435494 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d16b0 0x7f6d400d1a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.578+0000 7f6d45bbb640 1 -- 172.21.15.63:0/411435494 >> v1:172.21.15.63:6789/0 conn(0x7f6d4015d710 legacy=0x7f6d400ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.578+0000 7f6d45bbb640 1 -- 172.21.15.63:0/411435494 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d400b28a0 con 0x7f6d400d3cd0 2023-12-04T10:45:11.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.579+0000 7f6d45bbb640 1 --2- 172.21.15.63:0/411435494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d400d3cd0 0x7f6d400b3380 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009d90 tx=0x7f6d3802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ed01933e546b79 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:11.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.579+0000 7f6d37fff640 1 -- 172.21.15.63:0/411435494 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3802cbc0 con 0x7f6d400d3cd0 2023-12-04T10:45:11.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.579+0000 7f6d37fff640 1 -- 172.21.15.63:0/411435494 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3802cd20 con 0x7f6d400d3cd0 2023-12-04T10:45:11.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.579+0000 7f6d37fff640 1 -- 172.21.15.63:0/411435494 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38034660 con 0x7f6d400d3cd0 2023-12-04T10:45:11.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.580+0000 7f6d463bc640 1 -- 172.21.15.63:0/411435494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d400d3cd0 msgr2=0x7f6d400b3380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.580+0000 7f6d463bc640 1 --2- 172.21.15.63:0/411435494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d400d3cd0 0x7f6d400b3380 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009d90 tx=0x7f6d3802be10 comp rx=0 tx=0).stop 2023-12-04T10:45:11.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.580+0000 7f6d463bc640 1 -- 172.21.15.63:0/411435494 shutdown_connections 2023-12-04T10:45:11.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.580+0000 7f6d463bc640 1 --2- 172.21.15.63:0/411435494 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d400d3cd0 0x7f6d400b3380 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.580+0000 7f6d463bc640 1 --2- 172.21.15.63:0/411435494 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d16b0 0x7f6d400d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.580+0000 7f6d463bc640 1 -- 172.21.15.63:0/411435494 >> 172.21.15.63:0/411435494 conn(0x7f6d400d30d0 msgr2=0x7f6d400d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:11.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.580+0000 7f6d463bc640 1 -- 172.21.15.63:0/411435494 shutdown_connections 2023-12-04T10:45:11.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.580+0000 7f6d463bc640 1 -- 172.21.15.63:0/411435494 wait complete. 2023-12-04T10:45:11.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.582+0000 7f6d463bc640 1 Processor -- start 2023-12-04T10:45:11.583 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.582+0000 7f6d463bc640 1 -- start start 2023-12-04T10:45:11.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d463bc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d400d16b0 0x7f6d400c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d463bc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d3cd0 0x7f6d4015a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d463bc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d4015d710 0x7f6d400b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d463bc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400c9280 con 0x7f6d4015d710 2023-12-04T10:45:11.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d463bc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400c9c50 con 0x7f6d400d16b0 2023-12-04T10:45:11.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d463bc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d400c8390 con 0x7f6d400d3cd0 2023-12-04T10:45:11.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d45bbb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d4015d710 0x7f6d400b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d45bbb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d4015d710 0x7f6d400b0300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37116/0 (socket says 172.21.15.63:37116) 2023-12-04T10:45:11.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.583+0000 7f6d45bbb640 1 -- 172.21.15.63:0/1352871357 learned_addr learned my addr 172.21.15.63:0/1352871357 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:11.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.584+0000 7f6d453ba640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d400d16b0 0x7f6d400c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.584+0000 7f6d45bbb640 1 -- 172.21.15.63:0/1352871357 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d3cd0 msgr2=0x7f6d4015a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.584+0000 7f6d45bbb640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d3cd0 0x7f6d4015a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.584+0000 7f6d45bbb640 1 -- 172.21.15.63:0/1352871357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d400d16b0 msgr2=0x7f6d400c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.584+0000 7f6d45bbb640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d400d16b0 0x7f6d400c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.584+0000 7f6d45bbb640 1 -- 172.21.15.63:0/1352871357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d38009a70 con 0x7f6d4015d710 2023-12-04T10:45:11.586 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.584+0000 7f6d45bbb640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d4015d710 0x7f6d400b0300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009d90 tx=0x7f6d38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.585+0000 7f6d35ffb640 1 -- 172.21.15.63:0/1352871357 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38040650 con 0x7f6d4015d710 2023-12-04T10:45:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.585+0000 7f6d35ffb640 1 -- 172.21.15.63:0/1352871357 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d3802ce90 con 0x7f6d4015d710 2023-12-04T10:45:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.585+0000 7f6d35ffb640 1 -- 172.21.15.63:0/1352871357 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d38040a10 con 0x7f6d4015d710 2023-12-04T10:45:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.585+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d400c8670 con 0x7f6d4015d710 2023-12-04T10:45:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.585+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d400c8c30 con 0x7f6d4015d710 2023-12-04T10:45:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.586+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d400c9430 con 0x7f6d4015d710 2023-12-04T10:45:11.587 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.587+0000 7f6d35ffb640 1 -- 172.21.15.63:0/1352871357 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6d38040b70 con 0x7f6d4015d710 2023-12-04T10:45:11.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.588+0000 7f6d35ffb640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d2406ae40 0x7f6d2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:11.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.588+0000 7f6d35ffb640 1 -- 172.21.15.63:0/1352871357 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f6d380ac630 con 0x7f6d4015d710 2023-12-04T10:45:11.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.588+0000 7f6d453ba640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d2406ae40 0x7f6d2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:11.589 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.589+0000 7f6d453ba640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d2406ae40 0x7f6d2406d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009ad0 tx=0x7f6d3c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:11.593 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.592+0000 7f6d35ffb640 1 -- 172.21.15.63:0/1352871357 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6d400c9430 con 0x7f6d4015d710 2023-12-04T10:45:11.803 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.802+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6d4004e840 con 0x7f6d4015d710 2023-12-04T10:45:11.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.803+0000 7f6d35ffb640 1 -- 172.21.15.63:0/1352871357 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6d38077280 con 0x7f6d4015d710 2023-12-04T10:45:11.804 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-04T10:45:11.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.805+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d2406ae40 msgr2=0x7f6d2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.805+0000 7f6d463bc640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d2406ae40 0x7f6d2406d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f6d3c009ad0 tx=0x7f6d3c008040 comp rx=0 tx=0).stop 2023-12-04T10:45:11.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.805+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d4015d710 msgr2=0x7f6d400b0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:11.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.805+0000 7f6d463bc640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d4015d710 0x7f6d400b0300 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009d90 tx=0x7f6d38004a40 comp rx=0 tx=0).stop 2023-12-04T10:45:11.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.806+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 shutdown_connections 2023-12-04T10:45:11.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.806+0000 7f6d463bc640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f6d2406ae40 0x7f6d2406d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.806+0000 7f6d463bc640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f6d400d3cd0 0x7f6d4015a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.806+0000 7f6d463bc640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f6d4015d710 0x7f6d400b0300 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.806+0000 7f6d463bc640 1 --2- 172.21.15.63:0/1352871357 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6d400d16b0 0x7f6d400c9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:11.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.806+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 >> 172.21.15.63:0/1352871357 conn(0x7f6d400d30d0 msgr2=0x7f6d4006b1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:11.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.806+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 shutdown_connections 2023-12-04T10:45:11.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:11.806+0000 7f6d463bc640 1 -- 172.21.15.63:0/1352871357 wait complete. 2023-12-04T10:45:11.826 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-04T10:45:11.826 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:11.826 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-04T10:45:11.932 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T10:45:11.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:11.933 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-04T10:45:11.990 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:45:11.990 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:12.053 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:45:12.053 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:12.110 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T10:45:12.110 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:12.165 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:12.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.399+0000 7f0109c09640 1 Processor -- start 2023-12-04T10:45:12.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.400+0000 7f0109c09640 1 -- start start 2023-12-04T10:45:12.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.401+0000 7f0109c09640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01040cf850 0x7f01040cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.401+0000 7f0109c09640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040cf3d0 con 0x7f01040b3e50 2023-12-04T10:45:12.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.401+0000 7f0109c09640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01040b2480 con 0x7f01040cfc30 2023-12-04T10:45:12.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.401+0000 7f0109c09640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01040b2760 con 0x7f01040cf850 2023-12-04T10:45:12.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.402+0000 7f0103fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f01040b3e50 0x7f010415e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58174/0 (socket says 172.21.15.63:58174) 2023-12-04T10:45:12.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.402+0000 7f0103fff640 1 -- 172.21.15.63:0/3310259024 learned_addr learned my addr 172.21.15.63:0/3310259024 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:12.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.402+0000 7f01037fe640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01040cf850 0x7f01040cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.402+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 487739449 0 0) 0x7f00fc001490 con 0x7f01040b3e50 2023-12-04T10:45:12.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.402+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f00f0003520 con 0x7f01040b3e50 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1883348530 0 0) 0x7f00f0003520 con 0x7f01040b3e50 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01040cf850 msgr2=0x7f01040cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01040cf850 0x7f01040cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 >> v1:172.21.15.66:6789/0 conn(0x7f01040cfc30 legacy=0x7f01040cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01040cbdb0 con 0x7f01040b3e50 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f00fc001b80 con 0x7f01040b3e50 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 >> v1:172.21.15.63:6789/0 conn(0x7f01040b3e50 legacy=0x7f010415e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00f00039a0 0x7f00f0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00f00047c0 0x7f00f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f0005180 0x7f00f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01040b2760 con 0x7f00f00047c0 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000c080 con 0x7f00f0005180 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00f000c240 con 0x7f00f00039a0 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f01037fe640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f01040cf850 0x7f01040cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f00fbfff640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00f00047c0 0x7f00f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f00fbfff640 1 -- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00f00039a0 msgr2=0x7f00f0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f00fbfff640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f00f00039a0 0x7f00f0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f00fbfff640 1 -- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f0005180 msgr2=0x7f00f000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.403+0000 7f00fbfff640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f0005180 0x7f00f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.404+0000 7f00fbfff640 1 -- 172.21.15.63:0/3310259024 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f0003520 con 0x7f00f00047c0 2023-12-04T10:45:12.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.405+0000 7f00fbfff640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00f00047c0 0x7f00f0004c40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f00ec001750 tx=0x7f00f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b5d1a1d0d7ea88 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:12.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.405+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0052d0 con 0x7f00f00047c0 2023-12-04T10:45:12.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.405+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec02e050 con 0x7f00f00047c0 2023-12-04T10:45:12.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.405+0000 7f0102ffd640 1 -- 172.21.15.63:0/3310259024 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec003830 con 0x7f00f00047c0 2023-12-04T10:45:12.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.405+0000 7f0109c09640 1 -- 172.21.15.63:0/3310259024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00f00047c0 msgr2=0x7f00f0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.406+0000 7f0109c09640 1 --2- 172.21.15.63:0/3310259024 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f00f00047c0 0x7f00f0004c40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f00ec001750 tx=0x7f00f00057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.406+0000 7f0103fff640 1 -- 172.21.15.63:0/3310259024 reap_dead start 2023-12-04T10:45:12.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.406+0000 7f0109c09640 1 -- 172.21.15.63:0/3310259024 shutdown_connections 2023-12-04T10:45:12.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.406+0000 7f0109c09640 1 -- 172.21.15.63:0/3310259024 >> 172.21.15.63:0/3310259024 conn(0x7f01040d1000 msgr2=0x7f01040d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:12.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.406+0000 7f0109c09640 1 -- 172.21.15.63:0/3310259024 shutdown_connections 2023-12-04T10:45:12.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.406+0000 7f0109c09640 1 -- 172.21.15.63:0/3310259024 wait complete. 2023-12-04T10:45:12.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.408+0000 7f0109c09640 1 Processor -- start 2023-12-04T10:45:12.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.408+0000 7f0109c09640 1 -- start start 2023-12-04T10:45:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0109c09640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f00047c0 0x7f01040caaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0109c09640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f010415a4f0 0x7f010414d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0109c09640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010414e030 0x7f0104157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0109c09640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104159730 con 0x7f010414e030 2023-12-04T10:45:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0109c09640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104159a10 con 0x7f00f00047c0 2023-12-04T10:45:12.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0109c09640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0104159cf0 con 0x7f010415a4f0 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0103fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010414e030 0x7f0104157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0103fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010414e030 0x7f0104157410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37134/0 (socket says 172.21.15.63:37134) 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.409+0000 7f0103fff640 1 -- 172.21.15.63:0/191768093 learned_addr learned my addr 172.21.15.63:0/191768093 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.410+0000 7f01037fe640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f00047c0 0x7f01040caaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.410+0000 7f00fbfff640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f010415a4f0 0x7f010414d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.410+0000 7f0103fff640 1 -- 172.21.15.63:0/191768093 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f010415a4f0 msgr2=0x7f010414d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.410+0000 7f0103fff640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f010415a4f0 0x7f010414d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.410+0000 7f0103fff640 1 -- 172.21.15.63:0/191768093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f00047c0 msgr2=0x7f01040caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.410+0000 7f0103fff640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f00047c0 0x7f01040caaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.410+0000 7f0103fff640 1 -- 172.21.15.63:0/191768093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104159fd0 con 0x7f010414e030 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.410+0000 7f0103fff640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010414e030 0x7f0104157410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0015f0 tx=0x7f00fc00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:12.414 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.411+0000 7f0100ff9640 1 -- 172.21.15.63:0/191768093 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00a610 con 0x7f010414e030 2023-12-04T10:45:12.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.411+0000 7f0100ff9640 1 -- 172.21.15.63:0/191768093 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00fc00a7b0 con 0x7f010414e030 2023-12-04T10:45:12.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.411+0000 7f0100ff9640 1 -- 172.21.15.63:0/191768093 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00fc00ab60 con 0x7f010414e030 2023-12-04T10:45:12.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.411+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f010414ddc0 con 0x7f010414e030 2023-12-04T10:45:12.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.411+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0104159350 con 0x7f010414e030 2023-12-04T10:45:12.415 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.412+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010415a1c0 con 0x7f010414e030 2023-12-04T10:45:12.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.413+0000 7f0100ff9640 1 -- 172.21.15.63:0/191768093 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00fc00acc0 con 0x7f010414e030 2023-12-04T10:45:12.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.414+0000 7f0100ff9640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f00e406ae40 0x7f00e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.414+0000 7f0100ff9640 1 -- 172.21.15.63:0/191768093 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f00fc0890d0 con 0x7f010414e030 2023-12-04T10:45:12.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.414+0000 7f01037fe640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f00e406ae40 0x7f00e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.415+0000 7f01037fe640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f00e406ae40 0x7f00e406d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00f4006a90 tx=0x7f00f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:12.419 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.419+0000 7f0100ff9640 1 -- 172.21.15.63:0/191768093 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f00fc053dc0 con 0x7f010414e030 2023-12-04T10:45:12.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.613+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01040cf3d0 con 0x7f010414e030 2023-12-04T10:45:12.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.616+0000 7f0100ff9640 1 -- 172.21.15.63:0/191768093 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f01040cf3d0 con 0x7f010414e030 2023-12-04T10:45:12.617 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:12.617 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.618+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f00e406ae40 msgr2=0x7f00e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.618+0000 7f0109c09640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f00e406ae40 0x7f00e406d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f00f4006a90 tx=0x7f00f4008040 comp rx=0 tx=0).stop 2023-12-04T10:45:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.618+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010414e030 msgr2=0x7f0104157410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.618+0000 7f0109c09640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010414e030 0x7f0104157410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f00fc0015f0 tx=0x7f00fc00cf00 comp rx=0 tx=0).stop 2023-12-04T10:45:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.619+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 shutdown_connections 2023-12-04T10:45:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.619+0000 7f0109c09640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f00e406ae40 0x7f00e406d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.619+0000 7f0109c09640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f010415a4f0 0x7f010414d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.620 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.619+0000 7f0109c09640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f010414e030 0x7f0104157410 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.619+0000 7f0109c09640 1 --2- 172.21.15.63:0/191768093 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f00f00047c0 0x7f01040caaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.619+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 >> 172.21.15.63:0/191768093 conn(0x7f01040d1000 msgr2=0x7f01040cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:12.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.619+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 shutdown_connections 2023-12-04T10:45:12.621 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.619+0000 7f0109c09640 1 -- 172.21.15.63:0/191768093 wait complete. 2023-12-04T10:45:12.640 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:45:12.641 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:45:12.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.871+0000 7f2e0b548640 1 Processor -- start 2023-12-04T10:45:12.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.871+0000 7f2e0b548640 1 -- start start 2023-12-04T10:45:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.873+0000 7f2e0b548640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2e0415cd60 0x7f2e040717d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.873+0000 7f2e0b548640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0415b5c0 con 0x7f2e040cad70 2023-12-04T10:45:12.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.873+0000 7f2e0b548640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e04071dd0 con 0x7f2e0415b1e0 2023-12-04T10:45:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.873+0000 7f2e0b548640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0415aa30 con 0x7f2e0415cd60 2023-12-04T10:45:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.873+0000 7f2e08ae3640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2e040cad70 0x7f2e040710c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58186/0 (socket says 172.21.15.63:58186) 2023-12-04T10:45:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.873+0000 7f2e08ae3640 1 -- 172.21.15.63:0/1726074248 learned_addr learned my addr 172.21.15.63:0/1726074248 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.873+0000 7f2e09ae5640 1 --2- 172.21.15.63:0/1726074248 >> v2:172.21.15.63:3300/0 conn(0x7f2e0415cd60 0x7f2e040717d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.874+0000 7f2e09ae5640 1 -- 172.21.15.63:0/1726074248 >> v1:172.21.15.66:6789/0 conn(0x7f2e0415b1e0 legacy=0x7f2e040ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.874+0000 7f2e09ae5640 1 -- 172.21.15.63:0/1726074248 >> v1:172.21.15.63:6789/0 conn(0x7f2e040cad70 legacy=0x7f2e040710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.874+0000 7f2e03fff640 1 -- 172.21.15.63:0/1726074248 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488016011 0 0) 0x7f2e0415b5c0 con 0x7f2e040cad70 2023-12-04T10:45:12.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.874+0000 7f2e09ae5640 1 -- 172.21.15.63:0/1726074248 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e040720b0 con 0x7f2e0415cd60 2023-12-04T10:45:12.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.875+0000 7f2e09ae5640 1 --2- 172.21.15.63:0/1726074248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0415cd60 0x7f2e040717d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0097a0 tx=0x7f2dfc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eef1ed1ede51225 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:12.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.876+0000 7f2e03fff640 1 -- 172.21.15.63:0/1726074248 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc030610 con 0x7f2e0415cd60 2023-12-04T10:45:12.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.876+0000 7f2e03fff640 1 -- 172.21.15.63:0/1726074248 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc030770 con 0x7f2e0415cd60 2023-12-04T10:45:12.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.876+0000 7f2e03fff640 1 -- 172.21.15.63:0/1726074248 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc030b00 con 0x7f2e0415cd60 2023-12-04T10:45:12.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.877+0000 7f2e0b548640 1 -- 172.21.15.63:0/1726074248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0415cd60 msgr2=0x7f2e040717d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.877+0000 7f2e0b548640 1 --2- 172.21.15.63:0/1726074248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0415cd60 0x7f2e040717d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc0097a0 tx=0x7f2dfc02b960 comp rx=0 tx=0).stop 2023-12-04T10:45:12.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.877+0000 7f2e0b548640 1 -- 172.21.15.63:0/1726074248 shutdown_connections 2023-12-04T10:45:12.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.877+0000 7f2e0b548640 1 --2- 172.21.15.63:0/1726074248 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0415cd60 0x7f2e040717d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.877+0000 7f2e0b548640 1 -- 172.21.15.63:0/1726074248 >> 172.21.15.63:0/1726074248 conn(0x7f2e040cee80 msgr2=0x7f2e040cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:12.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.877+0000 7f2e0b548640 1 -- 172.21.15.63:0/1726074248 shutdown_connections 2023-12-04T10:45:12.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.877+0000 7f2e0b548640 1 -- 172.21.15.63:0/1726074248 wait complete. 2023-12-04T10:45:12.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.879+0000 7f2e0b548640 1 Processor -- start 2023-12-04T10:45:12.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.879+0000 7f2e0b548640 1 -- start start 2023-12-04T10:45:12.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.880+0000 7f2e0b548640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e040cad70 0x7f2e04159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.880+0000 7f2e0b548640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0415b1e0 0x7f2e0414ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.880+0000 7f2e0b548640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0415cd60 0x7f2e041539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.880+0000 7f2e0b548640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041535b0 con 0x7f2e040cad70 2023-12-04T10:45:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.880+0000 7f2e0b548640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0414da20 con 0x7f2e0415b1e0 2023-12-04T10:45:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.880+0000 7f2e0b548640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04152930 con 0x7f2e0415cd60 2023-12-04T10:45:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e092e4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e040cad70 0x7f2e04159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e092e4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e040cad70 0x7f2e04159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37156/0 (socket says 172.21.15.63:37156) 2023-12-04T10:45:12.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e092e4640 1 -- 172.21.15.63:0/4205867896 learned_addr learned my addr 172.21.15.63:0/4205867896 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e08ae3640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0415b1e0 0x7f2e0414ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e09ae5640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0415cd60 0x7f2e041539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e092e4640 1 -- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0415cd60 msgr2=0x7f2e041539d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e092e4640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0415cd60 0x7f2e041539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e092e4640 1 -- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0415b1e0 msgr2=0x7f2e0414ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e092e4640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0415b1e0 0x7f2e0414ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:12.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e092e4640 1 -- 172.21.15.63:0/4205867896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc009400 con 0x7f2e040cad70 2023-12-04T10:45:12.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.881+0000 7f2e08ae3640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0415b1e0 0x7f2e0414ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:12.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.882+0000 7f2e092e4640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e040cad70 0x7f2e04159350 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2df400c870 tx=0x7f2df400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.882+0000 7f2e01ffb640 1 -- 172.21.15.63:0/4205867896 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4003b70 con 0x7f2e040cad70 2023-12-04T10:45:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.882+0000 7f2e01ffb640 1 -- 172.21.15.63:0/4205867896 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df4003cf0 con 0x7f2e040cad70 2023-12-04T10:45:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.882+0000 7f2e01ffb640 1 -- 172.21.15.63:0/4205867896 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df400aa90 con 0x7f2e040cad70 2023-12-04T10:45:12.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.882+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e04152c10 con 0x7f2e040cad70 2023-12-04T10:45:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.882+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e041531d0 con 0x7f2e040cad70 2023-12-04T10:45:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.884+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04153820 con 0x7f2e040cad70 2023-12-04T10:45:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.884+0000 7f2e01ffb640 1 -- 172.21.15.63:0/4205867896 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2df400abf0 con 0x7f2e040cad70 2023-12-04T10:45:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.885+0000 7f2e01ffb640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.885+0000 7f2e01ffb640 1 -- 172.21.15.63:0/4205867896 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f2df4089940 con 0x7f2e040cad70 2023-12-04T10:45:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.886+0000 7f2e08ae3640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:12.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.886+0000 7f2e08ae3640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2e0414de40 tx=0x7f2df8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:12.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:12.890+0000 7f2e01ffb640 1 -- 172.21.15.63:0/4205867896 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2df4054590 con 0x7f2e040cad70 2023-12-04T10:45:13.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.088+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e04068710 con 0x7f2e040cad70 2023-12-04T10:45:13.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.089+0000 7f2e01ffb640 1 -- 172.21.15.63:0/4205867896 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2df4003e60 con 0x7f2e040cad70 2023-12-04T10:45:13.090 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:45:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 msgr2=0x7f2df006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2e0414de40 tx=0x7f2df8009040 comp rx=0 tx=0).stop 2023-12-04T10:45:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e040cad70 msgr2=0x7f2e04159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e040cad70 0x7f2e04159350 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2df400c870 tx=0x7f2df400cd30 comp rx=0 tx=0).stop 2023-12-04T10:45:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 shutdown_connections 2023-12-04T10:45:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0415cd60 0x7f2e041539d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0415b1e0 0x7f2e0414ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 --2- 172.21.15.63:0/4205867896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e040cad70 0x7f2e04159350 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 >> 172.21.15.63:0/4205867896 conn(0x7f2e040cee80 msgr2=0x7f2e041644a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 shutdown_connections 2023-12-04T10:45:13.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.092+0000 7f2e0b548640 1 -- 172.21.15.63:0/4205867896 wait complete. 2023-12-04T10:45:13.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:45:13.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.340+0000 7fba17fff640 1 Processor -- start 2023-12-04T10:45:13.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.340+0000 7fba17fff640 1 -- start start 2023-12-04T10:45:13.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.342+0000 7fba17fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fba180b36b0 0x7fba180707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.343+0000 7fba17fff640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180ac890 con 0x7fba180acd20 2023-12-04T10:45:13.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.343+0000 7fba17fff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba180b2b60 con 0x7fba1815d0c0 2023-12-04T10:45:13.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.343+0000 7fba17fff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba180b2e40 con 0x7fba180b36b0 2023-12-04T10:45:13.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.343+0000 7fba0e7fc640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fba180b36b0 0x7fba180707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.343+0000 7fba177fe640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fba180acd20 0x7fba180ad130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58196/0 (socket says 172.21.15.63:58196) 2023-12-04T10:45:13.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.343+0000 7fba177fe640 1 -- 172.21.15.63:0/637755890 learned_addr learned my addr 172.21.15.63:0/637755890 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:13.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.344+0000 7fba0e7fc640 1 -- 172.21.15.63:0/637755890 >> v1:172.21.15.66:6789/0 conn(0x7fba1815d0c0 legacy=0x7fba18070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:13.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.344+0000 7fba0e7fc640 1 -- 172.21.15.63:0/637755890 >> v1:172.21.15.63:6789/0 conn(0x7fba180acd20 legacy=0x7fba180ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.344+0000 7fba0e7fc640 1 -- 172.21.15.63:0/637755890 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba180b3120 con 0x7fba180b36b0 2023-12-04T10:45:13.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.344+0000 7fba167fc640 1 -- 172.21.15.63:0/637755890 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2716157251 0 0) 0x7fba180ac890 con 0x7fba180acd20 2023-12-04T10:45:13.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.345+0000 7fba0e7fc640 1 --2- 172.21.15.63:0/637755890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180b36b0 0x7fba180707a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fba00009790 tx=0x7fba0002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94f33da58717dc server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:13.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.345+0000 7fba167fc640 1 -- 172.21.15.63:0/637755890 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00030610 con 0x7fba180b36b0 2023-12-04T10:45:13.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.345+0000 7fba167fc640 1 -- 172.21.15.63:0/637755890 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00030770 con 0x7fba180b36b0 2023-12-04T10:45:13.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.345+0000 7fba167fc640 1 -- 172.21.15.63:0/637755890 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00030b00 con 0x7fba180b36b0 2023-12-04T10:45:13.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.346+0000 7fba17fff640 1 -- 172.21.15.63:0/637755890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180b36b0 msgr2=0x7fba180707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.346+0000 7fba17fff640 1 --2- 172.21.15.63:0/637755890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180b36b0 0x7fba180707a0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fba00009790 tx=0x7fba0002b960 comp rx=0 tx=0).stop 2023-12-04T10:45:13.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.346+0000 7fba17fff640 1 -- 172.21.15.63:0/637755890 shutdown_connections 2023-12-04T10:45:13.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.346+0000 7fba17fff640 1 --2- 172.21.15.63:0/637755890 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180b36b0 0x7fba180707a0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.346+0000 7fba17fff640 1 -- 172.21.15.63:0/637755890 >> 172.21.15.63:0/637755890 conn(0x7fba180b0860 msgr2=0x7fba180b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:13.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.346+0000 7fba17fff640 1 -- 172.21.15.63:0/637755890 shutdown_connections 2023-12-04T10:45:13.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.346+0000 7fba17fff640 1 -- 172.21.15.63:0/637755890 wait complete. 2023-12-04T10:45:13.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.348+0000 7fba17fff640 1 Processor -- start 2023-12-04T10:45:13.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.348+0000 7fba17fff640 1 -- start start 2023-12-04T10:45:13.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba17fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180acd20 0x7fba1814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba17fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba180b36b0 0x7fba180cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba17fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba1815d0c0 0x7fba181f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba17fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba1814cd20 con 0x7fba180acd20 2023-12-04T10:45:13.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba17fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba180c3be0 con 0x7fba1815d0c0 2023-12-04T10:45:13.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba17fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba180cc4e0 con 0x7fba180b36b0 2023-12-04T10:45:13.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba16ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180acd20 0x7fba1814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba16ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180acd20 0x7fba1814c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37178/0 (socket says 172.21.15.63:37178) 2023-12-04T10:45:13.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba16ffd640 1 -- 172.21.15.63:0/1980755125 learned_addr learned my addr 172.21.15.63:0/1980755125 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:13.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba16ffd640 1 -- 172.21.15.63:0/1980755125 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba180b36b0 msgr2=0x7fba180cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba16ffd640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba180b36b0 0x7fba180cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba16ffd640 1 -- 172.21.15.63:0/1980755125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba1815d0c0 msgr2=0x7fba181f2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba16ffd640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba1815d0c0 0x7fba181f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.349+0000 7fba16ffd640 1 -- 172.21.15.63:0/1980755125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba000093a0 con 0x7fba180acd20 2023-12-04T10:45:13.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.350+0000 7fba16ffd640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180acd20 0x7fba1814c7e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c870 tx=0x7fba0800cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:13.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.350+0000 7fba0ffff640 1 -- 172.21.15.63:0/1980755125 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08003b70 con 0x7fba180acd20 2023-12-04T10:45:13.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.350+0000 7fba0ffff640 1 -- 172.21.15.63:0/1980755125 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba08003cf0 con 0x7fba180acd20 2023-12-04T10:45:13.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.350+0000 7fba0ffff640 1 -- 172.21.15.63:0/1980755125 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800aa90 con 0x7fba180acd20 2023-12-04T10:45:13.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.350+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba180cc7c0 con 0x7fba180acd20 2023-12-04T10:45:13.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.350+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba180ccd80 con 0x7fba180acd20 2023-12-04T10:45:13.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.351+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba1804e840 con 0x7fba180acd20 2023-12-04T10:45:13.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.352+0000 7fba0ffff640 1 -- 172.21.15.63:0/1980755125 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fba0800abf0 con 0x7fba180acd20 2023-12-04T10:45:13.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.353+0000 7fba0ffff640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb9f806ae40 0x7fb9f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.353+0000 7fba0ffff640 1 -- 172.21.15.63:0/1980755125 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fba08089a00 con 0x7fba180acd20 2023-12-04T10:45:13.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.353+0000 7fba0e7fc640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb9f806ae40 0x7fb9f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.354+0000 7fba0e7fc640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb9f806ae40 0x7fb9f806d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fba00036000 tx=0x7fba0003b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:13.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.358+0000 7fba0ffff640 1 -- 172.21.15.63:0/1980755125 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fba080545c0 con 0x7fba180acd20 2023-12-04T10:45:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.553+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fba1806e3b0 con 0x7fba180acd20 2023-12-04T10:45:13.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.554+0000 7fba0ffff640 1 -- 172.21.15.63:0/1980755125 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fba08003e60 con 0x7fba180acd20 2023-12-04T10:45:13.555 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:13.557 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb9f806ae40 msgr2=0x7fb9f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb9f806ae40 0x7fb9f806d300 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fba00036000 tx=0x7fba0003b040 comp rx=0 tx=0).stop 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180acd20 msgr2=0x7fba1814c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180acd20 0x7fba1814c7e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fba0800c870 tx=0x7fba0800cd30 comp rx=0 tx=0).stop 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 shutdown_connections 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb9f806ae40 0x7fb9f806d300 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fba180b36b0 0x7fba180cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fba1815d0c0 0x7fba181f2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 --2- 172.21.15.63:0/1980755125 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fba180acd20 0x7fba1814c7e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.556+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 >> 172.21.15.63:0/1980755125 conn(0x7fba180b0860 msgr2=0x7fba1806c760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:13.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.557+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 shutdown_connections 2023-12-04T10:45:13.559 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.557+0000 7fba17fff640 1 -- 172.21.15.63:0/1980755125 wait complete. 2023-12-04T10:45:13.575 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:45:13.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.810+0000 7effd2cda640 1 Processor -- start 2023-12-04T10:45:13.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.810+0000 7effd2cda640 1 -- start start 2023-12-04T10:45:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.811+0000 7effd2cda640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc15e710 0x7effcc0cec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.812+0000 7effd2cda640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effcc0cc4a0 0x7effcc0cf460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.812+0000 7effd2cda640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effcc0c5020 con 0x7effcc0cf9a0 2023-12-04T10:45:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.812+0000 7effd2cda640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effcc0d1d60 con 0x7effcc0cc4a0 2023-12-04T10:45:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.812+0000 7effd2cda640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc0cfe30 con 0x7effcc15e710 2023-12-04T10:45:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.812+0000 7effd14d7640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7effcc0cc4a0 0x7effcc0cf460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.812+0000 7effd24d9640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7effcc0cf9a0 0x7effcc0cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58206/0 (socket says 172.21.15.63:58206) 2023-12-04T10:45:13.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.812+0000 7effd24d9640 1 -- 172.21.15.63:0/96402786 learned_addr learned my addr 172.21.15.63:0/96402786 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.812+0000 7effd1cd8640 1 --2- 172.21.15.63:0/96402786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc15e710 0x7effcc0cec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.813+0000 7effd14d7640 1 -- 172.21.15.63:0/96402786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc15e710 msgr2=0x7effcc0cec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.813+0000 7effd14d7640 1 --2- 172.21.15.63:0/96402786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc15e710 0x7effcc0cec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.813+0000 7effd14d7640 1 -- 172.21.15.63:0/96402786 >> v1:172.21.15.63:6789/0 conn(0x7effcc0cf9a0 legacy=0x7effcc0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.813+0000 7effd14d7640 1 -- 172.21.15.63:0/96402786 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effcc0cc9a0 con 0x7effcc0cc4a0 2023-12-04T10:45:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.813+0000 7effd0cd6640 1 -- 172.21.15.63:0/96402786 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 108882833 0 0) 0x7effcc0c5020 con 0x7effcc0cf9a0 2023-12-04T10:45:13.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.814+0000 7effd14d7640 1 --2- 172.21.15.63:0/96402786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc0cc4a0 0x7effcc0cf460 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7effbc0097a0 tx=0x7effbc02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f046d979b5d8bf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:13.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.814+0000 7effd0cd6640 1 -- 172.21.15.63:0/96402786 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc02d040 con 0x7effcc0cc4a0 2023-12-04T10:45:13.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.814+0000 7effd0cd6640 1 -- 172.21.15.63:0/96402786 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effbc031810 con 0x7effcc0cc4a0 2023-12-04T10:45:13.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.814+0000 7effd0cd6640 1 -- 172.21.15.63:0/96402786 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effbc031ba0 con 0x7effcc0cc4a0 2023-12-04T10:45:13.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.815+0000 7effd2cda640 1 -- 172.21.15.63:0/96402786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc0cc4a0 msgr2=0x7effcc0cf460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.815+0000 7effd2cda640 1 --2- 172.21.15.63:0/96402786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc0cc4a0 0x7effcc0cf460 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7effbc0097a0 tx=0x7effbc02b8b0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.815+0000 7effd2cda640 1 -- 172.21.15.63:0/96402786 shutdown_connections 2023-12-04T10:45:13.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.815+0000 7effd2cda640 1 --2- 172.21.15.63:0/96402786 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc0cc4a0 0x7effcc0cf460 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.815+0000 7effd2cda640 1 --2- 172.21.15.63:0/96402786 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc15e710 0x7effcc0cec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.815+0000 7effd2cda640 1 -- 172.21.15.63:0/96402786 >> 172.21.15.63:0/96402786 conn(0x7effcc0d0e80 msgr2=0x7effcc0d1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:13.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.815+0000 7effd2cda640 1 -- 172.21.15.63:0/96402786 shutdown_connections 2023-12-04T10:45:13.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.815+0000 7effd2cda640 1 -- 172.21.15.63:0/96402786 wait complete. 2023-12-04T10:45:13.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.818+0000 7effd2cda640 1 Processor -- start 2023-12-04T10:45:13.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.818+0000 7effd2cda640 1 -- start start 2023-12-04T10:45:13.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.819+0000 7effd2cda640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effcc0cc4a0 0x7effcc152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.819+0000 7effd2cda640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc0cf9a0 0x7effcc1efad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.819+0000 7effd2cda640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc15e710 0x7effcc1f0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.819+0000 7effd2cda640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc159290 con 0x7effcc15e710 2023-12-04T10:45:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.819+0000 7effd2cda640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effcc1549a0 con 0x7effcc0cc4a0 2023-12-04T10:45:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.819+0000 7effd2cda640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effcc159490 con 0x7effcc0cf9a0 2023-12-04T10:45:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc15e710 0x7effcc1f0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc15e710 0x7effcc1f0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:37190/0 (socket says 172.21.15.63:37190) 2023-12-04T10:45:13.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 -- 172.21.15.63:0/806553938 learned_addr learned my addr 172.21.15.63:0/806553938 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd1cd8640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effcc0cc4a0 0x7effcc152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd14d7640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc0cf9a0 0x7effcc1efad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 -- 172.21.15.63:0/806553938 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc0cf9a0 msgr2=0x7effcc1efad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc0cf9a0 0x7effcc1efad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 -- 172.21.15.63:0/806553938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effcc0cc4a0 msgr2=0x7effcc152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effcc0cc4a0 0x7effcc152f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:13.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 -- 172.21.15.63:0/806553938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc009400 con 0x7effcc15e710 2023-12-04T10:45:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.820+0000 7effd24d9640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc15e710 0x7effcc1f0010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7effc400c450 tx=0x7effc400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.821+0000 7effc27fc640 1 -- 172.21.15.63:0/806553938 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc40074e0 con 0x7effcc15e710 2023-12-04T10:45:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.821+0000 7effc27fc640 1 -- 172.21.15.63:0/806553938 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effc4007660 con 0x7effcc15e710 2023-12-04T10:45:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.821+0000 7effc27fc640 1 -- 172.21.15.63:0/806553938 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effc4004a20 con 0x7effcc15e710 2023-12-04T10:45:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.821+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effcc154c40 con 0x7effcc15e710 2023-12-04T10:45:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.821+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effcc159770 con 0x7effcc15e710 2023-12-04T10:45:13.823 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.822+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effcc154800 con 0x7effcc15e710 2023-12-04T10:45:13.824 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.823+0000 7effc27fc640 1 -- 172.21.15.63:0/806553938 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7effc4004b80 con 0x7effcc15e710 2023-12-04T10:45:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.824+0000 7effc27fc640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7effb006aec0 0x7effb006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:13.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.824+0000 7effc27fc640 1 -- 172.21.15.63:0/806553938 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7effc4088f10 con 0x7effcc15e710 2023-12-04T10:45:13.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.825+0000 7effd1cd8640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7effb006aec0 0x7effb006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:13.826 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.826+0000 7effd1cd8640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7effb006aec0 0x7effb006d380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7effc8009e90 tx=0x7effc800b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:13.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:13.829+0000 7effc27fc640 1 -- 172.21.15.63:0/806553938 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7effcc154800 con 0x7effcc15e710 2023-12-04T10:45:14.033 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.032+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7effcc155160 con 0x7effcc15e710 2023-12-04T10:45:14.034 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.033+0000 7effc27fc640 1 -- 172.21.15.63:0/806553938 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7effcc155160 con 0x7effcc15e710 2023-12-04T10:45:14.034 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:45:14.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7effb006aec0 msgr2=0x7effb006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7effb006aec0 0x7effb006d380 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7effc8009e90 tx=0x7effc800b040 comp rx=0 tx=0).stop 2023-12-04T10:45:14.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc15e710 msgr2=0x7effcc1f0010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc15e710 0x7effcc1f0010 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7effc400c450 tx=0x7effc400c910 comp rx=0 tx=0).stop 2023-12-04T10:45:14.037 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 shutdown_connections 2023-12-04T10:45:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7effb006aec0 0x7effb006d380 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7effcc0cf9a0 0x7effcc1efad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7effcc15e710 0x7effcc1f0010 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 --2- 172.21.15.63:0/806553938 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7effcc0cc4a0 0x7effcc152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 >> 172.21.15.63:0/806553938 conn(0x7effcc0d0e80 msgr2=0x7effcc159a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 shutdown_connections 2023-12-04T10:45:14.038 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.036+0000 7effd2cda640 1 -- 172.21.15.63:0/806553938 wait complete. 2023-12-04T10:45:14.058 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:45:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.285+0000 7fe08887b640 1 Processor -- start 2023-12-04T10:45:14.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.285+0000 7fe08887b640 1 -- start start 2023-12-04T10:45:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.286+0000 7fe08887b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe08415d200 0x7fe0840cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe08887b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840ceed0 0x7fe0840cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe08887b640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0840d0e60 con 0x7fe08415d5e0 2023-12-04T10:45:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe08887b640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0840b6f70 con 0x7fe08415d200 2023-12-04T10:45:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe08887b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840d1140 con 0x7fe0840ceed0 2023-12-04T10:45:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe08259c640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe08415d5e0 0x7fe0840ce7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51922/0 (socket says 172.21.15.63:51922) 2023-12-04T10:45:14.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe08259c640 1 -- 172.21.15.63:0/3805113778 learned_addr learned my addr 172.21.15.63:0/3805113778 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:14.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe082d9d640 1 --2- 172.21.15.63:0/3805113778 >> v2:172.21.15.66:3300/0 conn(0x7fe08415d200 0x7fe0840cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2500256538 0 0) 0x7fe0840d0e60 con 0x7fe08415d5e0 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe06c003520 con 0x7fe08415d5e0 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.287+0000 7fe08359e640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840ceed0 0x7fe0840cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1478016788 0 0) 0x7fe06c003520 con 0x7fe08415d5e0 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840ceed0 msgr2=0x7fe0840cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840ceed0 0x7fe0840cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 >> v2:172.21.15.66:3300/0 conn(0x7fe08415d200 msgr2=0x7fe0840cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 --2- 172.21.15.63:0/3805113778 >> v2:172.21.15.66:3300/0 conn(0x7fe08415d200 0x7fe0840cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840d1420 con 0x7fe08415d5e0 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fe078001670 con 0x7fe08415d5e0 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 >> v1:172.21.15.63:6789/0 conn(0x7fe08415d5e0 legacy=0x7fe0840ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe06c003970 0x7fe06c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe06c0047c0 0x7fe06c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe06c005180 0x7fe06c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840b6f70 con 0x7fe06c005180 2023-12-04T10:45:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0840d1140 con 0x7fe06c0047c0 2023-12-04T10:45:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.288+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe06c00bf40 con 0x7fe06c003970 2023-12-04T10:45:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.289+0000 7fe08359e640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe06c005180 0x7fe06c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.289+0000 7fe082d9d640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe06c003970 0x7fe06c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.289+0000 7fe08259c640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe06c0047c0 0x7fe06c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.289+0000 7fe08359e640 1 -- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe06c003970 msgr2=0x7fe06c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.289+0000 7fe08359e640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe06c003970 0x7fe06c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.289+0000 7fe08359e640 1 -- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe06c0047c0 msgr2=0x7fe06c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.289+0000 7fe08359e640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe06c0047c0 0x7fe06c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.289+0000 7fe08359e640 1 -- 172.21.15.63:0/3805113778 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c003520 con 0x7fe06c005180 2023-12-04T10:45:14.292 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.291+0000 7fe08359e640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe06c005180 0x7fe06c00b980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe0840cf2b0 tx=0x7fe06c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531290420330d4e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.291+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c034610 con 0x7fe06c005180 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.291+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c02e070 con 0x7fe06c005180 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.291+0000 7fe081d9b640 1 -- 172.21.15.63:0/3805113778 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c034990 con 0x7fe06c005180 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.292+0000 7fe08887b640 1 -- 172.21.15.63:0/3805113778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe06c005180 msgr2=0x7fe06c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.292+0000 7fe08887b640 1 --2- 172.21.15.63:0/3805113778 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe06c005180 0x7fe06c00b980 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fe0840cf2b0 tx=0x7fe06c0057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.292+0000 7fe08359e640 1 -- 172.21.15.63:0/3805113778 reap_dead start 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.292+0000 7fe08887b640 1 -- 172.21.15.63:0/3805113778 shutdown_connections 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.292+0000 7fe08887b640 1 -- 172.21.15.63:0/3805113778 >> 172.21.15.63:0/3805113778 conn(0x7fe08409c3e0 msgr2=0x7fe0840d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.292+0000 7fe08887b640 1 -- 172.21.15.63:0/3805113778 shutdown_connections 2023-12-04T10:45:14.293 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.292+0000 7fe08887b640 1 -- 172.21.15.63:0/3805113778 wait complete. 2023-12-04T10:45:14.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.294+0000 7fe08887b640 1 Processor -- start 2023-12-04T10:45:14.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.294+0000 7fe08887b640 1 -- start start 2023-12-04T10:45:14.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.295+0000 7fe08887b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0840c7680 0x7fe0840c93d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.295+0000 7fe08887b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840c7a60 0x7fe08414f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.295+0000 7fe08887b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe08414faf0 0x7fe08415a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.295+0000 7fe08887b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841504f0 con 0x7fe08414faf0 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.295+0000 7fe08887b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe08414ff70 con 0x7fe0840c7680 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.295+0000 7fe08887b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0841f6760 con 0x7fe0840c7a60 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe08414faf0 0x7fe08415a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe08414faf0 0x7fe08415a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51394/0 (socket says 172.21.15.63:51394) 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 -- 172.21.15.63:0/4182512536 learned_addr learned my addr 172.21.15.63:0/4182512536 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:14.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe082d9d640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0840c7680 0x7fe0840c93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08259c640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840c7a60 0x7fe08414f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 -- 172.21.15.63:0/4182512536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840c7a60 msgr2=0x7fe08414f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840c7a60 0x7fe08414f5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 -- 172.21.15.63:0/4182512536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0840c7680 msgr2=0x7fe0840c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0840c7680 0x7fe0840c93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 -- 172.21.15.63:0/4182512536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0840d2080 con 0x7fe08414faf0 2023-12-04T10:45:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.296+0000 7fe08359e640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe08414faf0 0x7fe08415a210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe07c02be60 tx=0x7fe07c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.297+0000 7fe06b7fe640 1 -- 172.21.15.63:0/4182512536 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c003d50 con 0x7fe08414faf0 2023-12-04T10:45:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.297+0000 7fe06b7fe640 1 -- 172.21.15.63:0/4182512536 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07c0044e0 con 0x7fe08414faf0 2023-12-04T10:45:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.297+0000 7fe06b7fe640 1 -- 172.21.15.63:0/4182512536 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07c03d670 con 0x7fe08414faf0 2023-12-04T10:45:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.297+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0841f6a40 con 0x7fe08414faf0 2023-12-04T10:45:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.297+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0841f7000 con 0x7fe08414faf0 2023-12-04T10:45:14.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.298+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0840b5360 con 0x7fe08414faf0 2023-12-04T10:45:14.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.299+0000 7fe06b7fe640 1 -- 172.21.15.63:0/4182512536 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe07c03d7d0 con 0x7fe08414faf0 2023-12-04T10:45:14.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.300+0000 7fe06b7fe640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe07006ae40 0x7fe07006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.300+0000 7fe06b7fe640 1 -- 172.21.15.63:0/4182512536 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe07c0ab400 con 0x7fe08414faf0 2023-12-04T10:45:14.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.300+0000 7fe082d9d640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe07006ae40 0x7fe07006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.302 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.301+0000 7fe082d9d640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe07006ae40 0x7fe07006d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe0841f6370 tx=0x7fe07400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:14.305 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.305+0000 7fe06b7fe640 1 -- 172.21.15.63:0/4182512536 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe07c0760e0 con 0x7fe08414faf0 2023-12-04T10:45:14.500 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.499+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe08404e840 con 0x7fe08414faf0 2023-12-04T10:45:14.501 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.500+0000 7fe06b7fe640 1 -- 172.21.15.63:0/4182512536 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe07c079700 con 0x7fe08414faf0 2023-12-04T10:45:14.501 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.502+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe07006ae40 msgr2=0x7fe07006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.502+0000 7fe08887b640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe07006ae40 0x7fe07006d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe0841f6370 tx=0x7fe07400b040 comp rx=0 tx=0).stop 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.502+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe08414faf0 msgr2=0x7fe08415a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.502+0000 7fe08887b640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe08414faf0 0x7fe08415a210 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe07c02be60 tx=0x7fe07c004730 comp rx=0 tx=0).stop 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.503+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 shutdown_connections 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.503+0000 7fe08887b640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe07006ae40 0x7fe07006d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.503+0000 7fe08887b640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0840c7a60 0x7fe08414f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.503+0000 7fe08887b640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe08414faf0 0x7fe08415a210 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.504 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.503+0000 7fe08887b640 1 --2- 172.21.15.63:0/4182512536 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0840c7680 0x7fe0840c93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.503+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 >> 172.21.15.63:0/4182512536 conn(0x7fe08409c3e0 msgr2=0x7fe08406c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:14.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.503+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 shutdown_connections 2023-12-04T10:45:14.505 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.503+0000 7fe08887b640 1 -- 172.21.15.63:0/4182512536 wait complete. 2023-12-04T10:45:14.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T10:45:14.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.752+0000 7f380e8d1640 1 Processor -- start 2023-12-04T10:45:14.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.753+0000 7f380e8d1640 1 -- start start 2023-12-04T10:45:14.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.754+0000 7f380e8d1640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f38080d16b0 0x7f38080d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.754+0000 7f380e8d1640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f380815d710 0x7f38080ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.754+0000 7f380e8d1640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38080d1fd0 con 0x7f38080d3cd0 2023-12-04T10:45:14.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.754+0000 7f380e8d1640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080cef40 con 0x7f38080d16b0 2023-12-04T10:45:14.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.754+0000 7f380e8d1640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38080b25c0 con 0x7f380815d710 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d8cf640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f38080d16b0 0x7f38080d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d8cf640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f38080d16b0 0x7f38080d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51406/0 (socket says 172.21.15.63:51406) 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d8cf640 1 -- 172.21.15.63:0/2733849732 learned_addr learned my addr 172.21.15.63:0/2733849732 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380e0d0640 1 --1- 172.21.15.63:0/2733849732 >> v1:172.21.15.63:6789/0 conn(0x7f38080d3cd0 0x7f38080cf770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51930/0 (socket says 172.21.15.63:51930) 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d0ce640 1 --2- 172.21.15.63:0/2733849732 >> v2:172.21.15.66:3300/0 conn(0x7f380815d710 0x7f38080ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d8cf640 1 -- 172.21.15.63:0/2733849732 >> v2:172.21.15.66:3300/0 conn(0x7f380815d710 msgr2=0x7f38080ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d8cf640 1 --2- 172.21.15.63:0/2733849732 >> v2:172.21.15.66:3300/0 conn(0x7f380815d710 0x7f38080ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d8cf640 1 -- 172.21.15.63:0/2733849732 >> v1:172.21.15.63:6789/0 conn(0x7f38080d3cd0 legacy=0x7f38080cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d8cf640 1 -- 172.21.15.63:0/2733849732 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38080b28a0 con 0x7f38080d16b0 2023-12-04T10:45:14.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.755+0000 7f380d0ce640 1 --2- 172.21.15.63:0/2733849732 >> v2:172.21.15.66:3300/0 conn(0x7f380815d710 0x7f38080ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:14.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.757+0000 7f380d8cf640 1 --2- 172.21.15.63:0/2733849732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38080d16b0 0x7f38080d1a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f380808c0a0 tx=0x7f380402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de71abbc77e4b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:14.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.757+0000 7f380c8cd640 1 -- 172.21.15.63:0/2733849732 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040317e0 con 0x7f38080d16b0 2023-12-04T10:45:14.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.757+0000 7f380c8cd640 1 -- 172.21.15.63:0/2733849732 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3804031940 con 0x7f38080d16b0 2023-12-04T10:45:14.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.757+0000 7f380c8cd640 1 -- 172.21.15.63:0/2733849732 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3804031cd0 con 0x7f38080d16b0 2023-12-04T10:45:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.758+0000 7f380e8d1640 1 -- 172.21.15.63:0/2733849732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38080d16b0 msgr2=0x7f38080d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.758+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2733849732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38080d16b0 0x7f38080d1a90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f380808c0a0 tx=0x7f380402b880 comp rx=0 tx=0).stop 2023-12-04T10:45:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.758+0000 7f380e8d1640 1 -- 172.21.15.63:0/2733849732 shutdown_connections 2023-12-04T10:45:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.758+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2733849732 >> v2:172.21.15.66:3300/0 conn(0x7f380815d710 0x7f38080ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.758+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2733849732 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f38080d16b0 0x7f38080d1a90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.758+0000 7f380e8d1640 1 -- 172.21.15.63:0/2733849732 >> 172.21.15.63:0/2733849732 conn(0x7f38080d30d0 msgr2=0x7f38080d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.758+0000 7f380e8d1640 1 -- 172.21.15.63:0/2733849732 shutdown_connections 2023-12-04T10:45:14.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.758+0000 7f380e8d1640 1 -- 172.21.15.63:0/2733849732 wait complete. 2023-12-04T10:45:14.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.760+0000 7f380e8d1640 1 Processor -- start 2023-12-04T10:45:14.760 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.760+0000 7f380e8d1640 1 -- start start 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e8d1640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38080d16b0 0x7f380815e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e8d1640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38080d3cd0 0x7f380814a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e8d1640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f380815d710 0x7f38080b85f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e8d1640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080c85f0 con 0x7f380815d710 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e8d1640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38080b8e90 con 0x7f38080d16b0 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e8d1640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38080c7c50 con 0x7f38080d3cd0 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e0d0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f380815d710 0x7f38080b85f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e0d0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f380815d710 0x7f38080b85f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51412/0 (socket says 172.21.15.63:51412) 2023-12-04T10:45:14.762 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380e0d0640 1 -- 172.21.15.63:0/2677021782 learned_addr learned my addr 172.21.15.63:0/2677021782 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:14.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.761+0000 7f380d8cf640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38080d16b0 0x7f380815e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380d0ce640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38080d3cd0 0x7f380814a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380e0d0640 1 -- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38080d3cd0 msgr2=0x7f380814a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380e0d0640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38080d3cd0 0x7f380814a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380e0d0640 1 -- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38080d16b0 msgr2=0x7f380815e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380e0d0640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38080d16b0 0x7f380815e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380e0d0640 1 -- 172.21.15.63:0/2677021782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38040094d0 con 0x7f380815d710 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380d8cf640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38080d16b0 0x7f380815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380e0d0640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f380815d710 0x7f38080b85f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f380000c780 tx=0x7f380000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f37fe7fc640 1 -- 172.21.15.63:0/2677021782 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380000ce90 con 0x7f380815d710 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f37fe7fc640 1 -- 172.21.15.63:0/2677021782 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380000a640 con 0x7f380815d710 2023-12-04T10:45:14.764 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f37fe7fc640 1 -- 172.21.15.63:0/2677021782 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380000a9f0 con 0x7f380815d710 2023-12-04T10:45:14.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.762+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38080c7f30 con 0x7f380815d710 2023-12-04T10:45:14.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.763+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380814aa40 con 0x7f380815d710 2023-12-04T10:45:14.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.764+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38080c8730 con 0x7f380815d710 2023-12-04T10:45:14.765 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.765+0000 7f37fe7fc640 1 -- 172.21.15.63:0/2677021782 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f380000ab50 con 0x7f380815d710 2023-12-04T10:45:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.766+0000 7f37fe7fc640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37ec06ae70 0x7f37ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.766+0000 7f37fe7fc640 1 -- 172.21.15.63:0/2677021782 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f3800089160 con 0x7f380815d710 2023-12-04T10:45:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.766+0000 7f380d8cf640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37ec06ae70 0x7f37ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:14.767 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.767+0000 7f380d8cf640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37ec06ae70 0x7f37ec06d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3804036000 tx=0x7f380403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:14.771 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.770+0000 7f37fe7fc640 1 -- 172.21.15.63:0/2677021782 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f38080c8730 con 0x7f380815d710 2023-12-04T10:45:14.980 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.979+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f38080c8730 con 0x7f380815d710 2023-12-04T10:45:14.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.980+0000 7f37fe7fc640 1 -- 172.21.15.63:0/2677021782 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v29) v1 ==== 80+0+0 (secure 0 0 0) 0x7f38080c8730 con 0x7f380815d710 2023-12-04T10:45:14.982 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-04T10:45:14.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.982+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37ec06ae70 msgr2=0x7f37ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.982+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37ec06ae70 0x7f37ec06d330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f3804036000 tx=0x7f380403d040 comp rx=0 tx=0).stop 2023-12-04T10:45:14.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.982+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f380815d710 msgr2=0x7f38080b85f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:14.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.982+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f380815d710 0x7f38080b85f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f380000c780 tx=0x7f380000cc40 comp rx=0 tx=0).stop 2023-12-04T10:45:14.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.983+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 shutdown_connections 2023-12-04T10:45:14.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.983+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37ec06ae70 0x7f37ec06d330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.983+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f38080d3cd0 0x7f380814a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.983+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f380815d710 0x7f38080b85f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.983+0000 7f380e8d1640 1 --2- 172.21.15.63:0/2677021782 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f38080d16b0 0x7f380815e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:14.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.983+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 >> 172.21.15.63:0/2677021782 conn(0x7f38080d30d0 msgr2=0x7f38080cdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:14.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.983+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 shutdown_connections 2023-12-04T10:45:14.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:14.983+0000 7f380e8d1640 1 -- 172.21.15.63:0/2677021782 wait complete. 2023-12-04T10:45:14.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:45:14.994 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:45:15.003 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-04T10:45:15.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:15.004 DEBUG:teuthology.orchestra.run.smithi066:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-04T10:45:15.101 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T10:45:15.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:15.101 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-04T10:45:15.151 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-04T10:45:15.151 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:45:15.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.384+0000 7fe194f9e640 1 Processor -- start 2023-12-04T10:45:15.385 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.384+0000 7fe194f9e640 1 -- start start 2023-12-04T10:45:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.386+0000 7fe194f9e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19006a940 0x7fe19006c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.386+0000 7fe194f9e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe1900ce530 0x7fe1900ce960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.386+0000 7fe194f9e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19006ce80 con 0x7fe1900c9c80 2023-12-04T10:45:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.386+0000 7fe194f9e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900cd4b0 con 0x7fe1900ce530 2023-12-04T10:45:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.386+0000 7fe194f9e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900cd790 con 0x7fe19006a940 2023-12-04T10:45:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.386+0000 7fe187fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe1900c9c80 0x7fe1900ca0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51944/0 (socket says 172.21.15.63:51944) 2023-12-04T10:45:15.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.386+0000 7fe187fff640 1 -- 172.21.15.63:0/3572341411 learned_addr learned my addr 172.21.15.63:0/3572341411 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18f7fe640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19006a940 0x7fe19006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.389 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3572341411 >> v2:172.21.15.66:3300/0 conn(0x7fe1900ce530 0x7fe1900ce960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2361033386 0 0) 0x7fe19006ce80 con 0x7fe1900c9c80 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe17c003520 con 0x7fe1900c9c80 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1501912108 0 0) 0x7fe17c003520 con 0x7fe1900c9c80 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19006a940 msgr2=0x7fe19006c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19006a940 0x7fe19006c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 >> v2:172.21.15.66:3300/0 conn(0x7fe1900ce530 msgr2=0x7fe1900ce960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 --2- 172.21.15.63:0/3572341411 >> v2:172.21.15.66:3300/0 conn(0x7fe1900ce530 0x7fe1900ce960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900cda70 con 0x7fe1900c9c80 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3572341411 >> v2:172.21.15.66:3300/0 conn(0x7fe1900ce530 0x7fe1900ce960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fe178001670 con 0x7fe1900c9c80 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 >> v1:172.21.15.63:6789/0 conn(0x7fe1900c9c80 legacy=0x7fe1900ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe17c003970 0x7fe17c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19006a940 0x7fe17c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe17c004d00 0x7fe17c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.387+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900cd4b0 con 0x7fe17c004d00 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900cd790 con 0x7fe17c003970 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c00bab0 con 0x7fe19006a940 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe17c004d00 0x7fe17c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18f7fe640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe17c003970 0x7fe17c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe187fff640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19006a940 0x7fe17c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18ffff640 1 -- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19006a940 msgr2=0x7fe17c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19006a940 0x7fe17c0047c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.391 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18ffff640 1 -- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe17c003970 msgr2=0x7fe17c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:15.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe17c003970 0x7fe17c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18ffff640 1 -- 172.21.15.63:0/3572341411 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c003520 con 0x7fe17c004d00 2023-12-04T10:45:15.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.388+0000 7fe18f7fe640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe17c003970 0x7fe17c003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:15.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.389+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe17c004d00 0x7fe17c005180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe1880073e0 tx=0x7fe17c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d7ef3f63db0e27 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.390+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18802cdc0 con 0x7fe17c004d00 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.390+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188034440 con 0x7fe17c004d00 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.390+0000 7fe18effd640 1 -- 172.21.15.63:0/3572341411 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880347b0 con 0x7fe17c004d00 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.390+0000 7fe194f9e640 1 -- 172.21.15.63:0/3572341411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe17c004d00 msgr2=0x7fe17c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.390+0000 7fe194f9e640 1 --2- 172.21.15.63:0/3572341411 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe17c004d00 0x7fe17c005180 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fe1880073e0 tx=0x7fe17c0057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.390+0000 7fe18ffff640 1 -- 172.21.15.63:0/3572341411 reap_dead start 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.390+0000 7fe194f9e640 1 -- 172.21.15.63:0/3572341411 shutdown_connections 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.390+0000 7fe194f9e640 1 -- 172.21.15.63:0/3572341411 >> 172.21.15.63:0/3572341411 conn(0x7fe1900cc0b0 msgr2=0x7fe1900cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.391+0000 7fe194f9e640 1 -- 172.21.15.63:0/3572341411 shutdown_connections 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.391+0000 7fe194f9e640 1 -- 172.21.15.63:0/3572341411 wait complete. 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.392+0000 7fe194f9e640 1 Processor -- start 2023-12-04T10:45:15.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.393+0000 7fe194f9e640 1 -- start start 2023-12-04T10:45:15.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe194f9e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19014fa40 0x7fe1900c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe194f9e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1900cc4c0 0x7fe1900cc940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe194f9e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19015df20 0x7fe19015e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe194f9e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900cce80 con 0x7fe19015df20 2023-12-04T10:45:15.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe194f9e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c3fa0 con 0x7fe1900cc4c0 2023-12-04T10:45:15.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe194f9e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c4280 con 0x7fe19014fa40 2023-12-04T10:45:15.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19015df20 0x7fe19015e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19015df20 0x7fe19015e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51428/0 (socket says 172.21.15.63:51428) 2023-12-04T10:45:15.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18ffff640 1 -- 172.21.15.63:0/3398389974 learned_addr learned my addr 172.21.15.63:0/3398389974 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:15.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18f7fe640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19014fa40 0x7fe1900c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe187fff640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1900cc4c0 0x7fe1900cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18ffff640 1 -- 172.21.15.63:0/3398389974 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19014fa40 msgr2=0x7fe1900c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19014fa40 0x7fe1900c5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18ffff640 1 -- 172.21.15.63:0/3398389974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1900cc4c0 msgr2=0x7fe1900cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1900cc4c0 0x7fe1900cc940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.394+0000 7fe18ffff640 1 -- 172.21.15.63:0/3398389974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900c4560 con 0x7fe19015df20 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.395+0000 7fe18ffff640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19015df20 0x7fe19015e3a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe188037040 tx=0x7fe188004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.395+0000 7fe18cff9640 1 -- 172.21.15.63:0/3398389974 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188034e20 con 0x7fe19015df20 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.395+0000 7fe18cff9640 1 -- 172.21.15.63:0/3398389974 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18803e440 con 0x7fe19015df20 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.395+0000 7fe18cff9640 1 -- 172.21.15.63:0/3398389974 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18803e7f0 con 0x7fe19015df20 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.395+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1900c4840 con 0x7fe19015df20 2023-12-04T10:45:15.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.395+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe19014fe20 con 0x7fe19015df20 2023-12-04T10:45:15.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.396+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19004e840 con 0x7fe19015df20 2023-12-04T10:45:15.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.397+0000 7fe18cff9640 1 -- 172.21.15.63:0/3398389974 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe18803e950 con 0x7fe19015df20 2023-12-04T10:45:15.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.398+0000 7fe18cff9640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe17006ae40 0x7fe17006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.407 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.398+0000 7fe18cff9640 1 -- 172.21.15.63:0/3398389974 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fe1880ab9f0 con 0x7fe19015df20 2023-12-04T10:45:15.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.398+0000 7fe18f7fe640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe17006ae40 0x7fe17006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.399+0000 7fe18f7fe640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe17006ae40 0x7fe17006d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe180006fd0 tx=0x7fe180008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:15.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.403+0000 7fe18cff9640 1 -- 172.21.15.63:0/3398389974 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe1880765b0 con 0x7fe19015df20 2023-12-04T10:45:15.634 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.633+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe190073b70 con 0x7fe19015df20 2023-12-04T10:45:15.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.634+0000 7fe18cff9640 1 -- 172.21.15.63:0/3398389974 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7fe188039070 con 0x7fe19015df20 2023-12-04T10:45:15.636 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:15.636 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:44:21.556693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T10:45:15.636 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe17006ae40 msgr2=0x7fe17006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe17006ae40 0x7fe17006d300 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe180006fd0 tx=0x7fe180008040 comp rx=0 tx=0).stop 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19015df20 msgr2=0x7fe19015e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19015df20 0x7fe19015e3a0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fe188037040 tx=0x7fe188004ab0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 shutdown_connections 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe17006ae40 0x7fe17006d300 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe19015df20 0x7fe19015e3a0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe1900cc4c0 0x7fe1900cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 --2- 172.21.15.63:0/3398389974 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe19014fa40 0x7fe1900c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 >> 172.21.15.63:0/3398389974 conn(0x7fe1900cc0b0 msgr2=0x7fe1900afa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.637+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 shutdown_connections 2023-12-04T10:45:15.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.638+0000 7fe194f9e640 1 -- 172.21.15.63:0/3398389974 wait complete. 2023-12-04T10:45:15.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:15.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.873+0000 7f136b29e640 1 Processor -- start 2023-12-04T10:45:15.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.873+0000 7f136b29e640 1 -- start start 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136b29e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1364160920 0x7f136406bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136b29e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f136406b560 0x7f136406c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136b29e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 0x7f13640cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136b29e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1364160d00 con 0x7f1364160920 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136b29e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13640cfb50 con 0x7f136406b560 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136b29e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640b0840 con 0x7f13640b0260 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136a29c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1364160920 0x7f136406bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136a29c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1364160920 0x7f136406bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51432/0 (socket says 172.21.15.63:51432) 2023-12-04T10:45:15.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.875+0000 7f136a29c640 1 -- 172.21.15.63:0/635938457 learned_addr learned my addr 172.21.15.63:0/635938457 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.876+0000 7f136a29c640 1 -- 172.21.15.63:0/635938457 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 msgr2=0x7f13640cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.876+0000 7f136aa9d640 1 --2- 172.21.15.63:0/635938457 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 0x7f13640cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.876+0000 7f1369a9b640 1 --2- 172.21.15.63:0/635938457 >> v2:172.21.15.66:3300/0 conn(0x7f136406b560 0x7f136406c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.876+0000 7f136a29c640 1 --2- 172.21.15.63:0/635938457 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 0x7f13640cd6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.876+0000 7f136a29c640 1 -- 172.21.15.63:0/635938457 >> v2:172.21.15.66:3300/0 conn(0x7f136406b560 msgr2=0x7f136406c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.876+0000 7f136a29c640 1 --2- 172.21.15.63:0/635938457 >> v2:172.21.15.66:3300/0 conn(0x7f136406b560 0x7f136406c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.876+0000 7f136a29c640 1 -- 172.21.15.63:0/635938457 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13640cfda0 con 0x7f1364160920 2023-12-04T10:45:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.876+0000 7f1369a9b640 1 --2- 172.21.15.63:0/635938457 >> v2:172.21.15.66:3300/0 conn(0x7f136406b560 0x7f136406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.877+0000 7f136a29c640 1 --2- 172.21.15.63:0/635938457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f136406bc20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1360009870 tx=0x7f136002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3104a4588b7180a9 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:15.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.877+0000 7f136929a640 1 -- 172.21.15.63:0/635938457 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360031640 con 0x7f1364160920 2023-12-04T10:45:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.877+0000 7f136929a640 1 -- 172.21.15.63:0/635938457 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13600317a0 con 0x7f1364160920 2023-12-04T10:45:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.877+0000 7f136929a640 1 -- 172.21.15.63:0/635938457 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1360031b30 con 0x7f1364160920 2023-12-04T10:45:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 -- 172.21.15.63:0/635938457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 msgr2=0x7f136406bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 --2- 172.21.15.63:0/635938457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f136406bc20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f1360009870 tx=0x7f136002b8f0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 -- 172.21.15.63:0/635938457 shutdown_connections 2023-12-04T10:45:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 --2- 172.21.15.63:0/635938457 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 0x7f13640cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 --2- 172.21.15.63:0/635938457 >> v2:172.21.15.66:3300/0 conn(0x7f136406b560 0x7f136406c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 --2- 172.21.15.63:0/635938457 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f136406bc20 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 -- 172.21.15.63:0/635938457 >> 172.21.15.63:0/635938457 conn(0x7f13640d0e40 msgr2=0x7f13640d1250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 -- 172.21.15.63:0/635938457 shutdown_connections 2023-12-04T10:45:15.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.878+0000 7f136b29e640 1 -- 172.21.15.63:0/635938457 wait complete. 2023-12-04T10:45:15.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.880+0000 7f136b29e640 1 Processor -- start 2023-12-04T10:45:15.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.881+0000 7f136b29e640 1 -- start start 2023-12-04T10:45:15.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.882+0000 7f136b29e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136406b560 0x7f13641f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.882+0000 7f136b29e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 0x7f13641f2920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.882+0000 7f136b29e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f13640b45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.882+0000 7f136b29e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136415ac10 con 0x7f1364160920 2023-12-04T10:45:15.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.882+0000 7f136b29e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136415ae60 con 0x7f136406b560 2023-12-04T10:45:15.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.882+0000 7f136b29e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13640b3ac0 con 0x7f13640b0260 2023-12-04T10:45:15.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.882+0000 7f136aa9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f13640b45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.882+0000 7f136aa9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f13640b45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51446/0 (socket says 172.21.15.63:51446) 2023-12-04T10:45:15.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f136aa9d640 1 -- 172.21.15.63:0/881272337 learned_addr learned my addr 172.21.15.63:0/881272337 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:15.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f136a29c640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136406b560 0x7f13641f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f1369a9b640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 0x7f13641f2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f136aa9d640 1 -- 172.21.15.63:0/881272337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 msgr2=0x7f13641f2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f136aa9d640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 0x7f13641f2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f136aa9d640 1 -- 172.21.15.63:0/881272337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136406b560 msgr2=0x7f13641f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f136aa9d640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136406b560 0x7f13641f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f136aa9d640 1 -- 172.21.15.63:0/881272337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13600094d0 con 0x7f1364160920 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.883+0000 7f136aa9d640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f13640b45a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f135c00cd40 tx=0x7f135c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.884+0000 7f135affd640 1 -- 172.21.15.63:0/881272337 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c003b90 con 0x7f1364160920 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.884+0000 7f135affd640 1 -- 172.21.15.63:0/881272337 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f135c003cf0 con 0x7f1364160920 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.884+0000 7f135affd640 1 -- 172.21.15.63:0/881272337 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135c004240 con 0x7f1364160920 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.884+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13640b3da0 con 0x7f1364160920 2023-12-04T10:45:15.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.884+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13641f2e60 con 0x7f1364160920 2023-12-04T10:45:15.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.885+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13640b42c0 con 0x7f1364160920 2023-12-04T10:45:15.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.886+0000 7f135affd640 1 -- 172.21.15.63:0/881272337 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f135c0043a0 con 0x7f1364160920 2023-12-04T10:45:15.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.887+0000 7f135affd640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f134806ae40 0x7f134806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.887+0000 7f135affd640 1 -- 172.21.15.63:0/881272337 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f135c012070 con 0x7f1364160920 2023-12-04T10:45:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.887+0000 7f136a29c640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f134806ae40 0x7f134806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:15.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.888+0000 7f136a29c640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f134806ae40 0x7f134806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1360036000 tx=0x7f136003c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:15.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:15.891+0000 7f135affd640 1 -- 172.21.15.63:0/881272337 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f13640b42c0 con 0x7f1364160920 2023-12-04T10:45:16.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.091+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13640b42c0 con 0x7f1364160920 2023-12-04T10:45:16.094 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.094+0000 7f135affd640 1 -- 172.21.15.63:0/881272337 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7f13640b42c0 con 0x7f1364160920 2023-12-04T10:45:16.095 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:16.095 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f134806ae40 msgr2=0x7f134806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f134806ae40 0x7f134806d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1360036000 tx=0x7f136003c040 comp rx=0 tx=0).stop 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 msgr2=0x7f13640b45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f13640b45a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f135c00cd40 tx=0x7f135c00a660 comp rx=0 tx=0).stop 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 shutdown_connections 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f134806ae40 0x7f134806d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f13640b0260 0x7f13641f2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1364160920 0x7f13640b45a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 --2- 172.21.15.63:0/881272337 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f136406b560 0x7f13641f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.096+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 >> 172.21.15.63:0/881272337 conn(0x7f13640d0e40 msgr2=0x7f13640d04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.097+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 shutdown_connections 2023-12-04T10:45:16.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.097+0000 7f136b29e640 1 -- 172.21.15.63:0/881272337 wait complete. 2023-12-04T10:45:16.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:43:50.631085+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:43:51.716722+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-04T10:43:56.060583+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '27', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-04T10:45:16.118 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:45:16.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.339+0000 7f91ef59e640 1 Processor -- start 2023-12-04T10:45:16.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.339+0000 7f91ef59e640 1 -- start start 2023-12-04T10:45:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.341+0000 7f91ef59e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f91f0143950 0x7f91f006d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.341+0000 7f91ef59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f006dcf0 0x7f91f0070090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.341+0000 7f91ef59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f015b280 con 0x7f91f00b3790 2023-12-04T10:45:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.341+0000 7f91ef59e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91f00b26f0 con 0x7f91f0143950 2023-12-04T10:45:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.341+0000 7f91ef59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00b29d0 con 0x7f91f006dcf0 2023-12-04T10:45:16.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.341+0000 7f91ee59c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f91f0143950 0x7f91f006d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.341+0000 7f91ee59c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f91f0143950 0x7f91f006d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51460/0 (socket says 172.21.15.63:51460) 2023-12-04T10:45:16.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.341+0000 7f91ee59c640 1 -- 172.21.15.63:0/3038967896 learned_addr learned my addr 172.21.15.63:0/3038967896 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:16.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.342+0000 7f91eed9d640 1 --2- 172.21.15.63:0/3038967896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f006dcf0 0x7f91f0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.342+0000 7f91ee59c640 1 -- 172.21.15.63:0/3038967896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f006dcf0 msgr2=0x7f91f0070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:16.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.342+0000 7f91ee59c640 1 --2- 172.21.15.63:0/3038967896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f006dcf0 0x7f91f0070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.342+0000 7f91ee59c640 1 -- 172.21.15.63:0/3038967896 >> v1:172.21.15.66:6789/0 conn(0x7f91f00b3790 legacy=0x7f91f015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.342+0000 7f91ee59c640 1 -- 172.21.15.63:0/3038967896 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00b2cb0 con 0x7f91f0143950 2023-12-04T10:45:16.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.343+0000 7f91ee59c640 1 --2- 172.21.15.63:0/3038967896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f0143950 0x7f91f006d7b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009870 tx=0x7f91e002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758663e0bdf6c2d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:16.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ed59a640 1 -- 172.21.15.63:0/3038967896 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0030840 con 0x7f91f0143950 2023-12-04T10:45:16.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ed59a640 1 -- 172.21.15.63:0/3038967896 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e00309a0 con 0x7f91f0143950 2023-12-04T10:45:16.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ed59a640 1 -- 172.21.15.63:0/3038967896 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0030d30 con 0x7f91f0143950 2023-12-04T10:45:16.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ef59e640 1 -- 172.21.15.63:0/3038967896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f0143950 msgr2=0x7f91f006d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ef59e640 1 --2- 172.21.15.63:0/3038967896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f0143950 0x7f91f006d7b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009870 tx=0x7f91e002b980 comp rx=0 tx=0).stop 2023-12-04T10:45:16.345 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ef59e640 1 -- 172.21.15.63:0/3038967896 shutdown_connections 2023-12-04T10:45:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ef59e640 1 --2- 172.21.15.63:0/3038967896 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f006dcf0 0x7f91f0070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ef59e640 1 --2- 172.21.15.63:0/3038967896 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f0143950 0x7f91f006d7b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.344+0000 7f91ef59e640 1 -- 172.21.15.63:0/3038967896 >> 172.21.15.63:0/3038967896 conn(0x7f91f00b0860 msgr2=0x7f91f00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.345+0000 7f91ef59e640 1 -- 172.21.15.63:0/3038967896 shutdown_connections 2023-12-04T10:45:16.346 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.345+0000 7f91ef59e640 1 -- 172.21.15.63:0/3038967896 wait complete. 2023-12-04T10:45:16.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.346+0000 7f91ef59e640 1 Processor -- start 2023-12-04T10:45:16.347 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.347+0000 7f91ef59e640 1 -- start start 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.347+0000 7f91ef59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f006dcf0 0x7f91f0142c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.347+0000 7f91ef59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f0143950 0x7f91f01eedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ef59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f013c200 0x7f91f0141f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ef59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0140c60 con 0x7f91f006dcf0 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ef59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0143180 con 0x7f91f0143950 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ef59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0140eb0 con 0x7f91f013c200 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ee59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f006dcf0 0x7f91f0142c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ee59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f006dcf0 0x7f91f0142c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51472/0 (socket says 172.21.15.63:51472) 2023-12-04T10:45:16.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ee59c640 1 -- 172.21.15.63:0/2014104884 learned_addr learned my addr 172.21.15.63:0/2014104884 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91edd9b640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f0143950 0x7f91f01eedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ee59c640 1 -- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f013c200 msgr2=0x7f91f0141f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91eed9d640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f013c200 0x7f91f0141f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ee59c640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f013c200 0x7f91f0141f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.350 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ee59c640 1 -- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f0143950 msgr2=0x7f91f01eedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ee59c640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f0143950 0x7f91f01eedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91ee59c640 1 -- 172.21.15.63:0/2014104884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e00094d0 con 0x7f91f006dcf0 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.348+0000 7f91edd9b640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f0143950 0x7f91f01eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.349+0000 7f91ee59c640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f006dcf0 0x7f91f0142c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009870 tx=0x7f91e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.349+0000 7f91deffd640 1 -- 172.21.15.63:0/2014104884 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e0039a90 con 0x7f91f006dcf0 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.349+0000 7f91deffd640 1 -- 172.21.15.63:0/2014104884 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e0039bf0 con 0x7f91f006dcf0 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.349+0000 7f91deffd640 1 -- 172.21.15.63:0/2014104884 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e00433f0 con 0x7f91f006dcf0 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.349+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f0141190 con 0x7f91f006dcf0 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.349+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f0141750 con 0x7f91f006dcf0 2023-12-04T10:45:16.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.351+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f004e840 con 0x7f91f006dcf0 2023-12-04T10:45:16.352 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.352+0000 7f91deffd640 1 -- 172.21.15.63:0/2014104884 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f91e0042390 con 0x7f91f006dcf0 2023-12-04T10:45:16.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.352+0000 7f91deffd640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f91d006ae40 0x7f91d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.353+0000 7f91deffd640 1 -- 172.21.15.63:0/2014104884 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f91e00abbe0 con 0x7f91f006dcf0 2023-12-04T10:45:16.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.353+0000 7f91edd9b640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f91d006ae40 0x7f91d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.354 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.353+0000 7f91edd9b640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f91d006ae40 0x7f91d006d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91f0159830 tx=0x7f91e4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:16.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.357+0000 7f91deffd640 1 -- 172.21.15.63:0/2014104884 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f91e00768c0 con 0x7f91f006dcf0 2023-12-04T10:45:16.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.549+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f91f006c2b0 con 0x7f91f006dcf0 2023-12-04T10:45:16.550 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.550+0000 7f91deffd640 1 -- 172.21.15.63:0/2014104884 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f91e00480a0 con 0x7f91f006dcf0 2023-12-04T10:45:16.551 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:45:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f91d006ae40 msgr2=0x7f91d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f91d006ae40 0x7f91d006d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f91f0159830 tx=0x7f91e4009040 comp rx=0 tx=0).stop 2023-12-04T10:45:16.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f006dcf0 msgr2=0x7f91f0142c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f006dcf0 0x7f91f0142c40 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f91e0009870 tx=0x7f91e0004730 comp rx=0 tx=0).stop 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 shutdown_connections 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f91d006ae40 0x7f91d006d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f91f013c200 0x7f91f0141f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f91f0143950 0x7f91f01eedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 --2- 172.21.15.63:0/2014104884 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f91f006dcf0 0x7f91f0142c40 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.552+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 >> 172.21.15.63:0/2014104884 conn(0x7f91f00b0860 msgr2=0x7f91f006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.553+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 shutdown_connections 2023-12-04T10:45:16.554 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.553+0000 7f91ef59e640 1 -- 172.21.15.63:0/2014104884 wait complete. 2023-12-04T10:45:16.573 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T10:45:16.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.803+0000 7fb4a6e09640 1 Processor -- start 2023-12-04T10:45:16.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.803+0000 7fb4a6e09640 1 -- start start 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.805+0000 7fb4a6e09640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb4a0143ca0 0x7fb4a00b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.805+0000 7fb4a6e09640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb4a006c520 0x7fb4a00cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.805+0000 7fb4a6e09640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a00cb800 con 0x7fb4a00b3350 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.805+0000 7fb4a6e09640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00cbae0 con 0x7fb4a006c520 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.805+0000 7fb4a6e09640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00cbdc0 con 0x7fb4a0143ca0 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.805+0000 7fb4a6608640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb4a006c520 0x7fb4a00cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.805+0000 7fb4a6608640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb4a006c520 0x7fb4a00cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51478/0 (socket says 172.21.15.63:51478) 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.805+0000 7fb4a6608640 1 -- 172.21.15.63:0/1889809286 learned_addr learned my addr 172.21.15.63:0/1889809286 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:16.807 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.806+0000 7fb4a5e07640 1 --2- 172.21.15.63:0/1889809286 >> v2:172.21.15.66:3300/0 conn(0x7fb4a0143ca0 0x7fb4a00b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.806+0000 7fb4a6608640 1 -- 172.21.15.63:0/1889809286 >> v2:172.21.15.66:3300/0 conn(0x7fb4a0143ca0 msgr2=0x7fb4a00b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:16.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.806+0000 7fb4a6608640 1 --2- 172.21.15.63:0/1889809286 >> v2:172.21.15.66:3300/0 conn(0x7fb4a0143ca0 0x7fb4a00b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.806+0000 7fb4a6608640 1 -- 172.21.15.63:0/1889809286 >> v1:172.21.15.66:6789/0 conn(0x7fb4a00b3350 legacy=0x7fb4a006be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:16.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.806+0000 7fb4a6608640 1 -- 172.21.15.63:0/1889809286 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a00b2610 con 0x7fb4a006c520 2023-12-04T10:45:16.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.806+0000 7fb4a5e07640 1 --2- 172.21.15.63:0/1889809286 >> v2:172.21.15.66:3300/0 conn(0x7fb4a0143ca0 0x7fb4a00b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:16.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.807+0000 7fb4a6608640 1 --2- 172.21.15.63:0/1889809286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a00cd370 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb4a006e5a0 tx=0x7fb49802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f64de5c48f1bc715 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:16.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.807+0000 7fb4a4e05640 1 -- 172.21.15.63:0/1889809286 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49802ca80 con 0x7fb4a006c520 2023-12-04T10:45:16.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.807+0000 7fb4a4e05640 1 -- 172.21.15.63:0/1889809286 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49802cbe0 con 0x7fb4a006c520 2023-12-04T10:45:16.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.807+0000 7fb4a4e05640 1 -- 172.21.15.63:0/1889809286 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4980343f0 con 0x7fb4a006c520 2023-12-04T10:45:16.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.808+0000 7fb4a6e09640 1 -- 172.21.15.63:0/1889809286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 msgr2=0x7fb4a00cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.808+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/1889809286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a00cd370 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb4a006e5a0 tx=0x7fb49802bee0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.808+0000 7fb4a6e09640 1 -- 172.21.15.63:0/1889809286 shutdown_connections 2023-12-04T10:45:16.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.808+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/1889809286 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a00cd370 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.808+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/1889809286 >> v2:172.21.15.66:3300/0 conn(0x7fb4a0143ca0 0x7fb4a00b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.808+0000 7fb4a6e09640 1 -- 172.21.15.63:0/1889809286 >> 172.21.15.63:0/1889809286 conn(0x7fb4a00b0860 msgr2=0x7fb4a00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:16.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.808+0000 7fb4a6e09640 1 -- 172.21.15.63:0/1889809286 shutdown_connections 2023-12-04T10:45:16.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.808+0000 7fb4a6e09640 1 -- 172.21.15.63:0/1889809286 wait complete. 2023-12-04T10:45:16.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.810+0000 7fb4a6e09640 1 Processor -- start 2023-12-04T10:45:16.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.811+0000 7fb4a6e09640 1 -- start start 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a6e09640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a015a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a6e09640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4a00b3350 0x7fb4a015e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a6e09640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4a0143ca0 0x7fb4a006c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a6e09640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a015d270 con 0x7fb4a006c520 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a6e09640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a015ac20 con 0x7fb4a00b3350 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a6e09640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a015c5f0 con 0x7fb4a0143ca0 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5e07640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a015a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5e07640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a015a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51488/0 (socket says 172.21.15.63:51488) 2023-12-04T10:45:16.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5e07640 1 -- 172.21.15.63:0/2364628324 learned_addr learned my addr 172.21.15.63:0/2364628324 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:16.814 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5606640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4a00b3350 0x7fb4a015e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5e07640 1 -- 172.21.15.63:0/2364628324 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4a0143ca0 msgr2=0x7fb4a006c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5e07640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4a0143ca0 0x7fb4a006c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5e07640 1 -- 172.21.15.63:0/2364628324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4a00b3350 msgr2=0x7fb4a015e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5e07640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4a00b3350 0x7fb4a015e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.812+0000 7fb4a5e07640 1 -- 172.21.15.63:0/2364628324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb498009b30 con 0x7fb4a006c520 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.813+0000 7fb4a5606640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4a00b3350 0x7fb4a015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.813+0000 7fb4a5e07640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a015a6e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00c7f0 tx=0x7fb49c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.813+0000 7fb4967fc640 1 -- 172.21.15.63:0/2364628324 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c007820 con 0x7fb4a006c520 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.813+0000 7fb4967fc640 1 -- 172.21.15.63:0/2364628324 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49c007980 con 0x7fb4a006c520 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.813+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a015c8d0 con 0x7fb4a006c520 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.813+0000 7fb4967fc640 1 -- 172.21.15.63:0/2364628324 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c007cf0 con 0x7fb4a006c520 2023-12-04T10:45:16.815 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.813+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a015ce90 con 0x7fb4a006c520 2023-12-04T10:45:16.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.815+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a015d4e0 con 0x7fb4a006c520 2023-12-04T10:45:16.816 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.816+0000 7fb4967fc640 1 -- 172.21.15.63:0/2364628324 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb49c0113f0 con 0x7fb4a006c520 2023-12-04T10:45:16.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.816+0000 7fb4967fc640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb48406ae40 0x7fb48406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:16.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.817+0000 7fb4967fc640 1 -- 172.21.15.63:0/2364628324 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fb49c089ce0 con 0x7fb4a006c520 2023-12-04T10:45:16.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.817+0000 7fb4a5606640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb48406ae40 0x7fb48406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:16.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.818+0000 7fb4a5606640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb48406ae40 0x7fb48406d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb4a013e630 tx=0x7fb490009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:16.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:16.821+0000 7fb4967fc640 1 -- 172.21.15.63:0/2364628324 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb49c0549d0 con 0x7fb4a006c520 2023-12-04T10:45:17.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.014+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb4a004e840 con 0x7fb4a006c520 2023-12-04T10:45:17.016 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.015+0000 7fb4967fc640 1 -- 172.21.15.63:0/2364628324 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v29) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb49c057ff0 con 0x7fb4a006c520 2023-12-04T10:45:17.016 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:17.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.017+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb48406ae40 msgr2=0x7fb48406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.018 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.017+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb48406ae40 0x7fb48406d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb4a013e630 tx=0x7fb490009040 comp rx=0 tx=0).stop 2023-12-04T10:45:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.017+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 msgr2=0x7fb4a015a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a015a6e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fb49c00c7f0 tx=0x7fb49c00ccb0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 shutdown_connections 2023-12-04T10:45:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb48406ae40 0x7fb48406d300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb4a0143ca0 0x7fb4a006c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb4a00b3350 0x7fb4a015e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 --2- 172.21.15.63:0/2364628324 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb4a006c520 0x7fb4a015a6e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 >> 172.21.15.63:0/2364628324 conn(0x7fb4a00b0860 msgr2=0x7fb4a00adfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:17.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 shutdown_connections 2023-12-04T10:45:17.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.018+0000 7fb4a6e09640 1 -- 172.21.15.63:0/2364628324 wait complete. 2023-12-04T10:45:17.038 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T10:45:17.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.248+0000 7f0ebb306640 1 Processor -- start 2023-12-04T10:45:17.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.248+0000 7f0ebb306640 1 -- start start 2023-12-04T10:45:17.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.249+0000 7f0ebb306640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0eb415d200 0x7f0eb40cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.249+0000 7f0ebb306640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d5e0 0x7f0eb40cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.249+0000 7f0ebb306640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eb40b6f70 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.249+0000 7f0ebb306640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eb40d0e60 con 0x7f0eb415d200 2023-12-04T10:45:17.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.249+0000 7f0ebb306640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40d1140 con 0x7f0eb415d5e0 2023-12-04T10:45:17.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.250+0000 7f0eba304640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0eb415d200 0x7f0eb40cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.250+0000 7f0eba304640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f0eb415d200 0x7f0eb40cfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:55520/0 (socket says 172.21.15.63:55520) 2023-12-04T10:45:17.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.250+0000 7f0eba304640 1 -- 172.21.15.63:0/2972685732 learned_addr learned my addr 172.21.15.63:0/2972685732 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:17.251 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.250+0000 7f0eb9b03640 1 --2- 172.21.15.63:0/2972685732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d5e0 0x7f0eb40cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.251+0000 7f0eba304640 1 -- 172.21.15.63:0/2972685732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d5e0 msgr2=0x7f0eb40cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:17.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.251+0000 7f0eba304640 1 --2- 172.21.15.63:0/2972685732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d5e0 0x7f0eb40cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.251+0000 7f0eba304640 1 -- 172.21.15.63:0/2972685732 >> v1:172.21.15.66:6789/0 conn(0x7f0eb40ce7c0 legacy=0x7f0eb4160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.252 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.251+0000 7f0eba304640 1 -- 172.21.15.63:0/2972685732 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40d1420 con 0x7f0eb415d200 2023-12-04T10:45:17.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.252+0000 7f0eba304640 1 --2- 172.21.15.63:0/2972685732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d200 0x7f0eb40cfa70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009e50 tx=0x7f0ea402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c62008e229d1930b server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:17.253 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0eb9302640 1 -- 172.21.15.63:0/2972685732 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea402cb00 con 0x7f0eb415d200 2023-12-04T10:45:17.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0eb9302640 1 -- 172.21.15.63:0/2972685732 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea402cc60 con 0x7f0eb415d200 2023-12-04T10:45:17.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0eb9302640 1 -- 172.21.15.63:0/2972685732 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40343f0 con 0x7f0eb415d200 2023-12-04T10:45:17.254 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0ebb306640 1 -- 172.21.15.63:0/2972685732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d200 msgr2=0x7f0eb40cfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0ebb306640 1 --2- 172.21.15.63:0/2972685732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d200 0x7f0eb40cfa70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4009e50 tx=0x7f0ea402bf60 comp rx=0 tx=0).stop 2023-12-04T10:45:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0ebb306640 1 -- 172.21.15.63:0/2972685732 shutdown_connections 2023-12-04T10:45:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0ebb306640 1 --2- 172.21.15.63:0/2972685732 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d5e0 0x7f0eb40cffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0ebb306640 1 --2- 172.21.15.63:0/2972685732 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d200 0x7f0eb40cfa70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.253+0000 7f0ebb306640 1 -- 172.21.15.63:0/2972685732 >> 172.21.15.63:0/2972685732 conn(0x7f0eb409c3e0 msgr2=0x7f0eb40d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.254+0000 7f0ebb306640 1 -- 172.21.15.63:0/2972685732 shutdown_connections 2023-12-04T10:45:17.255 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.254+0000 7f0ebb306640 1 -- 172.21.15.63:0/2972685732 wait complete. 2023-12-04T10:45:17.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.255+0000 7f0ebb306640 1 Processor -- start 2023-12-04T10:45:17.256 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.256+0000 7f0ebb306640 1 -- start start 2023-12-04T10:45:17.257 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.256+0000 7f0ebb306640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40ce7c0 0x7f0eb41493e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.256+0000 7f0ebb306640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d200 0x7f0eb4153210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.256+0000 7f0ebb306640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d5e0 0x7f0eb4153750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.256+0000 7f0ebb306640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb4149920 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.256+0000 7f0ebb306640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb40cae50 con 0x7f0eb415d5e0 2023-12-04T10:45:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.256+0000 7f0ebb306640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eb415f9c0 con 0x7f0eb415d200 2023-12-04T10:45:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eba304640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40ce7c0 0x7f0eb41493e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eba304640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40ce7c0 0x7f0eb41493e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51498/0 (socket says 172.21.15.63:51498) 2023-12-04T10:45:17.258 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eba304640 1 -- 172.21.15.63:0/1672473720 learned_addr learned my addr 172.21.15.63:0/1672473720 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:17.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eb9b03640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d200 0x7f0eb4153210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0ebab05640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d5e0 0x7f0eb4153750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.259 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eba304640 1 -- 172.21.15.63:0/1672473720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d200 msgr2=0x7f0eb4153210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.260 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eba304640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d200 0x7f0eb4153210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eba304640 1 -- 172.21.15.63:0/1672473720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d5e0 msgr2=0x7f0eb4153750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eba304640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d5e0 0x7f0eb4153750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.257+0000 7f0eba304640 1 -- 172.21.15.63:0/1672473720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea4009b30 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.258+0000 7f0eba304640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40ce7c0 0x7f0eb41493e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4000f80 tx=0x7f0ea4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.258+0000 7f0eb2ffd640 1 -- 172.21.15.63:0/1672473720 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4009510 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.258+0000 7f0eb2ffd640 1 -- 172.21.15.63:0/1672473720 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ea403e450 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.258+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eb40d2080 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.258+0000 7f0eb2ffd640 1 -- 172.21.15.63:0/1672473720 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea403e800 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.261 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.258+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eb415ff80 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.260+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eb404e840 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.260+0000 7f0eb2ffd640 1 -- 172.21.15.63:0/1672473720 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0ea403e960 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.262 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.261+0000 7f0eb2ffd640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0ea006ae40 0x7f0ea006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.261+0000 7f0eb2ffd640 1 -- 172.21.15.63:0/1672473720 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f0ea40ac800 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.262+0000 7f0eb9b03640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0ea006ae40 0x7f0ea006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.263 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.262+0000 7f0eb9b03640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0ea006ae40 0x7f0ea006d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4156740 tx=0x7f0ea8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:17.267 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.266+0000 7f0eb2ffd640 1 -- 172.21.15.63:0/1672473720 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0ea40773d0 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.451+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0eb40b46d0 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.453+0000 7f0eb2ffd640 1 -- 172.21.15.63:0/1672473720 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v29) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0ea407a9f0 con 0x7f0eb40ce7c0 2023-12-04T10:45:17.454 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T10:45:17.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0ea006ae40 msgr2=0x7f0ea006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0ea006ae40 0x7f0ea006d300 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0eb4156740 tx=0x7f0ea8008040 comp rx=0 tx=0).stop 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40ce7c0 msgr2=0x7f0eb41493e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40ce7c0 0x7f0eb41493e0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4000f80 tx=0x7f0ea4004a40 comp rx=0 tx=0).stop 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 shutdown_connections 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0ea006ae40 0x7f0ea006d300 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0eb415d200 0x7f0eb4153210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0eb415d5e0 0x7f0eb4153750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 --2- 172.21.15.63:0/1672473720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0eb40ce7c0 0x7f0eb41493e0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.455+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 >> 172.21.15.63:0/1672473720 conn(0x7f0eb409c3e0 msgr2=0x7f0eb406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.456+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 shutdown_connections 2023-12-04T10:45:17.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.456+0000 7f0ebb306640 1 -- 172.21.15.63:0/1672473720 wait complete. 2023-12-04T10:45:17.475 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-04T10:45:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.695+0000 7fec0a240640 1 Processor -- start 2023-12-04T10:45:17.696 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.695+0000 7fec0a240640 1 -- start start 2023-12-04T10:45:17.697 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.696+0000 7fec0a240640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fec0415d5e0 0x7fec040ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.696+0000 7fec0a240640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040d0e60 con 0x7fec0415d200 2023-12-04T10:45:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.696+0000 7fec0a240640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec040d1140 con 0x7fec040d0180 2023-12-04T10:45:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.696+0000 7fec0a240640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec040d1420 con 0x7fec0415d5e0 2023-12-04T10:45:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.697+0000 7fec0923e640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fec0415d200 0x7fec040cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51960/0 (socket says 172.21.15.63:51960) 2023-12-04T10:45:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.697+0000 7fec0923e640 1 -- 172.21.15.63:0/3003933706 learned_addr learned my addr 172.21.15.63:0/3003933706 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:17.698 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.697+0000 7fec08a3d640 1 --2- 172.21.15.63:0/3003933706 >> v2:172.21.15.63:3300/0 conn(0x7fec0415d5e0 0x7fec040ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.697+0000 7fec03fff640 1 -- 172.21.15.63:0/3003933706 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290799612 0 0) 0x7fec040d0e60 con 0x7fec0415d200 2023-12-04T10:45:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.697+0000 7fec03fff640 1 -- 172.21.15.63:0/3003933706 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febec003520 con 0x7fec0415d200 2023-12-04T10:45:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.697+0000 7fec08a3d640 1 -- 172.21.15.63:0/3003933706 >> v1:172.21.15.66:6789/0 conn(0x7fec040d0180 legacy=0x7fec040b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.697+0000 7fec08a3d640 1 -- 172.21.15.63:0/3003933706 >> v1:172.21.15.63:6789/0 conn(0x7fec0415d200 legacy=0x7fec040cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.699 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.697+0000 7fec08a3d640 1 -- 172.21.15.63:0/3003933706 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec040d1700 con 0x7fec0415d5e0 2023-12-04T10:45:17.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.698+0000 7fec08a3d640 1 --2- 172.21.15.63:0/3003933706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d5e0 0x7fec040ce7c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7febf80097a0 tx=0x7febf802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34d3e98335c08400 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:17.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.699+0000 7fec03fff640 1 -- 172.21.15.63:0/3003933706 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf802e070 con 0x7fec0415d5e0 2023-12-04T10:45:17.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.699+0000 7fec03fff640 1 -- 172.21.15.63:0/3003933706 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80315a0 con 0x7fec0415d5e0 2023-12-04T10:45:17.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.699+0000 7fec03fff640 1 -- 172.21.15.63:0/3003933706 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8031930 con 0x7fec0415d5e0 2023-12-04T10:45:17.700 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.699+0000 7fec0a240640 1 -- 172.21.15.63:0/3003933706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d5e0 msgr2=0x7fec040ce7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.699+0000 7fec0a240640 1 --2- 172.21.15.63:0/3003933706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d5e0 0x7fec040ce7c0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7febf80097a0 tx=0x7febf802b840 comp rx=0 tx=0).stop 2023-12-04T10:45:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.699+0000 7fec0a240640 1 -- 172.21.15.63:0/3003933706 shutdown_connections 2023-12-04T10:45:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.699+0000 7fec0a240640 1 --2- 172.21.15.63:0/3003933706 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d5e0 0x7fec040ce7c0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.699+0000 7fec0a240640 1 -- 172.21.15.63:0/3003933706 >> 172.21.15.63:0/3003933706 conn(0x7fec0409c3e0 msgr2=0x7fec040d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.700+0000 7fec0a240640 1 -- 172.21.15.63:0/3003933706 shutdown_connections 2023-12-04T10:45:17.701 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.700+0000 7fec0a240640 1 -- 172.21.15.63:0/3003933706 wait complete. 2023-12-04T10:45:17.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.701+0000 7fec0a240640 1 Processor -- start 2023-12-04T10:45:17.702 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.702+0000 7fec0a240640 1 -- start start 2023-12-04T10:45:17.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.702+0000 7fec0a240640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec040d0180 0x7fec04149350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.704 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec0a240640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d200 0x7fec040b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec0a240640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec0415d5e0 0x7fec040b6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec0a240640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec040c7a50 con 0x7fec0415d200 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec0a240640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec040cccf0 con 0x7fec040d0180 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec0a240640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec040c7ca0 con 0x7fec0415d5e0 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec08a3d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d200 0x7fec040b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec08a3d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d200 0x7fec040b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51520/0 (socket says 172.21.15.63:51520) 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec08a3d640 1 -- 172.21.15.63:0/421284134 learned_addr learned my addr 172.21.15.63:0/421284134 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec09a3f640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec0415d5e0 0x7fec040b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec0923e640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec040d0180 0x7fec04149350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec08a3d640 1 -- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec0415d5e0 msgr2=0x7fec040b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec08a3d640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec0415d5e0 0x7fec040b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec08a3d640 1 -- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec040d0180 msgr2=0x7fec04149350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec08a3d640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec040d0180 0x7fec04149350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec08a3d640 1 -- 172.21.15.63:0/421284134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf8009400 con 0x7fec0415d200 2023-12-04T10:45:17.705 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.703+0000 7fec0923e640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec040d0180 0x7fec04149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:17.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.704+0000 7fec08a3d640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d200 0x7fec040b5d10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7febf8034040 tx=0x7febf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:17.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.704+0000 7fec01ffb640 1 -- 172.21.15.63:0/421284134 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8032840 con 0x7fec0415d200 2023-12-04T10:45:17.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.704+0000 7fec01ffb640 1 -- 172.21.15.63:0/421284134 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80329c0 con 0x7fec0415d200 2023-12-04T10:45:17.706 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.704+0000 7fec01ffb640 1 -- 172.21.15.63:0/421284134 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf8032d70 con 0x7fec0415d200 2023-12-04T10:45:17.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.704+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec040d2080 con 0x7fec0415d200 2023-12-04T10:45:17.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.704+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec040c8260 con 0x7fec0415d200 2023-12-04T10:45:17.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.706+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec0404e840 con 0x7fec0415d200 2023-12-04T10:45:17.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.706+0000 7fec01ffb640 1 -- 172.21.15.63:0/421284134 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7febf803b3f0 con 0x7fec0415d200 2023-12-04T10:45:17.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.707+0000 7fec01ffb640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7febf006ae40 0x7febf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:17.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.707+0000 7fec01ffb640 1 -- 172.21.15.63:0/421284134 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7febf80ab8f0 con 0x7fec0415d200 2023-12-04T10:45:17.708 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.708+0000 7fec0923e640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7febf006ae40 0x7febf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:17.709 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.708+0000 7fec0923e640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7febf006ae40 0x7febf006d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7febf4001560 tx=0x7febf4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:17.713 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.712+0000 7fec01ffb640 1 -- 172.21.15.63:0/421284134 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7febf80765e0 con 0x7fec0415d200 2023-12-04T10:45:17.909 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.908+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fec040d0750 con 0x7fec0415d200 2023-12-04T10:45:17.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.909+0000 7fec01ffb640 1 -- 172.21.15.63:0/421284134 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v29) v1 ==== 103+0+11 (secure 0 0 0) 0x7febf8079c00 con 0x7fec0415d200 2023-12-04T10:45:17.910 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T10:45:17.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7febf006ae40 msgr2=0x7febf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7febf006ae40 0x7febf006d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7febf4001560 tx=0x7febf4009040 comp rx=0 tx=0).stop 2023-12-04T10:45:17.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d200 msgr2=0x7fec040b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:17.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d200 0x7fec040b5d10 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7febf8034040 tx=0x7febf80046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 shutdown_connections 2023-12-04T10:45:17.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7febf006ae40 0x7febf006d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fec0415d5e0 0x7fec040b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fec0415d200 0x7fec040b5d10 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 --2- 172.21.15.63:0/421284134 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fec040d0180 0x7fec04149350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:17.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 >> 172.21.15.63:0/421284134 conn(0x7fec0409c3e0 msgr2=0x7fec0415de00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:17.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.912+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 shutdown_connections 2023-12-04T10:45:17.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:17.913+0000 7fec0a240640 1 -- 172.21.15.63:0/421284134 wait complete. 2023-12-04T10:45:17.934 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:45:18.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.149+0000 7f95bdbb5640 1 Processor -- start 2023-12-04T10:45:18.150 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.149+0000 7f95bdbb5640 1 -- start start 2023-12-04T10:45:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.151+0000 7f95bdbb5640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f95b80cca00 0x7f95b8070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.151+0000 7f95bdbb5640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b80ccfe0 con 0x7f95b80c9b10 2023-12-04T10:45:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.151+0000 7f95bdbb5640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b80cd2c0 con 0x7f95b80cb630 2023-12-04T10:45:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.151+0000 7f95bdbb5640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b80cd5a0 con 0x7f95b80cca00 2023-12-04T10:45:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.151+0000 7f95bd3b4640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f95b80c9b10 0x7f95b80c9f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51962/0 (socket says 172.21.15.63:51962) 2023-12-04T10:45:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.151+0000 7f95bd3b4640 1 -- 172.21.15.63:0/1231081219 learned_addr learned my addr 172.21.15.63:0/1231081219 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:18.152 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.151+0000 7f95affff640 1 --2- 172.21.15.63:0/1231081219 >> v2:172.21.15.63:3300/0 conn(0x7f95b80cca00 0x7f95b8070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.152+0000 7f95affff640 1 -- 172.21.15.63:0/1231081219 >> v1:172.21.15.66:6789/0 conn(0x7f95b80cb630 legacy=0x7f95b80cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.152+0000 7f95affff640 1 -- 172.21.15.63:0/1231081219 >> v1:172.21.15.63:6789/0 conn(0x7f95b80c9b10 legacy=0x7f95b80c9f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.152+0000 7f95affff640 1 -- 172.21.15.63:0/1231081219 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b80c9310 con 0x7f95b80cca00 2023-12-04T10:45:18.153 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.153+0000 7f95affff640 1 --2- 172.21.15.63:0/1231081219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80cca00 0x7f95b8070e80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95a80097a0 tx=0x7f95a802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f080d6c775ab92 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.153+0000 7f95af7fe640 1 -- 172.21.15.63:0/1231081219 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8030610 con 0x7f95b80cca00 2023-12-04T10:45:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.153+0000 7f95af7fe640 1 -- 172.21.15.63:0/1231081219 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95a8030770 con 0x7f95b80cca00 2023-12-04T10:45:18.154 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.153+0000 7f95af7fe640 1 -- 172.21.15.63:0/1231081219 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8030b00 con 0x7f95b80cca00 2023-12-04T10:45:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.154+0000 7f95bdbb5640 1 -- 172.21.15.63:0/1231081219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80cca00 msgr2=0x7f95b8070e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.154+0000 7f95bdbb5640 1 --2- 172.21.15.63:0/1231081219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80cca00 0x7f95b8070e80 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f95a80097a0 tx=0x7f95a802b960 comp rx=0 tx=0).stop 2023-12-04T10:45:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.154+0000 7f95bdbb5640 1 -- 172.21.15.63:0/1231081219 shutdown_connections 2023-12-04T10:45:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.154+0000 7f95bdbb5640 1 --2- 172.21.15.63:0/1231081219 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80cca00 0x7f95b8070e80 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.154+0000 7f95bdbb5640 1 -- 172.21.15.63:0/1231081219 >> 172.21.15.63:0/1231081219 conn(0x7f95b80b07f0 msgr2=0x7f95b80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.154+0000 7f95bdbb5640 1 -- 172.21.15.63:0/1231081219 shutdown_connections 2023-12-04T10:45:18.155 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.154+0000 7f95bdbb5640 1 -- 172.21.15.63:0/1231081219 wait complete. 2023-12-04T10:45:18.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.156+0000 7f95bdbb5640 1 Processor -- start 2023-12-04T10:45:18.156 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.156+0000 7f95bdbb5640 1 -- start start 2023-12-04T10:45:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bdbb5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80c9b10 0x7f95b80c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bdbb5640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95b80cb630 0x7f95b815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bdbb5640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b80cca00 0x7f95b815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bdbb5640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80c6230 con 0x7f95b80c9b10 2023-12-04T10:45:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bdbb5640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80c3810 con 0x7f95b80cca00 2023-12-04T10:45:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bdbb5640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80c8ab0 con 0x7f95b80cb630 2023-12-04T10:45:18.159 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bcbb3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80c9b10 0x7f95b80c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bcbb3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80c9b10 0x7f95b80c5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51542/0 (socket says 172.21.15.63:51542) 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bcbb3640 1 -- 172.21.15.63:0/3477932705 learned_addr learned my addr 172.21.15.63:0/3477932705 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bcbb3640 1 -- 172.21.15.63:0/3477932705 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95b80cb630 msgr2=0x7f95b815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bd3b4640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b80cca00 0x7f95b815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bcbb3640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95b80cb630 0x7f95b815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bcbb3640 1 -- 172.21.15.63:0/3477932705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b80cca00 msgr2=0x7f95b815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bcbb3640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b80cca00 0x7f95b815cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.157+0000 7f95bcbb3640 1 -- 172.21.15.63:0/3477932705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009400 con 0x7f95b80c9b10 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.158+0000 7f95bcbb3640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80c9b10 0x7f95b80c5cf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c450 tx=0x7f95b400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.158+0000 7f95ad7fa640 1 -- 172.21.15.63:0/3477932705 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40052d0 con 0x7f95b80c9b10 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.158+0000 7f95ad7fa640 1 -- 172.21.15.63:0/3477932705 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4005430 con 0x7f95b80c9b10 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.158+0000 7f95ad7fa640 1 -- 172.21.15.63:0/3477932705 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4012870 con 0x7f95b80c9b10 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.158+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b80c8d90 con 0x7f95b80c9b10 2023-12-04T10:45:18.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.158+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b80c3d90 con 0x7f95b80c9b10 2023-12-04T10:45:18.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.159+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b80cb4a0 con 0x7f95b80c9b10 2023-12-04T10:45:18.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.160+0000 7f95ad7fa640 1 -- 172.21.15.63:0/3477932705 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f95b40129d0 con 0x7f95b80c9b10 2023-12-04T10:45:18.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.161+0000 7f95ad7fa640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f95a406ae70 0x7f95a406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.161+0000 7f95ad7fa640 1 -- 172.21.15.63:0/3477932705 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f95b40894e0 con 0x7f95b80c9b10 2023-12-04T10:45:18.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.161+0000 7f95affff640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f95a406ae70 0x7f95a406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.162+0000 7f95affff640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f95a406ae70 0x7f95a406d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95a8036000 tx=0x7f95a8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:18.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.166+0000 7f95ad7fa640 1 -- 172.21.15.63:0/3477932705 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f95b40541c0 con 0x7f95b80c9b10 2023-12-04T10:45:18.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.400+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f95b804e840 con 0x7f95b80c9b10 2023-12-04T10:45:18.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.401+0000 7f95ad7fa640 1 -- 172.21.15.63:0/3477932705 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f95b40577e0 con 0x7f95b80c9b10 2023-12-04T10:45:18.403 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:18.403 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:44:21.556693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T10:45:18.403 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2023-12-04T10:45:18.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f95a406ae70 msgr2=0x7f95a406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.405 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f95a406ae70 0x7f95a406d330 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f95a8036000 tx=0x7f95a8030000 comp rx=0 tx=0).stop 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80c9b10 msgr2=0x7f95b80c5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80c9b10 0x7f95b80c5cf0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f95b400c450 tx=0x7f95b400c910 comp rx=0 tx=0).stop 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 shutdown_connections 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f95a406ae70 0x7f95a406d330 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f95b80cb630 0x7f95b815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f95b80cca00 0x7f95b815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 --2- 172.21.15.63:0/3477932705 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f95b80c9b10 0x7f95b80c5cf0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 >> 172.21.15.63:0/3477932705 conn(0x7f95b80b07f0 msgr2=0x7f95b80afd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 shutdown_connections 2023-12-04T10:45:18.406 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.404+0000 7f95bdbb5640 1 -- 172.21.15.63:0/3477932705 wait complete. 2023-12-04T10:45:18.425 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.636+0000 7fc63ead7640 1 Processor -- start 2023-12-04T10:45:18.637 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.636+0000 7fc63ead7640 1 -- start start 2023-12-04T10:45:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63ead7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638151ca0 0x7fc63806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63ead7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc63815b470 0x7fc6380cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63ead7640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc63806e0b0 0x7fc6380cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63ead7640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380cc7f0 con 0x7fc63806e0b0 2023-12-04T10:45:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63ead7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6380cca40 con 0x7fc63815b470 2023-12-04T10:45:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63ead7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380ccd20 con 0x7fc638151ca0 2023-12-04T10:45:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63e2d6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc63806e0b0 0x7fc6380cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63e2d6640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc63806e0b0 0x7fc6380cbab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51558/0 (socket says 172.21.15.63:51558) 2023-12-04T10:45:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.638+0000 7fc63e2d6640 1 -- 172.21.15.63:0/1610291110 learned_addr learned my addr 172.21.15.63:0/1610291110 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.639+0000 7fc63d2d4640 1 --2- 172.21.15.63:0/1610291110 >> v2:172.21.15.66:3300/0 conn(0x7fc63815b470 0x7fc6380cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.639+0000 7fc63dad5640 1 --2- 172.21.15.63:0/1610291110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638151ca0 0x7fc63806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.639+0000 7fc63e2d6640 1 -- 172.21.15.63:0/1610291110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638151ca0 msgr2=0x7fc63806db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.639+0000 7fc63e2d6640 1 --2- 172.21.15.63:0/1610291110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638151ca0 0x7fc63806db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.640 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.639+0000 7fc63e2d6640 1 -- 172.21.15.63:0/1610291110 >> v2:172.21.15.66:3300/0 conn(0x7fc63815b470 msgr2=0x7fc6380cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:18.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.639+0000 7fc63e2d6640 1 --2- 172.21.15.63:0/1610291110 >> v2:172.21.15.66:3300/0 conn(0x7fc63815b470 0x7fc6380cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.639+0000 7fc63e2d6640 1 -- 172.21.15.63:0/1610291110 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6380cd000 con 0x7fc63806e0b0 2023-12-04T10:45:18.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.640+0000 7fc63e2d6640 1 --2- 172.21.15.63:0/1610291110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6380cbab0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc6380b17c0 tx=0x7fc63002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a9f58a47ca538d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:18.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.640+0000 7fc63cad3640 1 -- 172.21.15.63:0/1610291110 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63002c9f0 con 0x7fc63806e0b0 2023-12-04T10:45:18.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.640+0000 7fc63cad3640 1 -- 172.21.15.63:0/1610291110 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63002cb50 con 0x7fc63806e0b0 2023-12-04T10:45:18.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.640+0000 7fc63cad3640 1 -- 172.21.15.63:0/1610291110 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6300343f0 con 0x7fc63806e0b0 2023-12-04T10:45:18.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 -- 172.21.15.63:0/1610291110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 msgr2=0x7fc6380cbab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 --2- 172.21.15.63:0/1610291110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6380cbab0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc6380b17c0 tx=0x7fc63002be50 comp rx=0 tx=0).stop 2023-12-04T10:45:18.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 -- 172.21.15.63:0/1610291110 shutdown_connections 2023-12-04T10:45:18.642 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 --2- 172.21.15.63:0/1610291110 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6380cbab0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 --2- 172.21.15.63:0/1610291110 >> v2:172.21.15.66:3300/0 conn(0x7fc63815b470 0x7fc6380cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 --2- 172.21.15.63:0/1610291110 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638151ca0 0x7fc63806db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 -- 172.21.15.63:0/1610291110 >> 172.21.15.63:0/1610291110 conn(0x7fc6380b07f0 msgr2=0x7fc6380b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 -- 172.21.15.63:0/1610291110 shutdown_connections 2023-12-04T10:45:18.643 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.641+0000 7fc63ead7640 1 -- 172.21.15.63:0/1610291110 wait complete. 2023-12-04T10:45:18.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.643+0000 7fc63ead7640 1 Processor -- start 2023-12-04T10:45:18.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.643+0000 7fc63ead7640 1 -- start start 2023-12-04T10:45:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63ead7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6381501d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63ead7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc638151ca0 0x7fc638157a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63ead7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638157fb0 0x7fc6380c6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63ead7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380c8760 con 0x7fc63806e0b0 2023-12-04T10:45:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63ead7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc638158460 con 0x7fc638151ca0 2023-12-04T10:45:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63ead7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6380c7ae0 con 0x7fc638157fb0 2023-12-04T10:45:18.646 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63dad5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6381501d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63dad5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6381501d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51572/0 (socket says 172.21.15.63:51572) 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.644+0000 7fc63dad5640 1 -- 172.21.15.63:0/241735678 learned_addr learned my addr 172.21.15.63:0/241735678 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.645+0000 7fc63d2d4640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc638151ca0 0x7fc638157a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.645+0000 7fc63e2d6640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638157fb0 0x7fc6380c6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.645+0000 7fc63dad5640 1 -- 172.21.15.63:0/241735678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638157fb0 msgr2=0x7fc6380c6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.645+0000 7fc63dad5640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638157fb0 0x7fc6380c6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.645+0000 7fc63dad5640 1 -- 172.21.15.63:0/241735678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc638151ca0 msgr2=0x7fc638157a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.645+0000 7fc63dad5640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc638151ca0 0x7fc638157a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.645+0000 7fc63dad5640 1 -- 172.21.15.63:0/241735678 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc630009b30 con 0x7fc63806e0b0 2023-12-04T10:45:18.647 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.645+0000 7fc63dad5640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6381501d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc63400d800 tx=0x7fc63400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.646+0000 7fc62e7fc640 1 -- 172.21.15.63:0/241735678 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400b6c0 con 0x7fc63806e0b0 2023-12-04T10:45:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.646+0000 7fc62e7fc640 1 -- 172.21.15.63:0/241735678 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc63400b820 con 0x7fc63806e0b0 2023-12-04T10:45:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.646+0000 7fc62e7fc640 1 -- 172.21.15.63:0/241735678 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc63400bbb0 con 0x7fc63806e0b0 2023-12-04T10:45:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.646+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6380c7dc0 con 0x7fc63806e0b0 2023-12-04T10:45:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.646+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6380c8380 con 0x7fc63806e0b0 2023-12-04T10:45:18.648 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.647+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc63804e840 con 0x7fc63806e0b0 2023-12-04T10:45:18.649 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.648+0000 7fc62e7fc640 1 -- 172.21.15.63:0/241735678 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc63400bd10 con 0x7fc63806e0b0 2023-12-04T10:45:18.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.649+0000 7fc62e7fc640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc61c06ae40 0x7fc61c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:18.650 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.649+0000 7fc62e7fc640 1 -- 172.21.15.63:0/241735678 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc634089ee0 con 0x7fc63806e0b0 2023-12-04T10:45:18.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.649+0000 7fc63d2d4640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc61c06ae40 0x7fc61c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:18.651 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.650+0000 7fc63d2d4640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc61c06ae40 0x7fc61c06d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc628006fd0 tx=0x7fc628008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:18.654 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.653+0000 7fc62e7fc640 1 -- 172.21.15.63:0/241735678 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc634054c60 con 0x7fc63806e0b0 2023-12-04T10:45:18.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.853+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6380c89d0 con 0x7fc63806e0b0 2023-12-04T10:45:18.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.856+0000 7fc62e7fc640 1 -- 172.21.15.63:0/241735678 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7fc634058280 con 0x7fc63806e0b0 2023-12-04T10:45:18.858 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:18.858 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc61c06ae40 msgr2=0x7fc61c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc61c06ae40 0x7fc61c06d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fc628006fd0 tx=0x7fc628008040 comp rx=0 tx=0).stop 2023-12-04T10:45:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 msgr2=0x7fc6381501d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6381501d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc63400d800 tx=0x7fc63400dcc0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 shutdown_connections 2023-12-04T10:45:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc61c06ae40 0x7fc61c06d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc638157fb0 0x7fc6380c6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc638151ca0 0x7fc638157a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.859+0000 7fc63ead7640 1 --2- 172.21.15.63:0/241735678 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc63806e0b0 0x7fc6381501d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:18.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.860+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 >> 172.21.15.63:0/241735678 conn(0x7fc6380b07f0 msgr2=0x7fc638159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:18.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.860+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 shutdown_connections 2023-12-04T10:45:18.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:18.860+0000 7fc63ead7640 1 -- 172.21.15.63:0/241735678 wait complete. 2023-12-04T10:45:18.879 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-04T10:45:18.879 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:45:19.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.101+0000 7f34b759e640 1 Processor -- start 2023-12-04T10:45:19.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.101+0000 7f34b759e640 1 -- start start 2023-12-04T10:45:19.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.103+0000 7f34b759e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34b8151ca0 0x7f34b806db70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.103+0000 7f34b759e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f34b806e0b0 0x7f34b8071740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.103+0000 7f34b759e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34b80cc7f0 con 0x7f34b815b470 2023-12-04T10:45:19.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.103+0000 7f34b759e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b80cca40 con 0x7f34b8151ca0 2023-12-04T10:45:19.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.103+0000 7f34b759e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34b80ccd20 con 0x7f34b806e0b0 2023-12-04T10:45:19.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.103+0000 7f34b659c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34b8151ca0 0x7f34b806db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.103+0000 7f34b659c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f34b8151ca0 0x7f34b806db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51582/0 (socket says 172.21.15.63:51582) 2023-12-04T10:45:19.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.103+0000 7f34b659c640 1 -- 172.21.15.63:0/211939715 learned_addr learned my addr 172.21.15.63:0/211939715 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:19.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.104+0000 7f34b6d9d640 1 --2- 172.21.15.63:0/211939715 >> v2:172.21.15.66:3300/0 conn(0x7f34b806e0b0 0x7f34b8071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.104+0000 7f34b659c640 1 -- 172.21.15.63:0/211939715 >> v2:172.21.15.66:3300/0 conn(0x7f34b806e0b0 msgr2=0x7f34b8071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:19.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.104+0000 7f34b659c640 1 --2- 172.21.15.63:0/211939715 >> v2:172.21.15.66:3300/0 conn(0x7f34b806e0b0 0x7f34b8071740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.104+0000 7f34b659c640 1 -- 172.21.15.63:0/211939715 >> v1:172.21.15.66:6789/0 conn(0x7f34b815b470 legacy=0x7f34b80cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:19.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.104+0000 7f34b659c640 1 -- 172.21.15.63:0/211939715 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34b80cd000 con 0x7f34b8151ca0 2023-12-04T10:45:19.106 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.105+0000 7f34b659c640 1 --2- 172.21.15.63:0/211939715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b806db70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f34b80b1860 tx=0x7f34a802be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6eef31e877d9abd server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.105+0000 7f34b559a640 1 -- 172.21.15.63:0/211939715 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a802c9f0 con 0x7f34b8151ca0 2023-12-04T10:45:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.105+0000 7f34b559a640 1 -- 172.21.15.63:0/211939715 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34a802cb50 con 0x7f34b8151ca0 2023-12-04T10:45:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.105+0000 7f34b559a640 1 -- 172.21.15.63:0/211939715 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34a80343f0 con 0x7f34b8151ca0 2023-12-04T10:45:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.106+0000 7f34b759e640 1 -- 172.21.15.63:0/211939715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 msgr2=0x7f34b806db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.106+0000 7f34b759e640 1 --2- 172.21.15.63:0/211939715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b806db70 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f34b80b1860 tx=0x7f34a802be50 comp rx=0 tx=0).stop 2023-12-04T10:45:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.106+0000 7f34b759e640 1 -- 172.21.15.63:0/211939715 shutdown_connections 2023-12-04T10:45:19.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.106+0000 7f34b759e640 1 --2- 172.21.15.63:0/211939715 >> v2:172.21.15.66:3300/0 conn(0x7f34b806e0b0 0x7f34b8071740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.106+0000 7f34b759e640 1 --2- 172.21.15.63:0/211939715 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b806db70 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.106+0000 7f34b759e640 1 -- 172.21.15.63:0/211939715 >> 172.21.15.63:0/211939715 conn(0x7f34b80b07f0 msgr2=0x7f34b80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:19.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.106+0000 7f34b759e640 1 -- 172.21.15.63:0/211939715 shutdown_connections 2023-12-04T10:45:19.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.106+0000 7f34b759e640 1 -- 172.21.15.63:0/211939715 wait complete. 2023-12-04T10:45:19.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.108+0000 7f34b759e640 1 Processor -- start 2023-12-04T10:45:19.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.108+0000 7f34b759e640 1 -- start start 2023-12-04T10:45:19.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b759e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34b806e0b0 0x7f34b81500d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b8152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b759e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34b815a5e0 0x7f34b81f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b759e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b81528b0 con 0x7f34b8151ca0 2023-12-04T10:45:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b759e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34b8152b90 con 0x7f34b815a5e0 2023-12-04T10:45:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b759e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34b8152e70 con 0x7f34b806e0b0 2023-12-04T10:45:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b5d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b5d9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b8152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51598/0 (socket says 172.21.15.63:51598) 2023-12-04T10:45:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.109+0000 7f34b5d9b640 1 -- 172.21.15.63:0/225199283 learned_addr learned my addr 172.21.15.63:0/225199283 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:19.114 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b6d9d640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34b815a5e0 0x7f34b81f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b659c640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34b806e0b0 0x7f34b81500d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b5d9b640 1 -- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34b806e0b0 msgr2=0x7f34b81500d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b5d9b640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34b806e0b0 0x7f34b81500d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b5d9b640 1 -- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34b815a5e0 msgr2=0x7f34b81f0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b5d9b640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34b815a5e0 0x7f34b81f0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b5d9b640 1 -- 172.21.15.63:0/225199283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34a8009b30 con 0x7f34b8151ca0 2023-12-04T10:45:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b659c640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34b806e0b0 0x7f34b81500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:19.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b5d9b640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b8152080 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00b3e0 tx=0x7f34ac00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:19.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34a6ffd640 1 -- 172.21.15.63:0/225199283 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac011830 con 0x7f34b8151ca0 2023-12-04T10:45:19.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34a6ffd640 1 -- 172.21.15.63:0/225199283 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac0119b0 con 0x7f34b8151ca0 2023-12-04T10:45:19.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34a6ffd640 1 -- 172.21.15.63:0/225199283 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac011d60 con 0x7f34b8151ca0 2023-12-04T10:45:19.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.110+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34b8153150 con 0x7f34b8151ca0 2023-12-04T10:45:19.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.111+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34b81525c0 con 0x7f34b8151ca0 2023-12-04T10:45:19.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.112+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34b8153670 con 0x7f34b8151ca0 2023-12-04T10:45:19.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.113+0000 7f34a6ffd640 1 -- 172.21.15.63:0/225199283 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f34ac01a400 con 0x7f34b8151ca0 2023-12-04T10:45:19.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.114+0000 7f34a6ffd640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f349806ae70 0x7f349806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.114+0000 7f34a6ffd640 1 -- 172.21.15.63:0/225199283 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f34ac089bc0 con 0x7f34b8151ca0 2023-12-04T10:45:19.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.114+0000 7f34b659c640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f349806ae70 0x7f349806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.118 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.115+0000 7f34b659c640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f349806ae70 0x7f349806d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f34a8035000 tx=0x7f34a8030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:19.119 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.118+0000 7f34a6ffd640 1 -- 172.21.15.63:0/225199283 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f34b8153670 con 0x7f34b8151ca0 2023-12-04T10:45:19.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.350+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34b806d4a0 con 0x7f34b8151ca0 2023-12-04T10:45:19.353 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.352+0000 7f34a6ffd640 1 -- 172.21.15.63:0/225199283 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f34ac015020 con 0x7f34b8151ca0 2023-12-04T10:45:19.353 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:19.353 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:44:21.556693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T10:45:19.354 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2023-12-04T10:45:19.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f349806ae70 msgr2=0x7f349806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f349806ae70 0x7f349806d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f34a8035000 tx=0x7f34a8030000 comp rx=0 tx=0).stop 2023-12-04T10:45:19.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 msgr2=0x7f34b8152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b8152080 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f34ac00b3e0 tx=0x7f34ac00b8a0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 shutdown_connections 2023-12-04T10:45:19.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f349806ae70 0x7f349806d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f34b815a5e0 0x7f34b81f0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f34b8151ca0 0x7f34b8152080 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.354+0000 7f34b759e640 1 --2- 172.21.15.63:0/225199283 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f34b806e0b0 0x7f34b81500d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.355+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 >> 172.21.15.63:0/225199283 conn(0x7f34b80b07f0 msgr2=0x7f34b806ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:19.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.355+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 shutdown_connections 2023-12-04T10:45:19.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.355+0000 7f34b759e640 1 -- 172.21.15.63:0/225199283 wait complete. 2023-12-04T10:45:19.374 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:45:19.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.596+0000 7f8d5a314640 1 Processor -- start 2023-12-04T10:45:19.597 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.596+0000 7f8d5a314640 1 -- start start 2023-12-04T10:45:19.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.598+0000 7f8d5a314640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d5415b470 0x7f8d540cb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.598+0000 7f8d5a314640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d540cc7f0 con 0x7f8d5406c0f0 2023-12-04T10:45:19.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.598+0000 7f8d5a314640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5406e280 con 0x7f8d54151ca0 2023-12-04T10:45:19.599 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.598+0000 7f8d5a314640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540cca40 con 0x7f8d5415b470 2023-12-04T10:45:19.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.598+0000 7f8d59b13640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8d5406c0f0 0x7f8d54071740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51974/0 (socket says 172.21.15.63:51974) 2023-12-04T10:45:19.600 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.598+0000 7f8d59b13640 1 -- 172.21.15.63:0/2329825897 learned_addr learned my addr 172.21.15.63:0/2329825897 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d58b11640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d5415b470 0x7f8d540cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2546356012 0 0) 0x7f8d540cc7f0 con 0x7f8d5406c0f0 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d40003520 con 0x7f8d5406c0f0 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4057167101 0 0) 0x7f8d40003520 con 0x7f8d5406c0f0 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d5415b470 msgr2=0x7f8d540cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d4bfff640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d5415b470 0x7f8d540cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 >> v1:172.21.15.66:6789/0 conn(0x7f8d54151ca0 legacy=0x7f8d5406db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d540ccd20 con 0x7f8d5406c0f0 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.599+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f8d4c001670 con 0x7f8d5406c0f0 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 >> v1:172.21.15.63:6789/0 conn(0x7f8d5406c0f0 legacy=0x7f8d54071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.602 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d4bfff640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d400039a0 0x7f8d40003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d4bfff640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d400047c0 0x7f8d40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d4bfff640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d400051f0 0x7f8d4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540cca40 con 0x7f8d400047c0 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4000bf70 con 0x7f8d400039a0 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4000c130 con 0x7f8d400051f0 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d58b11640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d400047c0 0x7f8d40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d59312640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d400039a0 0x7f8d40003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d58b11640 1 -- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d400051f0 msgr2=0x7f8d4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d58b11640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d400051f0 0x7f8d4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d58b11640 1 -- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d400039a0 msgr2=0x7f8d40003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d58b11640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d400039a0 0x7f8d40003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d58b11640 1 -- 172.21.15.63:0/2329825897 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40003520 con 0x7f8d400047c0 2023-12-04T10:45:19.603 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.600+0000 7f8d59312640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d400039a0 0x7f8d40003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d58b11640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d400047c0 0x7f8d40004c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009ac0 tx=0x7f8d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649024f254943359 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:19.604 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4402c710 con 0x7f8d400047c0 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4402c870 con 0x7f8d400047c0 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d4bfff640 1 -- 172.21.15.63:0/2329825897 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d4402cc00 con 0x7f8d400047c0 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d5a314640 1 -- 172.21.15.63:0/2329825897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d400047c0 msgr2=0x7f8d40004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d5a314640 1 --2- 172.21.15.63:0/2329825897 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d400047c0 0x7f8d40004c40 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f8d44009ac0 tx=0x7f8d400057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d59b13640 1 -- 172.21.15.63:0/2329825897 reap_dead start 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d5a314640 1 -- 172.21.15.63:0/2329825897 shutdown_connections 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.602+0000 7f8d5a314640 1 -- 172.21.15.63:0/2329825897 >> 172.21.15.63:0/2329825897 conn(0x7f8d540b07f0 msgr2=0x7f8d540b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.603+0000 7f8d5a314640 1 -- 172.21.15.63:0/2329825897 shutdown_connections 2023-12-04T10:45:19.605 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.603+0000 7f8d5a314640 1 -- 172.21.15.63:0/2329825897 wait complete. 2023-12-04T10:45:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.604+0000 7f8d5a314640 1 Processor -- start 2023-12-04T10:45:19.606 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.605+0000 7f8d5a314640 1 -- start start 2023-12-04T10:45:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d5a314640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d400047c0 0x7f8d540c6700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d5a314640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d540c6ff0 0x7f8d541f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.607 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d5a314640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d541f5ed0 0x7f8d541f2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d5a314640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5414f0d0 con 0x7f8d540c6ff0 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d5a314640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540b4770 con 0x7f8d541f5ed0 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d5a314640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d540c6c40 con 0x7f8d400047c0 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d58b11640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d540c6ff0 0x7f8d541f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d58b11640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d540c6ff0 0x7f8d541f1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51614/0 (socket says 172.21.15.63:51614) 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d58b11640 1 -- 172.21.15.63:0/583643201 learned_addr learned my addr 172.21.15.63:0/583643201 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d59312640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d400047c0 0x7f8d540c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d58b11640 1 -- 172.21.15.63:0/583643201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d400047c0 msgr2=0x7f8d540c6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d58b11640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d400047c0 0x7f8d540c6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.608 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d58b11640 1 -- 172.21.15.63:0/583643201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d541f5ed0 msgr2=0x7f8d541f2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d58b11640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d541f5ed0 0x7f8d541f2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.606+0000 7f8d58b11640 1 -- 172.21.15.63:0/583643201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d541f63b0 con 0x7f8d540c6ff0 2023-12-04T10:45:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.607+0000 7f8d58b11640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d540c6ff0 0x7f8d541f1ed0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8d4402c2b0 tx=0x7f8d44004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:19.609 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.607+0000 7f8d49ffb640 1 -- 172.21.15.63:0/583643201 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44003810 con 0x7f8d540c6ff0 2023-12-04T10:45:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.607+0000 7f8d49ffb640 1 -- 172.21.15.63:0/583643201 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d4402de90 con 0x7f8d540c6ff0 2023-12-04T10:45:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.607+0000 7f8d49ffb640 1 -- 172.21.15.63:0/583643201 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d44003b70 con 0x7f8d540c6ff0 2023-12-04T10:45:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.607+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d541f6690 con 0x7f8d540c6ff0 2023-12-04T10:45:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.607+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d541f6c50 con 0x7f8d540c6ff0 2023-12-04T10:45:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.608+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5414f240 con 0x7f8d540c6ff0 2023-12-04T10:45:19.610 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.609+0000 7f8d49ffb640 1 -- 172.21.15.63:0/583643201 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8d44003cd0 con 0x7f8d540c6ff0 2023-12-04T10:45:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.610+0000 7f8d49ffb640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8d3806ae70 0x7f8d3806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:19.611 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.610+0000 7f8d49ffb640 1 -- 172.21.15.63:0/583643201 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7f8d440aba50 con 0x7f8d540c6ff0 2023-12-04T10:45:19.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.611+0000 7f8d59312640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8d3806ae70 0x7f8d3806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:19.612 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.611+0000 7f8d59312640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8d3806ae70 0x7f8d3806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d50001e40 tx=0x7f8d50009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:19.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.615+0000 7f8d49ffb640 1 -- 172.21.15.63:0/583643201 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8d440767c0 con 0x7f8d540c6ff0 2023-12-04T10:45:19.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.850+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d5404e840 con 0x7f8d540c6ff0 2023-12-04T10:45:19.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.851+0000 7f8d49ffb640 1 -- 172.21.15.63:0/583643201 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+4909 (secure 0 0 0) 0x7f8d44079de0 con 0x7f8d540c6ff0 2023-12-04T10:45:19.852 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:19.852 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2132330586","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2132330586},{"type":"v1","addr":"172.21.15.66:6835","nonce":2132330586}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4254,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/2089870819","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":2089870819},{"type":"v1","addr":"172.21.15.63:6836","nonce":2089870819}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4258,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6837/3048043485","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":3048043485},{"type":"v1","addr":"172.21.15.63:6837","nonce":3048043485}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:43:52.705328+0000","modified":"2023-12-04T10:44:21.556693+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.66:6834/4278603848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":4278603848},{"type":"v1","addr":"172.21.15.66:6834","nonce":4278603848}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-04T10:45:19.853 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 9 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.854+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8d3806ae70 msgr2=0x7f8d3806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.854+0000 7f8d5a314640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8d3806ae70 0x7f8d3806d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8d50001e40 tx=0x7f8d50009040 comp rx=0 tx=0).stop 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.854+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d540c6ff0 msgr2=0x7f8d541f1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.854+0000 7f8d5a314640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d540c6ff0 0x7f8d541f1ed0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8d4402c2b0 tx=0x7f8d44004730 comp rx=0 tx=0).stop 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.854+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 shutdown_connections 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.854+0000 7f8d5a314640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f8d3806ae70 0x7f8d3806d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.855+0000 7f8d5a314640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d541f5ed0 0x7f8d541f2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.855+0000 7f8d5a314640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8d540c6ff0 0x7f8d541f1ed0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.855+0000 7f8d5a314640 1 --2- 172.21.15.63:0/583643201 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8d400047c0 0x7f8d540c6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.855+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 >> 172.21.15.63:0/583643201 conn(0x7f8d540b07f0 msgr2=0x7f8d54159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.855+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 shutdown_connections 2023-12-04T10:45:19.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:19.855+0000 7f8d5a314640 1 -- 172.21.15.63:0/583643201 wait complete. 2023-12-04T10:45:19.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:20.098 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.097+0000 7fdd6ffff640 1 Processor -- start 2023-12-04T10:45:20.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.097+0000 7fdd6ffff640 1 -- start start 2023-12-04T10:45:20.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.099+0000 7fdd6ffff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fdd70159f20 0x7fdd700cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.099+0000 7fdd6ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd70070df0 0x7fdd70071280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.099+0000 7fdd6ffff640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd7015a300 con 0x7fdd700cb630 2023-12-04T10:45:20.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.099+0000 7fdd6ffff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd700723f0 con 0x7fdd70070df0 2023-12-04T10:45:20.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.099+0000 7fdd6ffff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd700ca040 con 0x7fdd70159f20 2023-12-04T10:45:20.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.099+0000 7fdd6f7fe640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fdd700cb630 0x7fdd700cd900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51988/0 (socket says 172.21.15.63:51988) 2023-12-04T10:45:20.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.099+0000 7fdd6f7fe640 1 -- 172.21.15.63:0/722313476 learned_addr learned my addr 172.21.15.63:0/722313476 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:20.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.099+0000 7fdd67fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fdd70070df0 0x7fdd70071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.100+0000 7fdd6effd640 1 --2- 172.21.15.63:0/722313476 >> v2:172.21.15.66:3300/0 conn(0x7fdd70159f20 0x7fdd700cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.100+0000 7fdd67fff640 1 -- 172.21.15.63:0/722313476 >> v2:172.21.15.66:3300/0 conn(0x7fdd70159f20 msgr2=0x7fdd700cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:20.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.100+0000 7fdd67fff640 1 --2- 172.21.15.63:0/722313476 >> v2:172.21.15.66:3300/0 conn(0x7fdd70159f20 0x7fdd700cad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.100+0000 7fdd67fff640 1 -- 172.21.15.63:0/722313476 >> v1:172.21.15.63:6789/0 conn(0x7fdd700cb630 legacy=0x7fdd700cd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.100+0000 7fdd67fff640 1 -- 172.21.15.63:0/722313476 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd70071890 con 0x7fdd70070df0 2023-12-04T10:45:20.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.101+0000 7fdd67fff640 1 --2- 172.21.15.63:0/722313476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd70071280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdd700c24a0 tx=0x7fdd5802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6aa46b5cf6ea6d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:20.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.101+0000 7fdd6e7fc640 1 -- 172.21.15.63:0/722313476 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58031830 con 0x7fdd70070df0 2023-12-04T10:45:20.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.101+0000 7fdd6e7fc640 1 -- 172.21.15.63:0/722313476 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd58031990 con 0x7fdd70070df0 2023-12-04T10:45:20.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.101+0000 7fdd6e7fc640 1 -- 172.21.15.63:0/722313476 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd58031d20 con 0x7fdd70070df0 2023-12-04T10:45:20.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.102+0000 7fdd6ffff640 1 -- 172.21.15.63:0/722313476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 msgr2=0x7fdd70071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.102+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/722313476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd70071280 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fdd700c24a0 tx=0x7fdd5802b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.102+0000 7fdd6ffff640 1 -- 172.21.15.63:0/722313476 shutdown_connections 2023-12-04T10:45:20.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.102+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/722313476 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd70071280 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.102+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/722313476 >> v2:172.21.15.66:3300/0 conn(0x7fdd70159f20 0x7fdd700cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.102+0000 7fdd6ffff640 1 -- 172.21.15.63:0/722313476 >> 172.21.15.63:0/722313476 conn(0x7fdd700b07f0 msgr2=0x7fdd700b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:20.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.102+0000 7fdd6ffff640 1 -- 172.21.15.63:0/722313476 shutdown_connections 2023-12-04T10:45:20.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.102+0000 7fdd6ffff640 1 -- 172.21.15.63:0/722313476 wait complete. 2023-12-04T10:45:20.104 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.104+0000 7fdd6ffff640 1 Processor -- start 2023-12-04T10:45:20.105 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.104+0000 7fdd6ffff640 1 -- start start 2023-12-04T10:45:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd7014a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6ffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd700cb630 0x7fdd700c29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6ffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd70159f20 0x7fdd700ac8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6ffff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700ad820 con 0x7fdd70070df0 2023-12-04T10:45:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6ffff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700ad260 con 0x7fdd700cb630 2023-12-04T10:45:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6ffff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd700ad540 con 0x7fdd70159f20 2023-12-04T10:45:20.107 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd7014a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6effd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd7014a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51642/0 (socket says 172.21.15.63:51642) 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6effd640 1 -- 172.21.15.63:0/2106182792 learned_addr learned my addr 172.21.15.63:0/2106182792 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd67fff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd700cb630 0x7fdd700c29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6effd640 1 -- 172.21.15.63:0/2106182792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd70159f20 msgr2=0x7fdd700ac8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6effd640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd70159f20 0x7fdd700ac8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6effd640 1 -- 172.21.15.63:0/2106182792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd700cb630 msgr2=0x7fdd700c29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.105+0000 7fdd6effd640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd700cb630 0x7fdd700c29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.106+0000 7fdd6effd640 1 -- 172.21.15.63:0/2106182792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58009400 con 0x7fdd70070df0 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.106+0000 7fdd6effd640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd7014a840 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000c7f0 tx=0x7fdd6000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.106+0000 7fdd6cff9640 1 -- 172.21.15.63:0/2106182792 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60004220 con 0x7fdd70070df0 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.106+0000 7fdd6cff9640 1 -- 172.21.15.63:0/2106182792 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd60004380 con 0x7fdd70070df0 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.106+0000 7fdd6cff9640 1 -- 172.21.15.63:0/2106182792 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd60007840 con 0x7fdd70070df0 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.106+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd700c4760 con 0x7fdd70070df0 2023-12-04T10:45:20.108 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.106+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd7014ad80 con 0x7fdd70070df0 2023-12-04T10:45:20.109 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.107+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd700c45c0 con 0x7fdd70070df0 2023-12-04T10:45:20.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.108+0000 7fdd6cff9640 1 -- 172.21.15.63:0/2106182792 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdd60007bb0 con 0x7fdd70070df0 2023-12-04T10:45:20.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.109+0000 7fdd6cff9640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdd5006ae40 0x7fdd5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.109+0000 7fdd6cff9640 1 -- 172.21.15.63:0/2106182792 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fdd600898d0 con 0x7fdd70070df0 2023-12-04T10:45:20.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.110+0000 7fdd67fff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdd5006ae40 0x7fdd5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.110+0000 7fdd67fff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdd5006ae40 0x7fdd5006d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd58036000 tx=0x7fdd58008030 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:20.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.114+0000 7fdd6cff9640 1 -- 172.21.15.63:0/2106182792 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdd700c45c0 con 0x7fdd70070df0 2023-12-04T10:45:20.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.312+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd700c45c0 con 0x7fdd70070df0 2023-12-04T10:45:20.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.315+0000 7fdd6cff9640 1 -- 172.21.15.63:0/2106182792 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+18662 (secure 0 0 0) 0x7fdd700c45c0 con 0x7fdd70070df0 2023-12-04T10:45:20.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:20.317 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":29,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:44:39.779220+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:43:50.631085+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-04T10:43:51.716722+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-04T10:43:56.060583+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.e","mappings":[{"from":7,"to":1}]},{"pgid":"3.1c","mappings":[{"from":5,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":3,"to":2}]},{"pgid":"4.4","mappings":[{"from":1,"to":5}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.12","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:20.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdd5006ae40 msgr2=0x7fdd5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdd5006ae40 0x7fdd5006d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdd58036000 tx=0x7fdd58008030 comp rx=0 tx=0).stop 2023-12-04T10:45:20.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 msgr2=0x7fdd7014a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd7014a840 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fdd6000c7f0 tx=0x7fdd6000ccb0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 shutdown_connections 2023-12-04T10:45:20.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fdd5006ae40 0x7fdd5006d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fdd70159f20 0x7fdd700ac8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fdd700cb630 0x7fdd700c29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 --2- 172.21.15.63:0/2106182792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fdd70070df0 0x7fdd7014a840 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 >> 172.21.15.63:0/2106182792 conn(0x7fdd700b07f0 msgr2=0x7fdd700ceb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:20.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 shutdown_connections 2023-12-04T10:45:20.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.318+0000 7fdd6ffff640 1 -- 172.21.15.63:0/2106182792 wait complete. 2023-12-04T10:45:20.340 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-04T10:45:20.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.564+0000 7fc98cc39640 1 Processor -- start 2023-12-04T10:45:20.565 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.564+0000 7fc98cc39640 1 -- start start 2023-12-04T10:45:20.567 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.566+0000 7fc98cc39640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9880cca00 0x7fc988070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.566+0000 7fc98cc39640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9880ccfe0 con 0x7fc9880c9b10 2023-12-04T10:45:20.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.566+0000 7fc98cc39640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9880cd2c0 con 0x7fc9880cb630 2023-12-04T10:45:20.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.567+0000 7fc98cc39640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9880cd5a0 con 0x7fc9880cca00 2023-12-04T10:45:20.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.567+0000 7fc987fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fc9880c9b10 0x7fc9880c9fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:51998/0 (socket says 172.21.15.63:51998) 2023-12-04T10:45:20.568 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.567+0000 7fc987fff640 1 -- 172.21.15.63:0/402165823 learned_addr learned my addr 172.21.15.63:0/402165823 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:20.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.567+0000 7fc97ffff640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9880cca00 0x7fc988070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.567+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1481348945 0 0) 0x7fc9880ccfe0 con 0x7fc9880c9b10 2023-12-04T10:45:20.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.567+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc974003520 con 0x7fc9880c9b10 2023-12-04T10:45:20.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 102091005 0 0) 0x7fc974003520 con 0x7fc9880c9b10 2023-12-04T10:45:20.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9880cca00 msgr2=0x7fc988070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:20.569 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9880cca00 0x7fc988070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 >> v1:172.21.15.66:6789/0 conn(0x7fc9880cb630 legacy=0x7fc9880cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9880c9310 con 0x7fc9880c9b10 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fc9800019f0 con 0x7fc9880c9b10 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 >> v1:172.21.15.63:6789/0 conn(0x7fc9880c9b10 legacy=0x7fc9880c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9880cca00 0x7fc9740039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc974004d00 0x7fc974005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9880cd5a0 con 0x7fc974003f20 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc97400ba60 con 0x7fc974004d00 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc97400bc20 con 0x7fc9880cca00 2023-12-04T10:45:20.570 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.568+0000 7fc97ffff640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.569+0000 7fc987fff640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc974004d00 0x7fc974005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.569+0000 7fc9877fe640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9880cca00 0x7fc9740039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.569+0000 7fc97ffff640 1 -- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9880cca00 msgr2=0x7fc9740039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.569+0000 7fc97ffff640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc9880cca00 0x7fc9740039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.569+0000 7fc97ffff640 1 -- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc974004d00 msgr2=0x7fc974005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.569+0000 7fc97ffff640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc974004d00 0x7fc974005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.569+0000 7fc97ffff640 1 -- 172.21.15.63:0/402165823 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc974003520 con 0x7fc974003f20 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.569+0000 7fc987fff640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc974004d00 0x7fc974005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:20.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.570+0000 7fc97ffff640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9740047c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc970009ac0 tx=0x7fc9740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb0dae7cb2418642 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.570+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97002c6b0 con 0x7fc974003f20 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.570+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97002c810 con 0x7fc974003f20 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.570+0000 7fc986ffd640 1 -- 172.21.15.63:0/402165823 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97002cba0 con 0x7fc974003f20 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.571+0000 7fc98cc39640 1 -- 172.21.15.63:0/402165823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 msgr2=0x7fc9740047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.571+0000 7fc98cc39640 1 --2- 172.21.15.63:0/402165823 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9740047c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc970009ac0 tx=0x7fc9740057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.571+0000 7fc987fff640 1 -- 172.21.15.63:0/402165823 reap_dead start 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.571+0000 7fc98cc39640 1 -- 172.21.15.63:0/402165823 shutdown_connections 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.571+0000 7fc98cc39640 1 -- 172.21.15.63:0/402165823 >> 172.21.15.63:0/402165823 conn(0x7fc9880b07f0 msgr2=0x7fc9880b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.571+0000 7fc98cc39640 1 -- 172.21.15.63:0/402165823 shutdown_connections 2023-12-04T10:45:20.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.571+0000 7fc98cc39640 1 -- 172.21.15.63:0/402165823 wait complete. 2023-12-04T10:45:20.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.573+0000 7fc98cc39640 1 Processor -- start 2023-12-04T10:45:20.574 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.573+0000 7fc98cc39640 1 -- start start 2023-12-04T10:45:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc98cc39640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9881582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc98cc39640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98815a390 0x7fc98815a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.575 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc98cc39640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc988158a90 0x7fc988158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc98cc39640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98815ad50 con 0x7fc974003f20 2023-12-04T10:45:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc98cc39640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9880c2750 con 0x7fc98815a390 2023-12-04T10:45:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc98cc39640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc988159780 con 0x7fc988158a90 2023-12-04T10:45:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc9877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9881582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc9877fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9881582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51662/0 (socket says 172.21.15.63:51662) 2023-12-04T10:45:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.574+0000 7fc9877fe640 1 -- 172.21.15.63:0/994924472 learned_addr learned my addr 172.21.15.63:0/994924472 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.575+0000 7fc987fff640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc988158a90 0x7fc988158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.575+0000 7fc97ffff640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98815a390 0x7fc98815a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.575+0000 7fc9877fe640 1 -- 172.21.15.63:0/994924472 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc988158a90 msgr2=0x7fc988158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.575+0000 7fc9877fe640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc988158a90 0x7fc988158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.575+0000 7fc9877fe640 1 -- 172.21.15.63:0/994924472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98815a390 msgr2=0x7fc98815a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.575+0000 7fc9877fe640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98815a390 0x7fc98815a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.575+0000 7fc9877fe640 1 -- 172.21.15.63:0/994924472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc988159a60 con 0x7fc974003f20 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.575+0000 7fc9877fe640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9881582e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc97800e550 tx=0x7fc97800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.576+0000 7fc984ff9640 1 -- 172.21.15.63:0/994924472 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9780052e0 con 0x7fc974003f20 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.576+0000 7fc984ff9640 1 -- 172.21.15.63:0/994924472 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc978005440 con 0x7fc974003f20 2023-12-04T10:45:20.577 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.576+0000 7fc984ff9640 1 -- 172.21.15.63:0/994924472 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc978003810 con 0x7fc974003f20 2023-12-04T10:45:20.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.576+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc988159d40 con 0x7fc974003f20 2023-12-04T10:45:20.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.576+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc988158820 con 0x7fc974003f20 2023-12-04T10:45:20.578 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.577+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9880cb4a0 con 0x7fc974003f20 2023-12-04T10:45:20.579 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.578+0000 7fc984ff9640 1 -- 172.21.15.63:0/994924472 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc978003970 con 0x7fc974003f20 2023-12-04T10:45:20.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.579+0000 7fc984ff9640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc96806ae70 0x7fc96806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:20.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.579+0000 7fc984ff9640 1 -- 172.21.15.63:0/994924472 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6663+0+0 (secure 0 0 0) 0x7fc978089760 con 0x7fc974003f20 2023-12-04T10:45:20.580 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.579+0000 7fc97ffff640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc96806ae70 0x7fc96806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:20.581 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.580+0000 7fc97ffff640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc96806ae70 0x7fc96806d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc970036000 tx=0x7fc970030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:20.585 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.584+0000 7fc984ff9640 1 -- 172.21.15.63:0/994924472 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc978054440 con 0x7fc974003f20 2023-12-04T10:45:20.820 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.819+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc98804e840 con 0x7fc974003f20 2023-12-04T10:45:20.821 INFO:tasks.ceph.mon.a.smithi063.stderr:2023-12-04T10:45:20.820+0000 7ff16ad06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T10:45:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.824+0000 7fc984ff9640 1 -- 172.21.15.63:0/994924472 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc978057a60 con 0x7fc974003f20 2023-12-04T10:45:20.825 INFO:teuthology.orchestra.run.smithi063.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-04T10:45:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.827+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc96806ae70 msgr2=0x7fc96806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.827+0000 7fc98cc39640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc96806ae70 0x7fc96806d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc970036000 tx=0x7fc970030000 comp rx=0 tx=0).stop 2023-12-04T10:45:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.827+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 msgr2=0x7fc9881582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:20.828 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.827+0000 7fc98cc39640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9881582e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fc97800e550 tx=0x7fc97800ea10 comp rx=0 tx=0).stop 2023-12-04T10:45:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.828+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 shutdown_connections 2023-12-04T10:45:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.828+0000 7fc98cc39640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc96806ae70 0x7fc96806d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.828+0000 7fc98cc39640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc988158a90 0x7fc988158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.828+0000 7fc98cc39640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc98815a390 0x7fc98815a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.828+0000 7fc98cc39640 1 --2- 172.21.15.63:0/994924472 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc974003f20 0x7fc9881582e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.828+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 >> 172.21.15.63:0/994924472 conn(0x7fc9880b07f0 msgr2=0x7fc9880cab20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:20.829 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.828+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 shutdown_connections 2023-12-04T10:45:20.830 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:20.828+0000 7fc98cc39640 1 -- 172.21.15.63:0/994924472 wait complete. 2023-12-04T10:45:20.850 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-04T10:45:20.866 INFO:tasks.ceph.mds.d.smithi066.stderr: -6087> 2023-12-04T10:43:56.538+0000 7fd77bef0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T10:45:20.949 INFO:tasks.ceph.mds.d.smithi066.stdout:starting mds.d at 2023-12-04T10:45:21.084 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.083+0000 7fe15b59e640 1 Processor -- start 2023-12-04T10:45:21.085 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.083+0000 7fe15b59e640 1 -- start start 2023-12-04T10:45:21.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.085+0000 7fe15b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe15c15d5e0 0x7fe15c0ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.085+0000 7fe15b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 0x7fe15c0ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.085+0000 7fe15b59e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe15c0d0e60 con 0x7fe15c15d200 2023-12-04T10:45:21.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.085+0000 7fe15b59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15c0b6f70 con 0x7fe15c15d5e0 2023-12-04T10:45:21.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.085+0000 7fe15b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0d1140 con 0x7fe15c0d0180 2023-12-04T10:45:21.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.085+0000 7fe15a59c640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe15c15d200 0x7fe15c0cfa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52014/0 (socket says 172.21.15.63:52014) 2023-12-04T10:45:21.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.085+0000 7fe15a59c640 1 -- 172.21.15.63:0/322571007 learned_addr learned my addr 172.21.15.63:0/322571007 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:21.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe153fff640 1 --2- 172.21.15.63:0/322571007 >> v2:172.21.15.66:3300/0 conn(0x7fe15c15d5e0 0x7fe15c0ce7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:21.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 328894613 0 0) 0x7fe15c0d0e60 con 0x7fe15c15d200 2023-12-04T10:45:21.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe15ad9d640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 0x7fe15c0ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:21.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe148003520 con 0x7fe15c15d200 2023-12-04T10:45:21.088 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3626151939 0 0) 0x7fe148003520 con 0x7fe15c15d200 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 msgr2=0x7fe15c0ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 0x7fe15c0ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 >> v2:172.21.15.66:3300/0 conn(0x7fe15c15d5e0 msgr2=0x7fe15c0ce7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 --2- 172.21.15.63:0/322571007 >> v2:172.21.15.66:3300/0 conn(0x7fe15c15d5e0 0x7fe15c0ce7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0d1420 con 0x7fe15c15d200 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fe14c001670 con 0x7fe15c15d200 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 >> v1:172.21.15.63:6789/0 conn(0x7fe15c15d200 legacy=0x7fe15c0cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 0x7fe148003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe148003f40 0x7fe1480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe148005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0b6f70 con 0x7fe148004d00 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0d1140 con 0x7fe148003f40 2023-12-04T10:45:21.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe14800ba30 con 0x7fe15c0d0180 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.086+0000 7fe153fff640 1 --2- 172.21.15.63:0/322571007 >> v2:172.21.15.66:3300/0 conn(0x7fe15c15d5e0 0x7fe15c0ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe15ad9d640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe148005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe15a59c640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 0x7fe148003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe153fff640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe148003f40 0x7fe1480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe15ad9d640 1 -- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 msgr2=0x7fe148003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe15ad9d640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 0x7fe148003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe15ad9d640 1 -- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe148003f40 msgr2=0x7fe1480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe15ad9d640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe148003f40 0x7fe1480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe15ad9d640 1 -- 172.21.15.63:0/322571007 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe148003520 con 0x7fe148004d00 2023-12-04T10:45:21.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.087+0000 7fe15a59c640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c0d0180 0x7fe148003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:21.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.088+0000 7fe15ad9d640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe148005180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe154009fc0 tx=0x7fe1480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35aa36591d03fb12 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:21.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.089+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15402cc20 con 0x7fe148004d00 2023-12-04T10:45:21.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.089+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15400f040 con 0x7fe148004d00 2023-12-04T10:45:21.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.089+0000 7fe159d9b640 1 -- 172.21.15.63:0/322571007 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe154034440 con 0x7fe148004d00 2023-12-04T10:45:21.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.089+0000 7fe15b59e640 1 -- 172.21.15.63:0/322571007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 msgr2=0x7fe148005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:21.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.089+0000 7fe15b59e640 1 --2- 172.21.15.63:0/322571007 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe148005180 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fe154009fc0 tx=0x7fe1480057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.089+0000 7fe15ad9d640 1 -- 172.21.15.63:0/322571007 reap_dead start 2023-12-04T10:45:21.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.089+0000 7fe15b59e640 1 -- 172.21.15.63:0/322571007 shutdown_connections 2023-12-04T10:45:21.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.089+0000 7fe15b59e640 1 -- 172.21.15.63:0/322571007 >> 172.21.15.63:0/322571007 conn(0x7fe15c09c3e0 msgr2=0x7fe15c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:21.092 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.090+0000 7fe15b59e640 1 -- 172.21.15.63:0/322571007 shutdown_connections 2023-12-04T10:45:21.093 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.090+0000 7fe15b59e640 1 -- 172.21.15.63:0/322571007 wait complete. 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.091+0000 7fe15b59e640 1 Processor -- start 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.091+0000 7fe15b59e640 1 -- start start 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.092+0000 7fe15b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe15c15fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.092+0000 7fe15b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c14e4f0 0x7fe15c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.092+0000 7fe15b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe15c158ef0 0x7fe15c15d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.092+0000 7fe15b59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c159370 con 0x7fe148004d00 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.092+0000 7fe15b59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c1600e0 con 0x7fe15c158ef0 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.092+0000 7fe15b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe15c0ca5c0 con 0x7fe15c14e4f0 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe15c15fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe15c15fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51680/0 (socket says 172.21.15.63:51680) 2023-12-04T10:45:21.095 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15a59c640 1 -- 172.21.15.63:0/2451093572 learned_addr learned my addr 172.21.15.63:0/2451093572 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15a59c640 1 -- 172.21.15.63:0/2451093572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c14e4f0 msgr2=0x7fe15c1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15a59c640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c14e4f0 0x7fe15c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15a59c640 1 -- 172.21.15.63:0/2451093572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe15c158ef0 msgr2=0x7fe15c15d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15ad9d640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe15c158ef0 0x7fe15c15d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15a59c640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe15c158ef0 0x7fe15c15d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.093+0000 7fe15a59c640 1 -- 172.21.15.63:0/2451093572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe15c0d2080 con 0x7fe148004d00 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.094+0000 7fe15a59c640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe15c15fba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe14c001eb0 tx=0x7fe14c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.094+0000 7fe152ffd640 1 -- 172.21.15.63:0/2451093572 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0074e0 con 0x7fe148004d00 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.094+0000 7fe152ffd640 1 -- 172.21.15.63:0/2451093572 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c007640 con 0x7fe148004d00 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.094+0000 7fe152ffd640 1 -- 172.21.15.63:0/2451093572 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0049e0 con 0x7fe148004d00 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.094+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe15c0ca8a0 con 0x7fe148004d00 2023-12-04T10:45:21.096 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.094+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe15c0cae60 con 0x7fe148004d00 2023-12-04T10:45:21.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.095+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe15c0c75d0 con 0x7fe148004d00 2023-12-04T10:45:21.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.096+0000 7fe152ffd640 1 -- 172.21.15.63:0/2451093572 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe14c004b40 con 0x7fe148004d00 2023-12-04T10:45:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.098+0000 7fe152ffd640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe13c06ae70 0x7fe13c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.098+0000 7fe152ffd640 1 -- 172.21.15.63:0/2451093572 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6749+0+0 (secure 0 0 0) 0x7fe14c089510 con 0x7fe148004d00 2023-12-04T10:45:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.098+0000 7fe153fff640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe13c06ae70 0x7fe13c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:21.099 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.099+0000 7fe153fff640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe13c06ae70 0x7fe13c06d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe15c072610 tx=0x7fe14400e270 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:21.103 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.102+0000 7fe152ffd640 1 -- 172.21.15.63:0/2451093572 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe15c0c75d0 con 0x7fe148004d00 2023-12-04T10:45:21.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.334+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe15c0c75d0 con 0x7fe148004d00 2023-12-04T10:45:21.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.938+0000 7fe152ffd640 1 -- 172.21.15.63:0/2451093572 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe15c0c75d0 con 0x7fe148004d00 2023-12-04T10:45:21.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe13c06ae70 msgr2=0x7fe13c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe13c06ae70 0x7fe13c06d330 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe15c072610 tx=0x7fe14400e270 comp rx=0 tx=0).stop 2023-12-04T10:45:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 msgr2=0x7fe15c15fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe15c15fba0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fe14c001eb0 tx=0x7fe14c00dd40 comp rx=0 tx=0).stop 2023-12-04T10:45:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 shutdown_connections 2023-12-04T10:45:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe13c06ae70 0x7fe13c06d330 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe15c14e4f0 0x7fe15c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe15c158ef0 0x7fe15c15d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 --2- 172.21.15.63:0/2451093572 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe148004d00 0x7fe15c15fba0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:21.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.941+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 >> 172.21.15.63:0/2451093572 conn(0x7fe15c09c3e0 msgr2=0x7fe15c0ce5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:21.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.942+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 shutdown_connections 2023-12-04T10:45:21.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:21.942+0000 7fe15b59e640 1 -- 172.21.15.63:0/2451093572 wait complete. 2023-12-04T10:45:21.966 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-04T10:45:22.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.200+0000 7f672924b640 1 Processor -- start 2023-12-04T10:45:22.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.200+0000 7f672924b640 1 -- start start 2023-12-04T10:45:22.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.202+0000 7f672924b640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f672406d6f0 0x7f67240cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:22.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.202+0000 7f672924b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67240cc700 0x7f67240709e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:22.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.202+0000 7f672924b640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67240b39d0 con 0x7f672415a000 2023-12-04T10:45:22.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.202+0000 7f672924b640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f672406dcd0 con 0x7f672406d6f0 2023-12-04T10:45:22.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.202+0000 7f672924b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67240b2500 con 0x7f67240cc700 2023-12-04T10:45:22.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.202+0000 7f6723fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f672415a000 0x7f67240b32c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52024/0 (socket says 172.21.15.63:52024) 2023-12-04T10:45:22.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.202+0000 7f6723fff640 1 -- 172.21.15.63:0/3844163846 learned_addr learned my addr 172.21.15.63:0/3844163846 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:22.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.202+0000 7f671bfff640 1 --2- 172.21.15.63:0/3844163846 >> v2:172.21.15.63:3300/0 conn(0x7f672406d6f0 0x7f67240cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:22.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.203+0000 7f6728a4a640 1 --2- 172.21.15.63:0/3844163846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67240cc700 0x7f67240709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:22.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.203+0000 7f67237fe640 1 -- 172.21.15.63:0/3844163846 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3231711384 0 0) 0x7f67240b39d0 con 0x7f672415a000 2023-12-04T10:45:22.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.203+0000 7f671bfff640 1 -- 172.21.15.63:0/3844163846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67240cc700 msgr2=0x7f67240709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:22.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.203+0000 7f671bfff640 1 --2- 172.21.15.63:0/3844163846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67240cc700 0x7f67240709e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.203+0000 7f671bfff640 1 -- 172.21.15.63:0/3844163846 >> v1:172.21.15.63:6789/0 conn(0x7f672415a000 legacy=0x7f67240b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:22.205 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.203+0000 7f671bfff640 1 -- 172.21.15.63:0/3844163846 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67240b27e0 con 0x7f672406d6f0 2023-12-04T10:45:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.204+0000 7f671bfff640 1 --2- 172.21.15.63:0/3844163846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f67240cc1c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f670c0097a0 tx=0x7f670c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ee63ee3611c70 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.204+0000 7f67237fe640 1 -- 172.21.15.63:0/3844163846 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c031830 con 0x7f672406d6f0 2023-12-04T10:45:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f67237fe640 1 -- 172.21.15.63:0/3844163846 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f670c031990 con 0x7f672406d6f0 2023-12-04T10:45:22.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f67237fe640 1 -- 172.21.15.63:0/3844163846 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c031d20 con 0x7f672406d6f0 2023-12-04T10:45:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f672924b640 1 -- 172.21.15.63:0/3844163846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 msgr2=0x7f67240cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f672924b640 1 --2- 172.21.15.63:0/3844163846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f67240cc1c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f670c0097a0 tx=0x7f670c02b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f672924b640 1 -- 172.21.15.63:0/3844163846 shutdown_connections 2023-12-04T10:45:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f672924b640 1 --2- 172.21.15.63:0/3844163846 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f67240cc700 0x7f67240709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f672924b640 1 --2- 172.21.15.63:0/3844163846 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f67240cc1c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f672924b640 1 -- 172.21.15.63:0/3844163846 >> 172.21.15.63:0/3844163846 conn(0x7f67240b07f0 msgr2=0x7f67240b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f672924b640 1 -- 172.21.15.63:0/3844163846 shutdown_connections 2023-12-04T10:45:22.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.205+0000 7f672924b640 1 -- 172.21.15.63:0/3844163846 wait complete. 2023-12-04T10:45:22.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.207+0000 7f672924b640 1 Processor -- start 2023-12-04T10:45:22.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.207+0000 7f672924b640 1 -- start start 2023-12-04T10:45:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.208+0000 7f672924b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f6724151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.208+0000 7f672924b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67240cc700 0x7f6724155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f672924b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f672415a000 0x7f6724158640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f672924b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6724151f70 con 0x7f672406d6f0 2023-12-04T10:45:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f672924b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6724154550 con 0x7f67240cc700 2023-12-04T10:45:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f672924b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6724154830 con 0x7f672415a000 2023-12-04T10:45:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f6723fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f6724151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:22.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f6723fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f6724151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51706/0 (socket says 172.21.15.63:51706) 2023-12-04T10:45:22.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f6723fff640 1 -- 172.21.15.63:0/2444031468 learned_addr learned my addr 172.21.15.63:0/2444031468 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:22.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f6723fff640 1 -- 172.21.15.63:0/2444031468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f672415a000 msgr2=0x7f6724158640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:22.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f6723fff640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f672415a000 0x7f6724158640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f6723fff640 1 -- 172.21.15.63:0/2444031468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67240cc700 msgr2=0x7f6724155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:22.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f6723fff640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67240cc700 0x7f6724155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.211 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.209+0000 7f6723fff640 1 -- 172.21.15.63:0/2444031468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f670c009400 con 0x7f672406d6f0 2023-12-04T10:45:22.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.210+0000 7f6723fff640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f6724151a30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f671400c4d0 tx=0x7f671400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:22.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.210+0000 7f67217fa640 1 -- 172.21.15.63:0/2444031468 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67140074e0 con 0x7f672406d6f0 2023-12-04T10:45:22.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.210+0000 7f67217fa640 1 -- 172.21.15.63:0/2444031468 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6714007660 con 0x7f672406d6f0 2023-12-04T10:45:22.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.210+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6724154b10 con 0x7f672406d6f0 2023-12-04T10:45:22.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.210+0000 7f67217fa640 1 -- 172.21.15.63:0/2444031468 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6714004a20 con 0x7f672406d6f0 2023-12-04T10:45:22.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.210+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67241e3150 con 0x7f672406d6f0 2023-12-04T10:45:22.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.211+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6724157330 con 0x7f672406d6f0 2023-12-04T10:45:22.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.212+0000 7f67217fa640 1 -- 172.21.15.63:0/2444031468 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6714004b80 con 0x7f672406d6f0 2023-12-04T10:45:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.213+0000 7f67217fa640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f670406ae40 0x7f670406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.213+0000 7f67217fa640 1 -- 172.21.15.63:0/2444031468 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 6749+0+0 (secure 0 0 0) 0x7f6714088f60 con 0x7f672406d6f0 2023-12-04T10:45:22.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.213+0000 7f671bfff640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f670406ae40 0x7f670406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:22.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.214+0000 7f671bfff640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f670406ae40 0x7f670406d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f670c036000 tx=0x7f670c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:22.218 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.218+0000 7f67217fa640 1 -- 172.21.15.63:0/2444031468 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6714053bf0 con 0x7f672406d6f0 2023-12-04T10:45:22.416 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.415+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f672404e840 con 0x7f672406d6f0 2023-12-04T10:45:22.954 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.953+0000 7f67217fa640 1 -- 172.21.15.63:0/2444031468 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v31) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6714018020 con 0x7f672406d6f0 2023-12-04T10:45:22.954 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' removed 2023-12-04T10:45:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f670406ae40 msgr2=0x7f670406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f670406ae40 0x7f670406d300 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f670c036000 tx=0x7f670c030000 comp rx=0 tx=0).stop 2023-12-04T10:45:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 msgr2=0x7f6724151a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f6724151a30 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f671400c4d0 tx=0x7f671400c990 comp rx=0 tx=0).stop 2023-12-04T10:45:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 shutdown_connections 2023-12-04T10:45:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f670406ae40 0x7f670406d300 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f672415a000 0x7f6724158640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f67240cc700 0x7f6724155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 --2- 172.21.15.63:0/2444031468 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f672406d6f0 0x7f6724151a30 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:22.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 >> 172.21.15.63:0/2444031468 conn(0x7f67240b07f0 msgr2=0x7f67240cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:22.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 shutdown_connections 2023-12-04T10:45:22.959 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:22.957+0000 7f672924b640 1 -- 172.21.15.63:0/2444031468 wait complete. 2023-12-04T10:45:22.982 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-04T10:45:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.201+0000 7fef81da0640 1 Processor -- start 2023-12-04T10:45:23.202 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.201+0000 7fef81da0640 1 -- start start 2023-12-04T10:45:23.203 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.202+0000 7fef81da0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c160990 0x7fef7c0cfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.202+0000 7fef81da0640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fef7c0cf560 0x7fef7c0cff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.202+0000 7fef81da0640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef7c0d3cc0 con 0x7fef7c0b1f00 2023-12-04T10:45:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.202+0000 7fef81da0640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7c0d3fa0 con 0x7fef7c0cf560 2023-12-04T10:45:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.202+0000 7fef81da0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0ce6b0 con 0x7fef7c160990 2023-12-04T10:45:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.203+0000 7fef8159f640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fef7c0b1f00 0x7fef7c0d0f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:52034/0 (socket says 172.21.15.63:52034) 2023-12-04T10:45:23.204 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.203+0000 7fef8159f640 1 -- 172.21.15.63:0/2019205742 learned_addr learned my addr 172.21.15.63:0/2019205742 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.203+0000 7fef80d9e640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c160990 0x7fef7c0cfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.203+0000 7fef7bfff640 1 --2- 172.21.15.63:0/2019205742 >> v2:172.21.15.66:3300/0 conn(0x7fef7c0cf560 0x7fef7c0cff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.203+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872421876 0 0) 0x7fef7c0d3cc0 con 0x7fef7c0b1f00 2023-12-04T10:45:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.203+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef64003520 con 0x7fef7c0b1f00 2023-12-04T10:45:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1141657282 0 0) 0x7fef64003520 con 0x7fef7c0b1f00 2023-12-04T10:45:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c160990 msgr2=0x7fef7c0cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c160990 0x7fef7c0cfa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.206 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 >> v2:172.21.15.66:3300/0 conn(0x7fef7c0cf560 msgr2=0x7fef7c0cff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 --2- 172.21.15.63:0/2019205742 >> v2:172.21.15.66:3300/0 conn(0x7fef7c0cf560 0x7fef7c0cff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0ce8a0 con 0x7fef7c0b1f00 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fef74001670 con 0x7fef7c0b1f00 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 >> v1:172.21.15.63:6789/0 conn(0x7fef7c0b1f00 legacy=0x7fef7c0d0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64003970 0x7fef64003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c160990 0x7fef640047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef64004d00 0x7fef64005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0d3fa0 con 0x7fef64004d00 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef6400b980 con 0x7fef64003970 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef6400bac0 con 0x7fef7c160990 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.204+0000 7fef8159f640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef64004d00 0x7fef64005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.205+0000 7fef7bfff640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c160990 0x7fef640047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.205+0000 7fef80d9e640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64003970 0x7fef64003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.207 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.205+0000 7fef8159f640 1 -- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c160990 msgr2=0x7fef640047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.205+0000 7fef8159f640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c160990 0x7fef640047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.205+0000 7fef8159f640 1 -- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64003970 msgr2=0x7fef64003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.205+0000 7fef8159f640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64003970 0x7fef64003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.208 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.205+0000 7fef8159f640 1 -- 172.21.15.63:0/2019205742 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef64003520 con 0x7fef64004d00 2023-12-04T10:45:23.209 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.206+0000 7fef8159f640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef64004d00 0x7fef64005180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c290 tx=0x7fef640057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7582052f80689d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.206+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef74005ad0 con 0x7fef64004d00 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.206+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef74005c30 con 0x7fef64004d00 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.206+0000 7fef7b7fe640 1 -- 172.21.15.63:0/2019205742 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7402c8d0 con 0x7fef64004d00 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.207+0000 7fef81da0640 1 -- 172.21.15.63:0/2019205742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef64004d00 msgr2=0x7fef64005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.207+0000 7fef81da0640 1 --2- 172.21.15.63:0/2019205742 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef64004d00 0x7fef64005180 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fef7400c290 tx=0x7fef640057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.207+0000 7fef8159f640 1 -- 172.21.15.63:0/2019205742 reap_dead start 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.207+0000 7fef81da0640 1 -- 172.21.15.63:0/2019205742 shutdown_connections 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.207+0000 7fef81da0640 1 -- 172.21.15.63:0/2019205742 >> 172.21.15.63:0/2019205742 conn(0x7fef7c0d3000 msgr2=0x7fef7c0d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.207+0000 7fef81da0640 1 -- 172.21.15.63:0/2019205742 shutdown_connections 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.207+0000 7fef81da0640 1 -- 172.21.15.63:0/2019205742 wait complete. 2023-12-04T10:45:23.210 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.209+0000 7fef81da0640 1 Processor -- start 2023-12-04T10:45:23.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.209+0000 7fef81da0640 1 -- start start 2023-12-04T10:45:23.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef81da0640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64004d00 0x7fef7c15dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef81da0640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef7c0c7d60 0x7fef7c0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef81da0640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0c6af0 0x7fef7c0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef81da0640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0b5d90 con 0x7fef7c0c7d60 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef81da0640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0c8720 con 0x7fef64004d00 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef81da0640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef7c0c74b0 con 0x7fef7c0c6af0 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef7bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef7c0c7d60 0x7fef7c0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef7bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef7c0c7d60 0x7fef7c0c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:51724/0 (socket says 172.21.15.63:51724) 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.210+0000 7fef7bfff640 1 -- 172.21.15.63:0/2137079456 learned_addr learned my addr 172.21.15.63:0/2137079456 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef80d9e640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64004d00 0x7fef7c15dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef8159f640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0c6af0 0x7fef7c0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef7bfff640 1 -- 172.21.15.63:0/2137079456 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0c6af0 msgr2=0x7fef7c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef7bfff640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0c6af0 0x7fef7c0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.213 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef7bfff640 1 -- 172.21.15.63:0/2137079456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64004d00 msgr2=0x7fef7c15dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef7bfff640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64004d00 0x7fef7c15dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef7bfff640 1 -- 172.21.15.63:0/2137079456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0b2770 con 0x7fef7c0c7d60 2023-12-04T10:45:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef7bfff640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef7c0c7d60 0x7fef7c0c81e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fef70009fd0 tx=0x7fef700115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.211+0000 7fef797fa640 1 -- 172.21.15.63:0/2137079456 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7000e030 con 0x7fef7c0c7d60 2023-12-04T10:45:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.212+0000 7fef797fa640 1 -- 172.21.15.63:0/2137079456 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef70003990 con 0x7fef7c0c7d60 2023-12-04T10:45:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.212+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef7c0c7770 con 0x7fef7c0c7d60 2023-12-04T10:45:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.212+0000 7fef797fa640 1 -- 172.21.15.63:0/2137079456 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef70003b20 con 0x7fef7c0c7d60 2023-12-04T10:45:23.214 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.212+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef7c1e6590 con 0x7fef7c0c7d60 2023-12-04T10:45:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.213+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7c04e840 con 0x7fef7c0c7d60 2023-12-04T10:45:23.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.214+0000 7fef797fa640 1 -- 172.21.15.63:0/2137079456 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef70003c80 con 0x7fef7c0c7d60 2023-12-04T10:45:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.215+0000 7fef797fa640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef6806ae40 0x7fef6806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.215+0000 7fef797fa640 1 -- 172.21.15.63:0/2137079456 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 6311+0+0 (secure 0 0 0) 0x7fef7000f070 con 0x7fef7c0c7d60 2023-12-04T10:45:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.215+0000 7fef80d9e640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef6806ae40 0x7fef6806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:23.216 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.216+0000 7fef80d9e640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef6806ae40 0x7fef6806d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009990 tx=0x7fef6c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:23.220 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.220+0000 7fef797fa640 1 -- 172.21.15.63:0/2137079456 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef700552c0 con 0x7fef7c0c7d60 2023-12-04T10:45:23.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.412+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fef7c0743a0 con 0x7fef7c0c7d60 2023-12-04T10:45:23.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.977+0000 7fef797fa640 1 -- 172.21.15.63:0/2137079456 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v32) v1 ==== 169+0+0 (secure 0 0 0) 0x7fef700588e0 con 0x7fef7c0c7d60 2023-12-04T10:45:23.978 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' removed 2023-12-04T10:45:23.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.985+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef6806ae40 msgr2=0x7fef6806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:23.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.985+0000 7fef81da0640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef6806ae40 0x7fef6806d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009990 tx=0x7fef6c008040 comp rx=0 tx=0).stop 2023-12-04T10:45:23.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.985+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef7c0c7d60 msgr2=0x7fef7c0c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:23.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.985+0000 7fef81da0640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef7c0c7d60 0x7fef7c0c81e0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fef70009fd0 tx=0x7fef700115a0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.986+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 shutdown_connections 2023-12-04T10:45:23.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.986+0000 7fef81da0640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fef6806ae40 0x7fef6806d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.986+0000 7fef81da0640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fef7c0c6af0 0x7fef7c0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.986+0000 7fef81da0640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fef7c0c7d60 0x7fef7c0c81e0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.986+0000 7fef81da0640 1 --2- 172.21.15.63:0/2137079456 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fef64004d00 0x7fef7c15dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:23.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.986+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 >> 172.21.15.63:0/2137079456 conn(0x7fef7c0d3000 msgr2=0x7fef7c0cdbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:23.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.986+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 shutdown_connections 2023-12-04T10:45:23.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:23.986+0000 7fef81da0640 1 -- 172.21.15.63:0/2137079456 wait complete. 2023-12-04T10:45:24.014 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-04T10:45:24.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.228+0000 7f3f04c17640 1 Processor -- start 2023-12-04T10:45:24.229 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.228+0000 7f3f04c17640 1 -- start start 2023-12-04T10:45:24.230 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.229+0000 7f3f04c17640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f0013d6f0 0x7f3f000b0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:24.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.229+0000 7f3f04c17640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3f000b10e0 0x7f3f000b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:24.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.230+0000 7f3f04c17640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f000cba20 con 0x7f3f000cb640 2023-12-04T10:45:24.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.230+0000 7f3f04c17640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f000b1570 con 0x7f3f000b10e0 2023-12-04T10:45:24.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.230+0000 7f3f04c17640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000b3810 con 0x7f3f0013d6f0 2023-12-04T10:45:24.231 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.230+0000 7f3efdd9b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f0013d6f0 0x7f3f000b0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:24.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.230+0000 7f3efed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3f000b10e0 0x7f3f000b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:24.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.230+0000 7f3efed9d640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3f000b10e0 0x7f3f000b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:55358/0 (socket says 172.21.15.63:55358) 2023-12-04T10:45:24.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.230+0000 7f3efed9d640 1 -- 172.21.15.63:0/3083363298 learned_addr learned my addr 172.21.15.63:0/3083363298 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:24.232 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.231+0000 7f3efdd9b640 1 -- 172.21.15.63:0/3083363298 >> v2:172.21.15.66:3300/0 conn(0x7f3f000b10e0 msgr2=0x7f3f000b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:24.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.231+0000 7f3efdd9b640 1 --2- 172.21.15.63:0/3083363298 >> v2:172.21.15.66:3300/0 conn(0x7f3f000b10e0 0x7f3f000b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.231+0000 7f3efdd9b640 1 -- 172.21.15.63:0/3083363298 >> v1:172.21.15.66:6789/0 conn(0x7f3f000cb640 legacy=0x7f3f0015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:24.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.231+0000 7f3efdd9b640 1 -- 172.21.15.63:0/3083363298 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f000b3af0 con 0x7f3f0013d6f0 2023-12-04T10:45:24.233 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.233+0000 7f3efdd9b640 1 --2- 172.21.15.63:0/3083363298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f0013d6f0 0x7f3f000b0ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40097a0 tx=0x7f3ef402b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a582dd50cf16e1bb server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:24.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.233+0000 7f3efd59a640 1 -- 172.21.15.63:0/3083363298 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4031780 con 0x7f3f0013d6f0 2023-12-04T10:45:24.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.233+0000 7f3efd59a640 1 -- 172.21.15.63:0/3083363298 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef40318e0 con 0x7f3f0013d6f0 2023-12-04T10:45:24.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.233+0000 7f3efd59a640 1 -- 172.21.15.63:0/3083363298 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4031c70 con 0x7f3f0013d6f0 2023-12-04T10:45:24.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.234+0000 7f3f04c17640 1 -- 172.21.15.63:0/3083363298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f0013d6f0 msgr2=0x7f3f000b0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:24.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.234+0000 7f3f04c17640 1 --2- 172.21.15.63:0/3083363298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f0013d6f0 0x7f3f000b0ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3ef40097a0 tx=0x7f3ef402b820 comp rx=0 tx=0).stop 2023-12-04T10:45:24.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.234+0000 7f3f04c17640 1 -- 172.21.15.63:0/3083363298 shutdown_connections 2023-12-04T10:45:24.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.234+0000 7f3f04c17640 1 --2- 172.21.15.63:0/3083363298 >> v2:172.21.15.66:3300/0 conn(0x7f3f000b10e0 0x7f3f000b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.234+0000 7f3f04c17640 1 --2- 172.21.15.63:0/3083363298 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f0013d6f0 0x7f3f000b0ba0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.234+0000 7f3f04c17640 1 -- 172.21.15.63:0/3083363298 >> 172.21.15.63:0/3083363298 conn(0x7f3f0006a450 msgr2=0x7f3f0006a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:24.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.234+0000 7f3f04c17640 1 -- 172.21.15.63:0/3083363298 shutdown_connections 2023-12-04T10:45:24.236 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.234+0000 7f3f04c17640 1 -- 172.21.15.63:0/3083363298 wait complete. 2023-12-04T10:45:24.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.236+0000 7f3f04c17640 1 Processor -- start 2023-12-04T10:45:24.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.236+0000 7f3f04c17640 1 -- start start 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3f04c17640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f000b10e0 0x7f3f00152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3f04c17640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f000cb640 0x7f3f000b0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3f04c17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f0013d6f0 0x7f3f0013f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3f04c17640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f000b0340 con 0x7f3f000b10e0 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3f04c17640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f00153d70 con 0x7f3f0013d6f0 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3f04c17640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f00152ea0 con 0x7f3f000cb640 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3efe59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f000b10e0 0x7f3f00152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3efe59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f000b10e0 0x7f3f00152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:39976/0 (socket says 172.21.15.63:39976) 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.237+0000 7f3efe59c640 1 -- 172.21.15.63:0/2067627937 learned_addr learned my addr 172.21.15.63:0/2067627937 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efdd9b640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f000cb640 0x7f3f000b0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efed9d640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f0013d6f0 0x7f3f0013f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:24.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efe59c640 1 -- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f000cb640 msgr2=0x7f3f000b0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efe59c640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f000cb640 0x7f3f000b0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efe59c640 1 -- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f0013d6f0 msgr2=0x7f3f0013f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efe59c640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f0013d6f0 0x7f3f0013f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efe59c640 1 -- 172.21.15.63:0/2067627937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ef4009400 con 0x7f3f000b10e0 2023-12-04T10:45:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efed9d640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f0013d6f0 0x7f3f0013f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3efe59c640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f000b10e0 0x7f3f00152960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000c400 tx=0x7f3ef000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3eeeffd640 1 -- 172.21.15.63:0/2067627937 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef00052d0 con 0x7f3f000b10e0 2023-12-04T10:45:24.241 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3eeeffd640 1 -- 172.21.15.63:0/2067627937 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ef0005450 con 0x7f3f000b10e0 2023-12-04T10:45:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f000b0ca0 con 0x7f3f000b10e0 2023-12-04T10:45:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3eeeffd640 1 -- 172.21.15.63:0/2067627937 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ef0007260 con 0x7f3f000b10e0 2023-12-04T10:45:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.238+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f000afc80 con 0x7f3f000b10e0 2023-12-04T10:45:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.239+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f000b0480 con 0x7f3f000b10e0 2023-12-04T10:45:24.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.241+0000 7f3eeeffd640 1 -- 172.21.15.63:0/2067627937 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ef00073c0 con 0x7f3f000b10e0 2023-12-04T10:45:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.242+0000 7f3eeeffd640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3ee006ae40 0x7f3ee006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.242+0000 7f3eeeffd640 1 -- 172.21.15.63:0/2067627937 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5781+0+0 (secure 0 0 0) 0x7f3ef0088a60 con 0x7f3f000b10e0 2023-12-04T10:45:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.242+0000 7f3efdd9b640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3ee006ae40 0x7f3ee006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:24.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.243+0000 7f3efdd9b640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3ee006ae40 0x7f3ee006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4036000 tx=0x7f3ef403d040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:24.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.247+0000 7f3eeeffd640 1 -- 172.21.15.63:0/2067627937 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3f000b0480 con 0x7f3f000b10e0 2023-12-04T10:45:24.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.447+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3f000b0480 con 0x7f3f000b10e0 2023-12-04T10:45:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.987+0000 7f3eeeffd640 1 -- 172.21.15.63:0/2067627937 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v33) v1 ==== 178+0+0 (secure 0 0 0) 0x7f3f000b0480 con 0x7f3f000b10e0 2023-12-04T10:45:24.989 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data_ec' removed 2023-12-04T10:45:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.993+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3ee006ae40 msgr2=0x7f3ee006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.993+0000 7f3f04c17640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3ee006ae40 0x7f3ee006d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4036000 tx=0x7f3ef403d040 comp rx=0 tx=0).stop 2023-12-04T10:45:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.993+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f000b10e0 msgr2=0x7f3f00152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:24.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.993+0000 7f3f04c17640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f000b10e0 0x7f3f00152960 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3ef000c400 tx=0x7f3ef000c8c0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.994+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 shutdown_connections 2023-12-04T10:45:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.994+0000 7f3f04c17640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f3ee006ae40 0x7f3ee006d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.994+0000 7f3f04c17640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f3f000cb640 0x7f3f000b0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.994+0000 7f3f04c17640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3f0013d6f0 0x7f3f0013f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.994+0000 7f3f04c17640 1 --2- 172.21.15.63:0/2067627937 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f3f000b10e0 0x7f3f00152960 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.994+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 >> 172.21.15.63:0/2067627937 conn(0x7f3f0006a450 msgr2=0x7f3f0015c590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.994+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 shutdown_connections 2023-12-04T10:45:24.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:24.995+0000 7f3f04c17640 1 -- 172.21.15.63:0/2067627937 wait complete. 2023-12-04T10:45:25.021 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-04T10:45:25.021 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-04T10:45:25.021 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-04T10:45:25.021 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T10:45:25.021 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-04T10:45:25.021 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-04T10:45:25.022 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-04T10:45:25.022 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T10:45:25.022 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-04T10:45:25.022 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-04T10:45:25.022 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-04T10:45:25.022 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T10:45:25.023 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-04T10:45:25.023 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-04T10:45:25.023 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-04T10:45:25.023 INFO:teuthology.orchestra.run:waiting for 300 2023-12-04T10:45:25.041 INFO:tasks.ceph.mds.a:Stopped 2023-12-04T10:45:25.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-04T10:45:25.043 INFO:tasks.ceph.mds.c:Stopped 2023-12-04T10:45:25.043 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-04T10:45:25.044 INFO:tasks.ceph.mds.d:Stopped 2023-12-04T10:45:25.044 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-04T10:45:25.053 INFO:tasks.ceph.mds.b:Stopped 2023-12-04T10:45:25.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-04T10:45:25.093 INFO:tasks.ceph.mds.a:Started 2023-12-04T10:45:25.093 DEBUG:teuthology.parallel:result is None 2023-12-04T10:45:25.100 INFO:tasks.ceph.mds.d:Started 2023-12-04T10:45:25.100 DEBUG:teuthology.parallel:result is None 2023-12-04T10:45:25.101 INFO:tasks.ceph.mds.c:Started 2023-12-04T10:45:25.101 DEBUG:teuthology.parallel:result is None 2023-12-04T10:45:25.108 INFO:tasks.ceph.mds.b:Started 2023-12-04T10:45:25.108 DEBUG:teuthology.parallel:result is None 2023-12-04T10:45:25.108 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-04T10:45:25.261 INFO:tasks.ceph.mds.a.smithi063.stdout:starting mds.a at 2023-12-04T10:45:25.261 INFO:tasks.ceph.mds.c.smithi063.stdout:starting mds.c at 2023-12-04T10:45:25.276 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2023-12-04T10:45:25.277 INFO:tasks.ceph.mds.d.smithi066.stdout:starting mds.d at 2023-12-04T10:45:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.307+0000 7f19a3f89640 1 Processor -- start 2023-12-04T10:45:25.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.307+0000 7f19a3f89640 1 -- start start 2023-12-04T10:45:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.308+0000 7f19a3f89640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f199c0701b0 0x7f199c0705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.308+0000 7f19a3f89640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f199c0ca290 0x7f199c0ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.308+0000 7f19a3f89640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c070b00 con 0x7f199c144a00 2023-12-04T10:45:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.308+0000 7f19a3f89640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0cabe0 con 0x7f199c0ca290 2023-12-04T10:45:25.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.308+0000 7f19a3f89640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0cae80 con 0x7f199c0701b0 2023-12-04T10:45:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.309+0000 7f19a2526640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f199c0ca290 0x7f199c0ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.309+0000 7f19a2526640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f199c0ca290 0x7f199c0ca6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40026/0 (socket says 172.21.15.63:40026) 2023-12-04T10:45:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.309+0000 7f19a2526640 1 -- 172.21.15.63:0/1064334437 learned_addr learned my addr 172.21.15.63:0/1064334437 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.309+0000 7f19a1524640 1 --2- 172.21.15.63:0/1064334437 >> v2:172.21.15.66:3300/0 conn(0x7f199c0701b0 0x7f199c0705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:25.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.309+0000 7f19a2526640 1 -- 172.21.15.63:0/1064334437 >> v2:172.21.15.66:3300/0 conn(0x7f199c0701b0 msgr2=0x7f199c0705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.309+0000 7f19a2526640 1 --2- 172.21.15.63:0/1064334437 >> v2:172.21.15.66:3300/0 conn(0x7f199c0701b0 0x7f199c0705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.309+0000 7f19a2526640 1 -- 172.21.15.63:0/1064334437 >> v1:172.21.15.63:6789/0 conn(0x7f199c144a00 legacy=0x7f199c0b1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.309+0000 7f19a2526640 1 -- 172.21.15.63:0/1064334437 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c06c460 con 0x7f199c0ca290 2023-12-04T10:45:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.310+0000 7f19a2526640 1 --2- 172.21.15.63:0/1064334437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c0ca290 0x7f199c0ca6a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f199c0cb3d0 tx=0x7f199402bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff2b1052cbfce2c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a0d23640 1 -- 172.21.15.63:0/1064334437 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199402cb10 con 0x7f199c0ca290 2023-12-04T10:45:25.311 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a0d23640 1 -- 172.21.15.63:0/1064334437 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199402cc70 con 0x7f199c0ca290 2023-12-04T10:45:25.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a0d23640 1 -- 172.21.15.63:0/1064334437 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940343f0 con 0x7f199c0ca290 2023-12-04T10:45:25.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a3f89640 1 -- 172.21.15.63:0/1064334437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c0ca290 msgr2=0x7f199c0ca6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:25.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a3f89640 1 --2- 172.21.15.63:0/1064334437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c0ca290 0x7f199c0ca6a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f199c0cb3d0 tx=0x7f199402bf70 comp rx=0 tx=0).stop 2023-12-04T10:45:25.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a3f89640 1 -- 172.21.15.63:0/1064334437 shutdown_connections 2023-12-04T10:45:25.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a3f89640 1 --2- 172.21.15.63:0/1064334437 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c0ca290 0x7f199c0ca6a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:25.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a3f89640 1 --2- 172.21.15.63:0/1064334437 >> v2:172.21.15.66:3300/0 conn(0x7f199c0701b0 0x7f199c0705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:25.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a3f89640 1 -- 172.21.15.63:0/1064334437 >> 172.21.15.63:0/1064334437 conn(0x7f199c0cee80 msgr2=0x7f199c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:25.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a3f89640 1 -- 172.21.15.63:0/1064334437 shutdown_connections 2023-12-04T10:45:25.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.311+0000 7f19a3f89640 1 -- 172.21.15.63:0/1064334437 wait complete. 2023-12-04T10:45:25.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.313+0000 7f19a3f89640 1 Processor -- start 2023-12-04T10:45:25.314 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.313+0000 7f19a3f89640 1 -- start start 2023-12-04T10:45:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.314+0000 7f19a3f89640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f199c0701b0 0x7f199c13f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a3f89640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c0ca290 0x7f199c1e1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a3f89640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c144a00 0x7f199c13d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a3f89640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c13eb90 con 0x7f199c144a00 2023-12-04T10:45:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a3f89640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c13f560 con 0x7f199c0ca290 2023-12-04T10:45:25.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a3f89640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c13df80 con 0x7f199c0701b0 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a2526640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c144a00 0x7f199c13d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a1524640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c0ca290 0x7f199c1e1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a2526640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c144a00 0x7f199c13d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40028/0 (socket says 172.21.15.63:40028) 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a1524640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c0ca290 0x7f199c1e1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:55398/0 (socket says 172.21.15.63:55398) 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a2526640 1 -- 172.21.15.63:0/890406170 learned_addr learned my addr 172.21.15.63:0/890406170 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.315+0000 7f19a1d25640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f199c0701b0 0x7f199c13f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.316+0000 7f19a2526640 1 -- 172.21.15.63:0/890406170 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f199c0701b0 msgr2=0x7f199c13f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.316+0000 7f19a2526640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f199c0701b0 0x7f199c13f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.316+0000 7f19a2526640 1 -- 172.21.15.63:0/890406170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c0ca290 msgr2=0x7f199c1e1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.316+0000 7f19a2526640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c0ca290 0x7f199c1e1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:25.317 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.316+0000 7f19a2526640 1 -- 172.21.15.63:0/890406170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994009b30 con 0x7f199c144a00 2023-12-04T10:45:25.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.317+0000 7f19a2526640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c144a00 0x7f199c13d4a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1994036040 tx=0x7f1994004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:25.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.318+0000 7f19927fc640 1 -- 172.21.15.63:0/890406170 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994009510 con 0x7f199c144a00 2023-12-04T10:45:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.319+0000 7f19927fc640 1 -- 172.21.15.63:0/890406170 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199403e450 con 0x7f199c144a00 2023-12-04T10:45:25.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.319+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c13e260 con 0x7f199c144a00 2023-12-04T10:45:25.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.319+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c13e820 con 0x7f199c144a00 2023-12-04T10:45:25.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.321+0000 7f19927fc640 1 -- 172.21.15.63:0/890406170 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994009510 con 0x7f199c144a00 2023-12-04T10:45:25.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.321+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c13ed40 con 0x7f199c144a00 2023-12-04T10:45:25.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.324+0000 7f19927fc640 1 -- 172.21.15.63:0/890406170 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f199403e5c0 con 0x7f199c144a00 2023-12-04T10:45:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.326+0000 7f19927fc640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f198006aea0 0x7f198006d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.326+0000 7f19927fc640 1 -- 172.21.15.63:0/890406170 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f19940ac070 con 0x7f199c144a00 2023-12-04T10:45:25.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.326+0000 7f19a1d25640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f198006aea0 0x7f198006d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:25.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.327+0000 7f19a1d25640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f198006aea0 0x7f198006d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1998000f60 tx=0x7f1998009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:25.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.329+0000 7f19927fc640 1 -- 172.21.15.63:0/890406170 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f19940772d0 con 0x7f199c144a00 2023-12-04T10:45:25.543 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:25.542+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f199c068710 con 0x7f199c144a00 2023-12-04T10:45:26.015 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.013+0000 7f19927fc640 1 -- 172.21.15.63:0/890406170 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7f199407a8f0 con 0x7f199c144a00 2023-12-04T10:45:26.015 INFO:teuthology.orchestra.run.smithi063.stderr: removed all blocklist entries 2023-12-04T10:45:26.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f198006aea0 msgr2=0x7f198006d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f198006aea0 0x7f198006d360 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f1998000f60 tx=0x7f1998009040 comp rx=0 tx=0).stop 2023-12-04T10:45:26.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c144a00 msgr2=0x7f199c13d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c144a00 0x7f199c13d4a0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1994036040 tx=0x7f1994004a40 comp rx=0 tx=0).stop 2023-12-04T10:45:26.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 shutdown_connections 2023-12-04T10:45:26.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f198006aea0 0x7f198006d360 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.019 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f199c144a00 0x7f199c13d4a0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f199c0ca290 0x7f199c1e1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 --2- 172.21.15.63:0/890406170 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f199c0701b0 0x7f199c13f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.018+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 >> 172.21.15.63:0/890406170 conn(0x7f199c0cee80 msgr2=0x7f199c0b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:26.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.019+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 shutdown_connections 2023-12-04T10:45:26.020 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.019+0000 7f19a3f89640 1 -- 172.21.15.63:0/890406170 wait complete. 2023-12-04T10:45:26.044 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-04T10:45:26.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.268+0000 7f2db973c640 1 Processor -- start 2023-12-04T10:45:26.269 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.268+0000 7f2db973c640 1 -- start start 2023-12-04T10:45:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.270+0000 7f2db973c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2db40b1dc0 0x7f2db40cf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.270+0000 7f2db973c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40cf720 0x7f2db40acaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.270+0000 7f2db973c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2db40b3390 con 0x7f2db415d260 2023-12-04T10:45:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.270+0000 7f2db973c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2db4071900 con 0x7f2db40b1dc0 2023-12-04T10:45:26.271 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.270+0000 7f2db973c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db40cfbb0 con 0x7f2db40cf720 2023-12-04T10:45:26.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.271+0000 7f2db37fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40cf720 0x7f2db40acaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.271+0000 7f2db37fe640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40cf720 0x7f2db40acaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:43830/0 (socket says 172.21.15.63:43830) 2023-12-04T10:45:26.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.271+0000 7f2db37fe640 1 -- 172.21.15.63:0/1966931390 learned_addr learned my addr 172.21.15.63:0/1966931390 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:26.272 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.271+0000 7f2db27fc640 1 --2- 172.21.15.63:0/1966931390 >> v2:172.21.15.66:3300/0 conn(0x7f2db40b1dc0 0x7f2db40cf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.272+0000 7f2db37fe640 1 -- 172.21.15.63:0/1966931390 >> v2:172.21.15.66:3300/0 conn(0x7f2db40b1dc0 msgr2=0x7f2db40cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:26.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.272+0000 7f2db37fe640 1 --2- 172.21.15.63:0/1966931390 >> v2:172.21.15.66:3300/0 conn(0x7f2db40b1dc0 0x7f2db40cf1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.272+0000 7f2db37fe640 1 -- 172.21.15.63:0/1966931390 >> v1:172.21.15.66:6789/0 conn(0x7f2db415d260 legacy=0x7f2db40711f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.273 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.272+0000 7f2db37fe640 1 -- 172.21.15.63:0/1966931390 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db40b2f00 con 0x7f2db40cf720 2023-12-04T10:45:26.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.273+0000 7f2db37fe640 1 --2- 172.21.15.63:0/1966931390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40cf720 0x7f2db40acaa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009870 tx=0x7f2dac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4e6a39450630d2d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:26.274 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db1ffb640 1 -- 172.21.15.63:0/1966931390 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac030840 con 0x7f2db40cf720 2023-12-04T10:45:26.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db1ffb640 1 -- 172.21.15.63:0/1966931390 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dac0309a0 con 0x7f2db40cf720 2023-12-04T10:45:26.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db1ffb640 1 -- 172.21.15.63:0/1966931390 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dac030d30 con 0x7f2db40cf720 2023-12-04T10:45:26.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db973c640 1 -- 172.21.15.63:0/1966931390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40cf720 msgr2=0x7f2db40acaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.275 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db973c640 1 --2- 172.21.15.63:0/1966931390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40cf720 0x7f2db40acaa0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2dac009870 tx=0x7f2dac02b980 comp rx=0 tx=0).stop 2023-12-04T10:45:26.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db973c640 1 -- 172.21.15.63:0/1966931390 shutdown_connections 2023-12-04T10:45:26.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db973c640 1 --2- 172.21.15.63:0/1966931390 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40cf720 0x7f2db40acaa0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db973c640 1 --2- 172.21.15.63:0/1966931390 >> v2:172.21.15.66:3300/0 conn(0x7f2db40b1dc0 0x7f2db40cf1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.274+0000 7f2db973c640 1 -- 172.21.15.63:0/1966931390 >> 172.21.15.63:0/1966931390 conn(0x7f2db406a840 msgr2=0x7f2db406ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:26.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.275+0000 7f2db973c640 1 -- 172.21.15.63:0/1966931390 shutdown_connections 2023-12-04T10:45:26.276 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.275+0000 7f2db973c640 1 -- 172.21.15.63:0/1966931390 wait complete. 2023-12-04T10:45:26.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.276+0000 7f2db973c640 1 Processor -- start 2023-12-04T10:45:26.277 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.277+0000 7f2db973c640 1 -- start start 2023-12-04T10:45:26.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db973c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40b1dc0 0x7f2db4146ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db973c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2db40cf720 0x7f2db41532b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db973c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db415d260 0x7f2db41537f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db973c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db415f420 con 0x7f2db40cf720 2023-12-04T10:45:26.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db973c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2db4146ff0 con 0x7f2db415d260 2023-12-04T10:45:26.279 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db973c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2db415e7a0 con 0x7f2db40b1dc0 2023-12-04T10:45:26.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db27fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2db40cf720 0x7f2db41532b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db27fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2db40cf720 0x7f2db41532b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40030/0 (socket says 172.21.15.63:40030) 2023-12-04T10:45:26.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db27fc640 1 -- 172.21.15.63:0/2930920083 learned_addr learned my addr 172.21.15.63:0/2930920083 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:26.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db37fe640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db415d260 0x7f2db41537f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.280 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.278+0000 7f2db2ffd640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40b1dc0 0x7f2db4146ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2db27fc640 1 -- 172.21.15.63:0/2930920083 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40b1dc0 msgr2=0x7f2db4146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2db27fc640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40b1dc0 0x7f2db4146ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2db27fc640 1 -- 172.21.15.63:0/2930920083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db415d260 msgr2=0x7f2db41537f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2db27fc640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db415d260 0x7f2db41537f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2db27fc640 1 -- 172.21.15.63:0/2930920083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0094d0 con 0x7f2db40cf720 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2db27fc640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2db40cf720 0x7f2db41532b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00e9b0 tx=0x7f2d9c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2dab7fe640 1 -- 172.21.15.63:0/2930920083 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c009670 con 0x7f2db40cf720 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2dab7fe640 1 -- 172.21.15.63:0/2930920083 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d9c00c9a0 con 0x7f2db40cf720 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2db415ea80 con 0x7f2db40cf720 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2dab7fe640 1 -- 172.21.15.63:0/2930920083 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d9c00cd50 con 0x7f2db40cf720 2023-12-04T10:45:26.281 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.279+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2db415f040 con 0x7f2db40cf720 2023-12-04T10:45:26.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.281+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2db4068710 con 0x7f2db40cf720 2023-12-04T10:45:26.282 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.282+0000 7f2dab7fe640 1 -- 172.21.15.63:0/2930920083 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2d9c013470 con 0x7f2db40cf720 2023-12-04T10:45:26.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.283+0000 7f2dab7fe640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2d9406ae40 0x7f2d9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.283+0000 7f2dab7fe640 1 -- 172.21.15.63:0/2930920083 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f2d9c089740 con 0x7f2db40cf720 2023-12-04T10:45:26.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.283+0000 7f2db2ffd640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2d9406ae40 0x7f2d9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.285 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.284+0000 7f2db2ffd640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2d9406ae40 0x7f2d9406d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2da40012e0 tx=0x7f2da4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:26.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.288+0000 7f2dab7fe640 1 -- 172.21.15.63:0/2930920083 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d9c054970 con 0x7f2db40cf720 2023-12-04T10:45:26.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.552+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f2db40b2b60 con 0x7f2db40cf720 2023-12-04T10:45:26.553 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.553+0000 7f2dab7fe640 1 -- 172.21.15.63:0/2930920083 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f2d9c017090 con 0x7f2db40cf720 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: "auth_dump": [ 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.a", 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAorW1l0/hjOBAAZVCYxhAOVyKvxuFIBoMadA==", 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2023-12-04T10:45:26.554 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.b", 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAprW1lKrn8IhAAdm23ZoeS4t+aRKAzl4yt2w==", 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.555 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.c", 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAprW1lE7BPDxAAwzk357acyu62cvXhBbmthw==", 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.556 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mds.d", 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAprW1lyLtSNhAAw4tOdyahGZO4Rdf0Fzx2rg==", 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.0", 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAvrW1lcj2zBxAA4CuX9XQl1PFtrXK/Z+x8UQ==", 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2023-12-04T10:45:26.557 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.1", 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAyrW1lf8KvFBAAuB8QtCDBQfY896UIBobE3w==", 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.2", 2023-12-04T10:45:26.558 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQA1rW1l5xXXLRAAyRUEiNy1sjeEcVB40a3yoQ==", 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.3", 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQA5rW1lKk4PDRAAGJs+yweykmUM7r8gKUEjpQ==", 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.559 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.4", 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBArW1l3rT0JRAAjHFG2T5wImLNsnsJcc8GNA==", 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.5", 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBErW1lDvSWBxAACsL0tFOqEdyLOFpfIuF51A==", 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.560 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.6", 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBHrW1lwDqeIRAAtamHkDpHpEQV0syCbElRKw==", 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.561 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.562 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "osd.7", 2023-12-04T10:45:26.562 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBLrW1lGONZARAAmS8KrbH+AcydbHpmklECqw==", 2023-12-04T10:45:26.562 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.562 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow profile osd", 2023-12-04T10:45:26.562 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile osd", 2023-12-04T10:45:26.562 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.562 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.0", 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAqrW1lNHPvCRAAl2gnyDEti4/W/gQul97nNg==", 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.563 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.1", 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAqrW1lqtzxIhAAfJCX0+lgsQGnwbdljItHrQ==", 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.2", 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAqrW1lN8ZwFhAAnTCU+8ziHvtvXFfshAB9Ng==", 2023-12-04T10:45:26.564 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.3", 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAqrW1ltptgMBAAw8YyznNmZQ+7hqA2g1dL4g==", 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow", 2023-12-04T10:45:26.565 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow r", 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow rw", 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow rwx" 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.admin", 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA==", 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "mgr": "allow *", 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow *", 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.566 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mds", 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBUrW1lTolYNxAAYLwdEhJdhGU7Y3cZgIi2Zg==", 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mds" 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-mgr", 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBUrW1lR6dYNxAAsr7eDsHczYHeaxdeN0gFOA==", 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.567 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-osd", 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBUrW1l1sBYNxAA5m3N3I4vcIawE7jAU9Pv9g==", 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-osd" 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd", 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBUrW1l1tlYNxAADkDyaQjHAqH4VixW5DuRnA==", 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.568 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBUrW1lhPNYNxAAommzuacjC6yCtCSwTCARpA==", 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "client.bootstrap-rgw", 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQBUrW1l/A1ZNxAABjeCT06qoZjAEc7dRr6QVA==", 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.569 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.x", 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAorW1lXB9eKxAAEtNOCYtzp0dzfiqZ/kcqew==", 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: }, 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "entity": "mgr.y", 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "key": "AQAorW1lR0+yHBAAH2jKm94fo9r+yJdLSEs8EQ==", 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "caps": { 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "mds": "allow *", 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "mon": "allow profile mgr", 2023-12-04T10:45:26.570 INFO:teuthology.orchestra.run.smithi063.stdout: "osd": "allow *" 2023-12-04T10:45:26.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.571 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:26.571 INFO:teuthology.orchestra.run.smithi063.stdout: ] 2023-12-04T10:45:26.571 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-04T10:45:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.555+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2d9406ae40 msgr2=0x7f2d9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.555+0000 7f2db973c640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2d9406ae40 0x7f2d9406d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2da40012e0 tx=0x7f2da4009040 comp rx=0 tx=0).stop 2023-12-04T10:45:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.555+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2db40cf720 msgr2=0x7f2db41532b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.555+0000 7f2db973c640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2db40cf720 0x7f2db41532b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c00e9b0 tx=0x7f2d9c00ee70 comp rx=0 tx=0).stop 2023-12-04T10:45:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.556+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 shutdown_connections 2023-12-04T10:45:26.572 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.556+0000 7f2db973c640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2d9406ae40 0x7f2d9406d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.556+0000 7f2db973c640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2db415d260 0x7f2db41537f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.556+0000 7f2db973c640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2db40cf720 0x7f2db41532b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.556+0000 7f2db973c640 1 --2- 172.21.15.63:0/2930920083 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2db40b1dc0 0x7f2db4146ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.556+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 >> 172.21.15.63:0/2930920083 conn(0x7f2db406a840 msgr2=0x7f2db40b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.556+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 shutdown_connections 2023-12-04T10:45:26.573 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.556+0000 7f2db973c640 1 -- 172.21.15.63:0/2930920083 wait complete. 2023-12-04T10:45:26.576 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-04T10:45:26.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.803+0000 7f55dffff640 1 Processor -- start 2023-12-04T10:45:26.804 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.803+0000 7f55dffff640 1 -- start start 2023-12-04T10:45:26.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.805+0000 7f55dffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0142c70 0x7f55e0070090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.805+0000 7f55dffff640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e00b1f00 con 0x7f55e00b2390 2023-12-04T10:45:26.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.805+0000 7f55dffff640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55e00b1c00 con 0x7f55e0143280 2023-12-04T10:45:26.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.805+0000 7f55dffff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0143a70 con 0x7f55e0142c70 2023-12-04T10:45:26.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.805+0000 7f55df7fe640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f55e00b2390 0x7f55e00b2820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43636/0 (socket says 172.21.15.63:43636) 2023-12-04T10:45:26.806 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.805+0000 7f55df7fe640 1 -- 172.21.15.63:0/3250433317 learned_addr learned my addr 172.21.15.63:0/3250433317 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:26.808 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55deffd640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0142c70 0x7f55e0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149764983 0 0) 0x7f55e00b1f00 con 0x7f55e00b2390 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55cc003520 con 0x7f55e00b2390 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 684274998 0 0) 0x7f55cc003520 con 0x7f55e00b2390 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0142c70 msgr2=0x7f55e0070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0142c70 0x7f55e0070090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 >> v1:172.21.15.66:6789/0 conn(0x7f55e0143280 legacy=0x7f55e00705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0143050 con 0x7f55e00b2390 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f55d8001670 con 0x7f55e00b2390 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 >> v1:172.21.15.63:6789/0 conn(0x7f55e00b2390 legacy=0x7f55e00b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc0039a0 0x7f55cc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0142c70 0x7f55cc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55cc004d00 0x7f55cc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e0143a70 con 0x7f55cc004d00 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc00bb10 con 0x7f55cc0039a0 2023-12-04T10:45:26.809 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.806+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55cc00bcd0 con 0x7f55e0142c70 2023-12-04T10:45:26.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.807+0000 7f55df7fe640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55cc004d00 0x7f55cc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.807+0000 7f55de7fc640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0142c70 0x7f55cc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.807+0000 7f55df7fe640 1 -- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0142c70 msgr2=0x7f55cc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:26.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.807+0000 7f55deffd640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc0039a0 0x7f55cc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.807+0000 7f55df7fe640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0142c70 0x7f55cc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.807+0000 7f55df7fe640 1 -- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc0039a0 msgr2=0x7f55cc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:26.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.807+0000 7f55df7fe640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc0039a0 0x7f55cc003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.810 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.807+0000 7f55df7fe640 1 -- 172.21.15.63:0/3250433317 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc003520 con 0x7f55cc004d00 2023-12-04T10:45:26.811 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.808+0000 7f55df7fe640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55cc004d00 0x7f55cc005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f55d8007c00 tx=0x7f55cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b331cbbec7aa6736 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.808+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d802ec20 con 0x7f55cc004d00 2023-12-04T10:45:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d802ed80 con 0x7f55cc004d00 2023-12-04T10:45:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55ddffb640 1 -- 172.21.15.63:0/3250433317 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d8005b10 con 0x7f55cc004d00 2023-12-04T10:45:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55dffff640 1 -- 172.21.15.63:0/3250433317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55cc004d00 msgr2=0x7f55cc005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55dffff640 1 --2- 172.21.15.63:0/3250433317 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55cc004d00 0x7f55cc005180 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f55d8007c00 tx=0x7f55cc0057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.812 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55df7fe640 1 -- 172.21.15.63:0/3250433317 reap_dead start 2023-12-04T10:45:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55dffff640 1 -- 172.21.15.63:0/3250433317 shutdown_connections 2023-12-04T10:45:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55dffff640 1 -- 172.21.15.63:0/3250433317 >> 172.21.15.63:0/3250433317 conn(0x7f55e00b0860 msgr2=0x7f55e00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55dffff640 1 -- 172.21.15.63:0/3250433317 shutdown_connections 2023-12-04T10:45:26.813 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.809+0000 7f55dffff640 1 -- 172.21.15.63:0/3250433317 wait complete. 2023-12-04T10:45:26.817 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.811+0000 7f55dffff640 1 Processor -- start 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.811+0000 7f55dffff640 1 -- start start 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.812+0000 7f55dffff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc004d00 0x7f55e013cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.812+0000 7f55dffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e01f2fb0 0x7f55e01f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.812+0000 7f55dffff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0140c60 0x7f55e0141110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.812+0000 7f55dffff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e013d2e0 con 0x7f55e01f2fb0 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.812+0000 7f55dffff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55e013fbc0 con 0x7f55cc004d00 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.812+0000 7f55dffff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55e013fea0 con 0x7f55e0140c60 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e01f2fb0 0x7f55e01f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e01f2fb0 0x7f55e01f3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40038/0 (socket says 172.21.15.63:40038) 2023-12-04T10:45:26.818 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 -- 172.21.15.63:0/198131107 learned_addr learned my addr 172.21.15.63:0/198131107 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55deffd640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc004d00 0x7f55e013cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55df7fe640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0140c60 0x7f55e0141110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 -- 172.21.15.63:0/198131107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0140c60 msgr2=0x7f55e0141110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0140c60 0x7f55e0141110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 -- 172.21.15.63:0/198131107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc004d00 msgr2=0x7f55e013cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc004d00 0x7f55e013cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 -- 172.21.15.63:0/198131107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e0140180 con 0x7f55e01f2fb0 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.813+0000 7f55de7fc640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e01f2fb0 0x7f55e01f3430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55c800e550 tx=0x7f55c800ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.814+0000 7f55d7fff640 1 -- 172.21.15.63:0/198131107 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c80052e0 con 0x7f55e01f2fb0 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.814+0000 7f55d7fff640 1 -- 172.21.15.63:0/198131107 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55c8005440 con 0x7f55e01f2fb0 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.814+0000 7f55d7fff640 1 -- 172.21.15.63:0/198131107 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55c8003810 con 0x7f55e01f2fb0 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.814+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55e0140460 con 0x7f55e01f2fb0 2023-12-04T10:45:26.819 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.814+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55e0141760 con 0x7f55e01f2fb0 2023-12-04T10:45:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.815+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55e0071d50 con 0x7f55e01f2fb0 2023-12-04T10:45:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.816+0000 7f55d7fff640 1 -- 172.21.15.63:0/198131107 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f55c8003970 con 0x7f55e01f2fb0 2023-12-04T10:45:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.817+0000 7f55d7fff640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f55c006aec0 0x7f55c006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.817+0000 7f55d7fff640 1 -- 172.21.15.63:0/198131107 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f55c8089100 con 0x7f55e01f2fb0 2023-12-04T10:45:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.817+0000 7f55deffd640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f55c006aec0 0x7f55c006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:26.821 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.818+0000 7f55deffd640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f55c006aec0 0x7f55c006d380 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f55e01e35f0 tx=0x7f55d000b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:26.822 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:26.821+0000 7f55d7fff640 1 -- 172.21.15.63:0/198131107 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f55c80543a0 con 0x7f55e01f2fb0 2023-12-04T10:45:27.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.090+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f55e006dba0 con 0x7f55e01f2fb0 2023-12-04T10:45:27.097 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.096+0000 7f55d7fff640 1 -- 172.21.15.63:0/198131107 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f55e006dba0 con 0x7f55e01f2fb0 2023-12-04T10:45:27.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f55c006aec0 msgr2=0x7f55c006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f55c006aec0 0x7f55c006d380 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f55e01e35f0 tx=0x7f55d000b040 comp rx=0 tx=0).stop 2023-12-04T10:45:27.101 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e01f2fb0 msgr2=0x7f55e01f3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e01f2fb0 0x7f55e01f3430 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f55c800e550 tx=0x7f55c800ea10 comp rx=0 tx=0).stop 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 shutdown_connections 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f55c006aec0 0x7f55c006d380 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f55e0140c60 0x7f55e0141110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f55e01f2fb0 0x7f55e01f3430 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 --2- 172.21.15.63:0/198131107 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f55cc004d00 0x7f55e013cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 >> 172.21.15.63:0/198131107 conn(0x7f55e00b0860 msgr2=0x7f55e00aeab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 shutdown_connections 2023-12-04T10:45:27.102 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.100+0000 7f55dffff640 1 -- 172.21.15.63:0/198131107 wait complete. 2023-12-04T10:45:27.119 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-04T10:45:27.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.348+0000 7fd74e0d7640 1 Processor -- start 2023-12-04T10:45:27.349 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.348+0000 7fd74e0d7640 1 -- start start 2023-12-04T10:45:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.349+0000 7fd74e0d7640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd748144940 0x7fd748071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.350+0000 7fd74e0d7640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd74806be10 con 0x7fd74815bb80 2023-12-04T10:45:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.350+0000 7fd74e0d7640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd748070d40 con 0x7fd748070560 2023-12-04T10:45:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.350+0000 7fd74e0d7640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd748071020 con 0x7fd748144940 2023-12-04T10:45:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.350+0000 7fd74d8d6640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd74815bb80 0x7fd7480cd970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43648/0 (socket says 172.21.15.63:43648) 2023-12-04T10:45:27.351 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.350+0000 7fd74d8d6640 1 -- 172.21.15.63:0/3922501773 learned_addr learned my addr 172.21.15.63:0/3922501773 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4255070275 0 0) 0x7fd74806be10 con 0x7fd74815bb80 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd74d0d5640 1 --2- 172.21.15.63:0/3922501773 >> v2:172.21.15.66:3300/0 conn(0x7fd748144940 0x7fd748071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd734003520 con 0x7fd74815bb80 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427739347 0 0) 0x7fd734003520 con 0x7fd74815bb80 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 >> v2:172.21.15.66:3300/0 conn(0x7fd748144940 msgr2=0x7fd748071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 --2- 172.21.15.63:0/3922501773 >> v2:172.21.15.66:3300/0 conn(0x7fd748144940 0x7fd748071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 >> v1:172.21.15.66:6789/0 conn(0x7fd748070560 legacy=0x7fd74815b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd748071300 con 0x7fd74815bb80 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fd7400019f0 con 0x7fd74815bb80 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 >> v1:172.21.15.63:6789/0 conn(0x7fd74815bb80 legacy=0x7fd7480cd970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd734003970 0x7fd734003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7340047c0 0x7fd734004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.356 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd73400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748071020 con 0x7fd734005180 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd73400c0d0 con 0x7fd734003970 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd73400c290 con 0x7fd7340047c0 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.351+0000 7fd74d8d6640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd73400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.352+0000 7fd74c8d4640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7340047c0 0x7fd734004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.352+0000 7fd74d8d6640 1 -- 172.21.15.63:0/3922501773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7340047c0 msgr2=0x7fd734004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.352+0000 7fd74d8d6640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7340047c0 0x7fd734004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.352+0000 7fd74d8d6640 1 -- 172.21.15.63:0/3922501773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd734003970 msgr2=0x7fd734003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.352+0000 7fd74d8d6640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd734003970 0x7fd734003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.357 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.352+0000 7fd74d8d6640 1 -- 172.21.15.63:0/3922501773 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd734003520 con 0x7fd734005180 2023-12-04T10:45:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.352+0000 7fd74c8d4640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7340047c0 0x7fd734004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.353+0000 7fd74d8d6640 1 -- 172.21.15.63:0/3922501773 reap_dead start 2023-12-04T10:45:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.353+0000 7fd74d8d6640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd73400b980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd74000a830 tx=0x7fd7340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=381887c944941996 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.353+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7400072d0 con 0x7fd734005180 2023-12-04T10:45:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.353+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74002f070 con 0x7fd734005180 2023-12-04T10:45:27.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.353+0000 7fd73ffff640 1 -- 172.21.15.63:0/3922501773 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd740007690 con 0x7fd734005180 2023-12-04T10:45:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.354+0000 7fd74e0d7640 1 -- 172.21.15.63:0/3922501773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 msgr2=0x7fd73400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.354+0000 7fd74e0d7640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd73400b980 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd74000a830 tx=0x7fd7340057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.354+0000 7fd74e0d7640 1 -- 172.21.15.63:0/3922501773 shutdown_connections 2023-12-04T10:45:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.354+0000 7fd74e0d7640 1 --2- 172.21.15.63:0/3922501773 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd73400b980 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.354+0000 7fd74e0d7640 1 -- 172.21.15.63:0/3922501773 >> 172.21.15.63:0/3922501773 conn(0x7fd7480b0860 msgr2=0x7fd7480b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.354+0000 7fd74e0d7640 1 -- 172.21.15.63:0/3922501773 shutdown_connections 2023-12-04T10:45:27.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.354+0000 7fd74e0d7640 1 -- 172.21.15.63:0/3922501773 wait complete. 2023-12-04T10:45:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.356+0000 7fd74e0d7640 1 Processor -- start 2023-12-04T10:45:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.356+0000 7fd74e0d7640 1 -- start start 2023-12-04T10:45:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74e0d7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd7480ad860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74e0d7640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7481429d0 0x7fd748150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74e0d7640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7481413e0 0x7fd748150640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74e0d7640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748141930 con 0x7fd734005180 2023-12-04T10:45:27.363 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74e0d7640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd748141c10 con 0x7fd7481429d0 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74e0d7640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd748141ef0 con 0x7fd7481413e0 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74d0d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd7480ad860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74d0d5640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd7480ad860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40046/0 (socket says 172.21.15.63:40046) 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.357+0000 7fd74d0d5640 1 -- 172.21.15.63:0/1426303360 learned_addr learned my addr 172.21.15.63:0/1426303360 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd74d0d5640 1 -- 172.21.15.63:0/1426303360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7481413e0 msgr2=0x7fd748150640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd74d0d5640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7481413e0 0x7fd748150640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd74d0d5640 1 -- 172.21.15.63:0/1426303360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7481429d0 msgr2=0x7fd748150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd74d0d5640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7481429d0 0x7fd748150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd74d0d5640 1 -- 172.21.15.63:0/1426303360 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7481421d0 con 0x7fd734005180 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd74d0d5640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd7480ad860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd74400d800 tx=0x7fd74400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:27.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd73dffb640 1 -- 172.21.15.63:0/1426303360 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74400b6c0 con 0x7fd734005180 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd73dffb640 1 -- 172.21.15.63:0/1426303360 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd74400b840 con 0x7fd734005180 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd73dffb640 1 -- 172.21.15.63:0/1426303360 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd74400bbf0 con 0x7fd734005180 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.358+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7481424b0 con 0x7fd734005180 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.359+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd748152c40 con 0x7fd734005180 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.360+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7480af4b0 con 0x7fd734005180 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.361+0000 7fd73dffb640 1 -- 172.21.15.63:0/1426303360 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd74400bd50 con 0x7fd734005180 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.361+0000 7fd73dffb640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd72c06aec0 0x7fd72c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.362+0000 7fd73dffb640 1 -- 172.21.15.63:0/1426303360 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fd744089680 con 0x7fd734005180 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.362+0000 7fd74c8d4640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd72c06aec0 0x7fd72c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.363+0000 7fd74c8d4640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd72c06aec0 0x7fd72c06d380 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd738000f60 tx=0x7fd738009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:27.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.366+0000 7fd73dffb640 1 -- 172.21.15.63:0/1426303360 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd744054ab0 con 0x7fd734005180 2023-12-04T10:45:27.630 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.629+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd7480cc6e0 con 0x7fd734005180 2023-12-04T10:45:27.635 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.634+0000 7fd73dffb640 1 -- 172.21.15.63:0/1426303360 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd7440580d0 con 0x7fd734005180 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd72c06aec0 msgr2=0x7fd72c06d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd72c06aec0 0x7fd72c06d380 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd738000f60 tx=0x7fd738009040 comp rx=0 tx=0).stop 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 msgr2=0x7fd7480ad860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd7480ad860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fd74400d800 tx=0x7fd74400dcc0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 shutdown_connections 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd72c06aec0 0x7fd72c06d380 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7481413e0 0x7fd748150640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7481429d0 0x7fd748150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 --2- 172.21.15.63:0/1426303360 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd734005180 0x7fd7480ad860 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.638 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.636+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 >> 172.21.15.63:0/1426303360 conn(0x7fd7480b0860 msgr2=0x7fd7480aeda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.637+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 shutdown_connections 2023-12-04T10:45:27.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.637+0000 7fd74e0d7640 1 -- 172.21.15.63:0/1426303360 wait complete. 2023-12-04T10:45:27.656 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-04T10:45:27.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.878+0000 7ff873ffb640 1 Processor -- start 2023-12-04T10:45:27.879 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.878+0000 7ff873ffb640 1 -- start start 2023-12-04T10:45:27.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff873ffb640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff86c140210 0x7ff86c1405f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff873ffb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 0x7ff86c0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff873ffb640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff86c0cfc20 con 0x7ff86c0cf7d0 2023-12-04T10:45:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff873ffb640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff86c0ce800 con 0x7ff86c140210 2023-12-04T10:45:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff873ffb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c140b30 con 0x7ff86c141180 2023-12-04T10:45:27.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff871d97640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff86c140210 0x7ff86c1405f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff871d97640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff86c140210 0x7ff86c1405f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40060/0 (socket says 172.21.15.63:40060) 2023-12-04T10:45:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff871d97640 1 -- 172.21.15.63:0/2641023671 learned_addr learned my addr 172.21.15.63:0/2641023671 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff871d97640 1 -- 172.21.15.63:0/2641023671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 msgr2=0x7ff86c0cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff871d97640 1 --2- 172.21.15.63:0/2641023671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 0x7ff86c0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff871d97640 1 -- 172.21.15.63:0/2641023671 >> v1:172.21.15.66:6789/0 conn(0x7ff86c0cf7d0 legacy=0x7ff86c06c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.880+0000 7ff871d97640 1 -- 172.21.15.63:0/2641023671 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff86c0cd8e0 con 0x7ff86c140210 2023-12-04T10:45:27.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.882+0000 7ff871d97640 1 --2- 172.21.15.63:0/2641023671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c1405f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff868009870 tx=0x7ff86802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6adf50c52c68e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:27.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.882+0000 7ff870d95640 1 -- 172.21.15.63:0/2641023671 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868031640 con 0x7ff86c140210 2023-12-04T10:45:27.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.882+0000 7ff870d95640 1 -- 172.21.15.63:0/2641023671 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8680317a0 con 0x7ff86c140210 2023-12-04T10:45:27.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.882+0000 7ff870d95640 1 -- 172.21.15.63:0/2641023671 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868031b30 con 0x7ff86c140210 2023-12-04T10:45:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.883+0000 7ff873ffb640 1 -- 172.21.15.63:0/2641023671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 msgr2=0x7ff86c1405f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.883+0000 7ff873ffb640 1 --2- 172.21.15.63:0/2641023671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c1405f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7ff868009870 tx=0x7ff86802b8f0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.883+0000 7ff873ffb640 1 -- 172.21.15.63:0/2641023671 shutdown_connections 2023-12-04T10:45:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.883+0000 7ff873ffb640 1 --2- 172.21.15.63:0/2641023671 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 0x7ff86c0cf290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.883+0000 7ff873ffb640 1 --2- 172.21.15.63:0/2641023671 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c1405f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.883+0000 7ff873ffb640 1 -- 172.21.15.63:0/2641023671 >> 172.21.15.63:0/2641023671 conn(0x7ff86c06a8a0 msgr2=0x7ff86c06acb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.883+0000 7ff873ffb640 1 -- 172.21.15.63:0/2641023671 shutdown_connections 2023-12-04T10:45:27.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.883+0000 7ff873ffb640 1 -- 172.21.15.63:0/2641023671 wait complete. 2023-12-04T10:45:27.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.885+0000 7ff873ffb640 1 Processor -- start 2023-12-04T10:45:27.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.885+0000 7ff873ffb640 1 -- start start 2023-12-04T10:45:27.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff873ffb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff86c0cf7d0 0x7ff86c155020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff873ffb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff873ffb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 0x7ff86c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff873ffb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0ad8e0 con 0x7ff86c140210 2023-12-04T10:45:27.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff873ffb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0b2d80 con 0x7ff86c0cf7d0 2023-12-04T10:45:27.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff873ffb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0b3060 con 0x7ff86c141180 2023-12-04T10:45:27.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff871596640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.887 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff871596640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c0af6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40064/0 (socket says 172.21.15.63:40064) 2023-12-04T10:45:27.888 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.886+0000 7ff871596640 1 -- 172.21.15.63:0/1882651240 learned_addr learned my addr 172.21.15.63:0/1882651240 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:27.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff872598640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 0x7ff86c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff871596640 1 -- 172.21.15.63:0/1882651240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 msgr2=0x7ff86c0afc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff871596640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 0x7ff86c0afc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff871596640 1 -- 172.21.15.63:0/1882651240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff86c0cf7d0 msgr2=0x7ff86c155020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff871d97640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff86c0cf7d0 0x7ff86c155020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff871596640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff86c0cf7d0 0x7ff86c155020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff871596640 1 -- 172.21.15.63:0/1882651240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680094d0 con 0x7ff86c140210 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff871596640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c0af6e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00b4a0 tx=0x7ff85c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.887+0000 7ff8627fc640 1 -- 172.21.15.63:0/1882651240 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c010610 con 0x7ff86c140210 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.888+0000 7ff8627fc640 1 -- 172.21.15.63:0/1882651240 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff85c010770 con 0x7ff86c140210 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.888+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c0b3340 con 0x7ff86c140210 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.888+0000 7ff8627fc640 1 -- 172.21.15.63:0/1882651240 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85c010b20 con 0x7ff86c140210 2023-12-04T10:45:27.890 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.888+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c155560 con 0x7ff86c140210 2023-12-04T10:45:27.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.889+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c0ada20 con 0x7ff86c140210 2023-12-04T10:45:27.891 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.890+0000 7ff8627fc640 1 -- 172.21.15.63:0/1882651240 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff85c010c80 con 0x7ff86c140210 2023-12-04T10:45:27.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.891+0000 7ff8627fc640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff85006ae40 0x7ff85006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:27.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.891+0000 7ff8627fc640 1 -- 172.21.15.63:0/1882651240 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff85c0890a0 con 0x7ff86c140210 2023-12-04T10:45:27.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.891+0000 7ff871d97640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff85006ae40 0x7ff85006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:27.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.892+0000 7ff871d97640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff85006ae40 0x7ff85006d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff868036000 tx=0x7ff86803c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:27.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:27.896+0000 7ff8627fc640 1 -- 172.21.15.63:0/1882651240 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff86c0ada20 con 0x7ff86c140210 2023-12-04T10:45:28.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.166+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7ff86c0ada20 con 0x7ff86c140210 2023-12-04T10:45:28.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.171+0000 7ff8627fc640 1 -- 172.21.15.63:0/1882651240 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7ff86c0ada20 con 0x7ff86c140210 2023-12-04T10:45:28.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.174+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff85006ae40 msgr2=0x7ff85006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.174+0000 7ff873ffb640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff85006ae40 0x7ff85006d300 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff868036000 tx=0x7ff86803c040 comp rx=0 tx=0).stop 2023-12-04T10:45:28.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.174+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 msgr2=0x7ff86c0af6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c0af6e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00b4a0 tx=0x7ff85c00b960 comp rx=0 tx=0).stop 2023-12-04T10:45:28.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 shutdown_connections 2023-12-04T10:45:28.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff85006ae40 0x7ff85006d300 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff86c141180 0x7ff86c0afc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff86c140210 0x7ff86c0af6e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 --2- 172.21.15.63:0/1882651240 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff86c0cf7d0 0x7ff86c155020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 >> 172.21.15.63:0/1882651240 conn(0x7ff86c06a8a0 msgr2=0x7ff86c15b730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:28.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 shutdown_connections 2023-12-04T10:45:28.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.175+0000 7ff873ffb640 1 -- 172.21.15.63:0/1882651240 wait complete. 2023-12-04T10:45:28.197 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-04T10:45:28.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.427+0000 7f355090c640 1 Processor -- start 2023-12-04T10:45:28.428 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.427+0000 7f355090c640 1 -- start start 2023-12-04T10:45:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.429+0000 7f355090c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c143280 0x7f354c0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.429+0000 7f355090c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f354c0b2390 0x7f354c0b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.429+0000 7f355090c640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c0b1f00 con 0x7f354c142c70 2023-12-04T10:45:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.429+0000 7f355090c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354c0b1c00 con 0x7f354c0b2390 2023-12-04T10:45:28.430 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.429+0000 7f355090c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c143a70 con 0x7f354c143280 2023-12-04T10:45:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.430+0000 7f3543fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c143280 0x7f354c0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.430+0000 7f3543fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c143280 0x7f354c0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:43910/0 (socket says 172.21.15.63:43910) 2023-12-04T10:45:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.430+0000 7f3543fff640 1 -- 172.21.15.63:0/3185012302 learned_addr learned my addr 172.21.15.63:0/3185012302 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:28.431 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.430+0000 7f354bfff640 1 --2- 172.21.15.63:0/3185012302 >> v2:172.21.15.66:3300/0 conn(0x7f354c0b2390 0x7f354c0b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.431+0000 7f3543fff640 1 -- 172.21.15.63:0/3185012302 >> v2:172.21.15.66:3300/0 conn(0x7f354c0b2390 msgr2=0x7f354c0b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.431+0000 7f3543fff640 1 --2- 172.21.15.63:0/3185012302 >> v2:172.21.15.66:3300/0 conn(0x7f354c0b2390 0x7f354c0b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.431+0000 7f3543fff640 1 -- 172.21.15.63:0/3185012302 >> v1:172.21.15.66:6789/0 conn(0x7f354c142c70 legacy=0x7f354c070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.432 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.431+0000 7f3543fff640 1 -- 172.21.15.63:0/3185012302 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c143050 con 0x7f354c143280 2023-12-04T10:45:28.433 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.432+0000 7f3543fff640 1 --2- 172.21.15.63:0/3185012302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c143280 0x7f354c0707a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3534009870 tx=0x7f353402b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6ccb6e6d8c88098 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.433+0000 7f354affd640 1 -- 172.21.15.63:0/3185012302 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534031640 con 0x7f354c143280 2023-12-04T10:45:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.433+0000 7f354affd640 1 -- 172.21.15.63:0/3185012302 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35340317a0 con 0x7f354c143280 2023-12-04T10:45:28.434 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.433+0000 7f354affd640 1 -- 172.21.15.63:0/3185012302 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534031b30 con 0x7f354c143280 2023-12-04T10:45:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.433+0000 7f355090c640 1 -- 172.21.15.63:0/3185012302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c143280 msgr2=0x7f354c0707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.433+0000 7f355090c640 1 --2- 172.21.15.63:0/3185012302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c143280 0x7f354c0707a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3534009870 tx=0x7f353402b8f0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.433+0000 7f355090c640 1 -- 172.21.15.63:0/3185012302 shutdown_connections 2023-12-04T10:45:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.434+0000 7f355090c640 1 --2- 172.21.15.63:0/3185012302 >> v2:172.21.15.66:3300/0 conn(0x7f354c0b2390 0x7f354c0b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.434+0000 7f355090c640 1 --2- 172.21.15.63:0/3185012302 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c143280 0x7f354c0707a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.434+0000 7f355090c640 1 -- 172.21.15.63:0/3185012302 >> 172.21.15.63:0/3185012302 conn(0x7f354c0b0860 msgr2=0x7f354c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.434+0000 7f355090c640 1 -- 172.21.15.63:0/3185012302 shutdown_connections 2023-12-04T10:45:28.435 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.434+0000 7f355090c640 1 -- 172.21.15.63:0/3185012302 wait complete. 2023-12-04T10:45:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.435+0000 7f355090c640 1 Processor -- start 2023-12-04T10:45:28.436 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.436+0000 7f355090c640 1 -- start start 2023-12-04T10:45:28.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f355090c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c0b2390 0x7f354c13cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f355090c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f354c142c70 0x7f354c0cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f355090c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354c143280 0x7f354c0a8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.438 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f355090c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0ced30 con 0x7f354c142c70 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f355090c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0ce770 con 0x7f354c143280 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f355090c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0cea50 con 0x7f354c0b2390 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f3543fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f354c142c70 0x7f354c0cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f3543fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f354c142c70 0x7f354c0cdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40074/0 (socket says 172.21.15.63:40074) 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f3543fff640 1 -- 172.21.15.63:0/2917608258 learned_addr learned my addr 172.21.15.63:0/2917608258 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f3543fff640 1 -- 172.21.15.63:0/2917608258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c0b2390 msgr2=0x7f354c13cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f3543fff640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c0b2390 0x7f354c13cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f3543fff640 1 -- 172.21.15.63:0/2917608258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354c143280 msgr2=0x7f354c0a8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f3543fff640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354c143280 0x7f354c0a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.439 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.437+0000 7f3543fff640 1 -- 172.21.15.63:0/2917608258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35340094d0 con 0x7f354c142c70 2023-12-04T10:45:28.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.438+0000 7f3543fff640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f354c142c70 0x7f354c0cdd90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f353402b930 tx=0x7f35340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:28.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.438+0000 7f3548ff9640 1 -- 172.21.15.63:0/2917608258 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f353403ac60 con 0x7f354c142c70 2023-12-04T10:45:28.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.438+0000 7f3548ff9640 1 -- 172.21.15.63:0/2917608258 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f353403ade0 con 0x7f354c142c70 2023-12-04T10:45:28.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.438+0000 7f3548ff9640 1 -- 172.21.15.63:0/2917608258 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3534044630 con 0x7f354c142c70 2023-12-04T10:45:28.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.438+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c0c8bc0 con 0x7f354c142c70 2023-12-04T10:45:28.440 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.438+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c13d470 con 0x7f354c142c70 2023-12-04T10:45:28.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.440+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c0c90e0 con 0x7f354c142c70 2023-12-04T10:45:28.441 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.440+0000 7f3548ff9640 1 -- 172.21.15.63:0/2917608258 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f353402f050 con 0x7f354c142c70 2023-12-04T10:45:28.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.441+0000 7f3548ff9640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f352c06ae40 0x7f352c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.442 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.441+0000 7f3548ff9640 1 -- 172.21.15.63:0/2917608258 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f35340ab2e0 con 0x7f354c142c70 2023-12-04T10:45:28.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.442+0000 7f354b7fe640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f352c06ae40 0x7f352c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.443 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.443+0000 7f354b7fe640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f352c06ae40 0x7f352c06d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f353c000f60 tx=0x7f353c0079b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:28.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.446+0000 7f3548ff9640 1 -- 172.21.15.63:0/2917608258 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f354c0c90e0 con 0x7f354c142c70 2023-12-04T10:45:28.707 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.706+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f354c0c90e0 con 0x7f354c142c70 2023-12-04T10:45:28.712 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.711+0000 7f3548ff9640 1 -- 172.21.15.63:0/2917608258 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f354c0c90e0 con 0x7f354c142c70 2023-12-04T10:45:28.714 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f352c06ae40 msgr2=0x7f352c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f352c06ae40 0x7f352c06d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f353c000f60 tx=0x7f353c0079b0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f354c142c70 msgr2=0x7f354c0cdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f354c142c70 0x7f354c0cdd90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f353402b930 tx=0x7f35340046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 shutdown_connections 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f352c06ae40 0x7f352c06d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f354c143280 0x7f354c0a8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f354c142c70 0x7f354c0cdd90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 --2- 172.21.15.63:0/2917608258 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f354c0b2390 0x7f354c13cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.713+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 >> 172.21.15.63:0/2917608258 conn(0x7f354c0b0860 msgr2=0x7f354c140e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.714+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 shutdown_connections 2023-12-04T10:45:28.715 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.714+0000 7f355090c640 1 -- 172.21.15.63:0/2917608258 wait complete. 2023-12-04T10:45:28.731 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-04T10:45:28.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.938+0000 7f77ce8ad640 1 Processor -- start 2023-12-04T10:45:28.939 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.938+0000 7f77ce8ad640 1 -- start start 2023-12-04T10:45:28.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.939+0000 7f77ce8ad640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f77c80cca00 0x7f77c8070e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.939+0000 7f77ce8ad640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f77c80c9b10 0x7f77c80c9f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.939+0000 7f77ce8ad640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c80ccfe0 con 0x7f77c80cb630 2023-12-04T10:45:28.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.939+0000 7f77ce8ad640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c80cd2c0 con 0x7f77c80c9b10 2023-12-04T10:45:28.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.939+0000 7f77ce8ad640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c80cd5a0 con 0x7f77c80cca00 2023-12-04T10:45:28.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77cd8ab640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f77c80cb630 0x7f77c80cba10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43660/0 (socket says 172.21.15.63:43660) 2023-12-04T10:45:28.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77cd8ab640 1 -- 172.21.15.63:0/1602286895 learned_addr learned my addr 172.21.15.63:0/1602286895 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:28.941 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77ce0ac640 1 --2- 172.21.15.63:0/1602286895 >> v2:172.21.15.63:3300/0 conn(0x7f77c80c9b10 0x7f77c80c9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77cd0aa640 1 --2- 172.21.15.63:0/1602286895 >> v2:172.21.15.66:3300/0 conn(0x7f77c80cca00 0x7f77c8070e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77cc8a9640 1 -- 172.21.15.63:0/1602286895 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292881042 0 0) 0x7f77c80ccfe0 con 0x7f77c80cb630 2023-12-04T10:45:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77ce0ac640 1 -- 172.21.15.63:0/1602286895 >> v2:172.21.15.66:3300/0 conn(0x7f77c80cca00 msgr2=0x7f77c8070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77ce0ac640 1 --2- 172.21.15.63:0/1602286895 >> v2:172.21.15.66:3300/0 conn(0x7f77c80cca00 0x7f77c8070e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77ce0ac640 1 -- 172.21.15.63:0/1602286895 >> v1:172.21.15.63:6789/0 conn(0x7f77c80cb630 legacy=0x7f77c80cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77ce0ac640 1 -- 172.21.15.63:0/1602286895 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c80c9310 con 0x7f77c80c9b10 2023-12-04T10:45:28.942 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.940+0000 7f77cd0aa640 1 --2- 172.21.15.63:0/1602286895 >> v2:172.21.15.66:3300/0 conn(0x7f77c80cca00 0x7f77c8070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.941+0000 7f77ce0ac640 1 --2- 172.21.15.63:0/1602286895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80c9b10 0x7f77c80c9f80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f77c80cc290 tx=0x7f77c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955593cbf56081b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77cc8a9640 1 -- 172.21.15.63:0/1602286895 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c002cc80 con 0x7f77c80c9b10 2023-12-04T10:45:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77cc8a9640 1 -- 172.21.15.63:0/1602286895 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77c002cde0 con 0x7f77c80c9b10 2023-12-04T10:45:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77cc8a9640 1 -- 172.21.15.63:0/1602286895 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77c0034660 con 0x7f77c80c9b10 2023-12-04T10:45:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77ce8ad640 1 -- 172.21.15.63:0/1602286895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80c9b10 msgr2=0x7f77c80c9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/1602286895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80c9b10 0x7f77c80c9f80 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f77c80cc290 tx=0x7f77c002bed0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.943 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77ce8ad640 1 -- 172.21.15.63:0/1602286895 shutdown_connections 2023-12-04T10:45:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/1602286895 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80c9b10 0x7f77c80c9f80 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/1602286895 >> v2:172.21.15.66:3300/0 conn(0x7f77c80cca00 0x7f77c8070e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77ce8ad640 1 -- 172.21.15.63:0/1602286895 >> 172.21.15.63:0/1602286895 conn(0x7f77c80b07f0 msgr2=0x7f77c80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77ce8ad640 1 -- 172.21.15.63:0/1602286895 shutdown_connections 2023-12-04T10:45:28.944 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.942+0000 7f77ce8ad640 1 -- 172.21.15.63:0/1602286895 wait complete. 2023-12-04T10:45:28.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.944+0000 7f77ce8ad640 1 Processor -- start 2023-12-04T10:45:28.945 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.944+0000 7f77ce8ad640 1 -- start start 2023-12-04T10:45:28.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77ce8ad640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c80c9b10 0x7f77c815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77ce8ad640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80cb630 0x7f77c814f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77ce8ad640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77c80cca00 0x7f77c80c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77ce8ad640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80c47e0 con 0x7f77c80cb630 2023-12-04T10:45:28.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77ce8ad640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80c5140 con 0x7f77c80c9b10 2023-12-04T10:45:28.946 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77ce8ad640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80aeed0 con 0x7f77c80cca00 2023-12-04T10:45:28.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77cd0aa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80cb630 0x7f77c814f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77cd0aa640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80cb630 0x7f77c814f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40092/0 (socket says 172.21.15.63:40092) 2023-12-04T10:45:28.947 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.945+0000 7f77cd0aa640 1 -- 172.21.15.63:0/501857978 learned_addr learned my addr 172.21.15.63:0/501857978 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.946+0000 7f77cd8ab640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c80c9b10 0x7f77c815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.946+0000 7f77cd0aa640 1 -- 172.21.15.63:0/501857978 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77c80cca00 msgr2=0x7f77c80c4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.946+0000 7f77cd0aa640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77c80cca00 0x7f77c80c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.946+0000 7f77cd0aa640 1 -- 172.21.15.63:0/501857978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c80c9b10 msgr2=0x7f77c815b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.946+0000 7f77cd0aa640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c80c9b10 0x7f77c815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.946+0000 7f77cd0aa640 1 -- 172.21.15.63:0/501857978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009a70 con 0x7f77c80cb630 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.946+0000 7f77cd0aa640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80cb630 0x7f77c814f1e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c7f0 tx=0x7f77b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.946+0000 7f77be7fc640 1 -- 172.21.15.63:0/501857978 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b80077c0 con 0x7f77c80cb630 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.947+0000 7f77be7fc640 1 -- 172.21.15.63:0/501857978 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b8007920 con 0x7f77c80cb630 2023-12-04T10:45:28.948 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.947+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c80c41b0 con 0x7f77c80cb630 2023-12-04T10:45:28.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.947+0000 7f77be7fc640 1 -- 172.21.15.63:0/501857978 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8007c90 con 0x7f77c80cb630 2023-12-04T10:45:28.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.947+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c80af400 con 0x7f77c80cb630 2023-12-04T10:45:28.949 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.948+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c80cb4a0 con 0x7f77c80cb630 2023-12-04T10:45:28.950 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.949+0000 7f77be7fc640 1 -- 172.21.15.63:0/501857978 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f77b80113f0 con 0x7f77c80cb630 2023-12-04T10:45:28.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.950+0000 7f77be7fc640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f77ac06ae40 0x7f77ac06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:28.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.951+0000 7f77be7fc640 1 -- 172.21.15.63:0/501857978 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f77b80895e0 con 0x7f77c80cb630 2023-12-04T10:45:28.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.951+0000 7f77cd8ab640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f77ac06ae40 0x7f77ac06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:28.952 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.951+0000 7f77cd8ab640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f77ac06ae40 0x7f77ac06d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000f60 tx=0x7f77c4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:28.956 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:28.955+0000 7f77be7fc640 1 -- 172.21.15.63:0/501857978 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f77b8054930 con 0x7f77c80cb630 2023-12-04T10:45:29.212 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.211+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f77c804e840 con 0x7f77c80cb630 2023-12-04T10:45:29.215 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.215+0000 7f77be7fc640 1 -- 172.21.15.63:0/501857978 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f77b8057f50 con 0x7f77c80cb630 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.217+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f77ac06ae40 msgr2=0x7f77ac06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f77ac06ae40 0x7f77ac06d300 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f77c4000f60 tx=0x7f77c4009040 comp rx=0 tx=0).stop 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80cb630 msgr2=0x7f77c814f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80cb630 0x7f77c814f1e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f77b800c7f0 tx=0x7f77b800ccb0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 shutdown_connections 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f77ac06ae40 0x7f77ac06d300 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f77c80cca00 0x7f77c80c4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f77c80cb630 0x7f77c814f1e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 --2- 172.21.15.63:0/501857978 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f77c80c9b10 0x7f77c815b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 >> 172.21.15.63:0/501857978 conn(0x7f77c80b07f0 msgr2=0x7f77c80ca880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 shutdown_connections 2023-12-04T10:45:29.219 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.218+0000 7f77ce8ad640 1 -- 172.21.15.63:0/501857978 wait complete. 2023-12-04T10:45:29.238 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-04T10:45:29.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.451+0000 7fb46359e640 1 Processor -- start 2023-12-04T10:45:29.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.451+0000 7fb46359e640 1 -- start start 2023-12-04T10:45:29.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.452+0000 7fb46359e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb464144940 0x7fb464071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.452+0000 7fb46359e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb46415bb80 0x7fb4640cd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.452+0000 7fb46359e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb46406be10 con 0x7fb464070560 2023-12-04T10:45:29.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.452+0000 7fb46359e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb464070d40 con 0x7fb46415bb80 2023-12-04T10:45:29.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.452+0000 7fb46359e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb464071020 con 0x7fb464144940 2023-12-04T10:45:29.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb462d9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb46415bb80 0x7fb4640cd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb462d9d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb46415bb80 0x7fb4640cd970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40096/0 (socket says 172.21.15.63:40096) 2023-12-04T10:45:29.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb462d9d640 1 -- 172.21.15.63:0/4224086641 learned_addr learned my addr 172.21.15.63:0/4224086641 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:29.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb46259c640 1 --2- 172.21.15.63:0/4224086641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb464144940 0x7fb464071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb462d9d640 1 -- 172.21.15.63:0/4224086641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb464144940 msgr2=0x7fb464071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:29.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb462d9d640 1 --2- 172.21.15.63:0/4224086641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb464144940 0x7fb464071fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb462d9d640 1 -- 172.21.15.63:0/4224086641 >> v1:172.21.15.63:6789/0 conn(0x7fb464070560 legacy=0x7fb46415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb462d9d640 1 -- 172.21.15.63:0/4224086641 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb464071300 con 0x7fb46415bb80 2023-12-04T10:45:29.455 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.453+0000 7fb461d9b640 1 -- 172.21.15.63:0/4224086641 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3758417906 0 0) 0x7fb46406be10 con 0x7fb464070560 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.454+0000 7fb462d9d640 1 --2- 172.21.15.63:0/4224086641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415bb80 0x7fb4640cd970 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009e50 tx=0x7fb45c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71fc1abcf4c1ad0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.455+0000 7fb461d9b640 1 -- 172.21.15.63:0/4224086641 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c02cb00 con 0x7fb46415bb80 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.455+0000 7fb461d9b640 1 -- 172.21.15.63:0/4224086641 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45c02cc60 con 0x7fb46415bb80 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.455+0000 7fb461d9b640 1 -- 172.21.15.63:0/4224086641 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0343f0 con 0x7fb46415bb80 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.455+0000 7fb46359e640 1 -- 172.21.15.63:0/4224086641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415bb80 msgr2=0x7fb4640cd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.455+0000 7fb46359e640 1 --2- 172.21.15.63:0/4224086641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415bb80 0x7fb4640cd970 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009e50 tx=0x7fb45c02bf60 comp rx=0 tx=0).stop 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.456+0000 7fb46359e640 1 -- 172.21.15.63:0/4224086641 shutdown_connections 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.456+0000 7fb46359e640 1 --2- 172.21.15.63:0/4224086641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb46415bb80 0x7fb4640cd970 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.456+0000 7fb46359e640 1 --2- 172.21.15.63:0/4224086641 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb464144940 0x7fb464071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.456+0000 7fb46359e640 1 -- 172.21.15.63:0/4224086641 >> 172.21.15.63:0/4224086641 conn(0x7fb4640b0860 msgr2=0x7fb4640b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:29.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.456+0000 7fb46359e640 1 -- 172.21.15.63:0/4224086641 shutdown_connections 2023-12-04T10:45:29.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.456+0000 7fb46359e640 1 -- 172.21.15.63:0/4224086641 wait complete. 2023-12-04T10:45:29.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.457+0000 7fb46359e640 1 Processor -- start 2023-12-04T10:45:29.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.457+0000 7fb46359e640 1 -- start start 2023-12-04T10:45:29.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.458+0000 7fb46359e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb464070560 0x7fb46413cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.458+0000 7fb46359e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb464144940 0x7fb46415a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb464070560 0x7fb46413cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46259c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb464070560 0x7fb46413cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40104/0 (socket says 172.21.15.63:40104) 2023-12-04T10:45:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46359e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb46415bb80 0x7fb4640af3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46359e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46413bf60 con 0x7fb464070560 2023-12-04T10:45:29.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb46413c1b0 con 0x7fb464144940 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46259c640 1 -- 172.21.15.63:0/2187127959 learned_addr learned my addr 172.21.15.63:0/2187127959 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb46413c490 con 0x7fb46415bb80 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb45bfff640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb464144940 0x7fb46415a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46259c640 1 -- 172.21.15.63:0/2187127959 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb46415bb80 msgr2=0x7fb4640af3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46259c640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb46415bb80 0x7fb4640af3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46259c640 1 -- 172.21.15.63:0/2187127959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb464144940 msgr2=0x7fb46415a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46259c640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb464144940 0x7fb46415a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb46259c640 1 -- 172.21.15.63:0/2187127959 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb45c009b30 con 0x7fb464070560 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.459+0000 7fb45bfff640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb464144940 0x7fb46415a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.460+0000 7fb46259c640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb464070560 0x7fb46413cf70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb45400d800 tx=0x7fb45400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:29.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.460+0000 7fb45affd640 1 -- 172.21.15.63:0/2187127959 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400b6c0 con 0x7fb464070560 2023-12-04T10:45:29.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.460+0000 7fb45affd640 1 -- 172.21.15.63:0/2187127959 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb45400b840 con 0x7fb464070560 2023-12-04T10:45:29.463 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.460+0000 7fb45affd640 1 -- 172.21.15.63:0/2187127959 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb45400bbf0 con 0x7fb464070560 2023-12-04T10:45:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.460+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb46413c770 con 0x7fb464070560 2023-12-04T10:45:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.460+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb46413d4b0 con 0x7fb464070560 2023-12-04T10:45:29.464 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.461+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb46413cc90 con 0x7fb464070560 2023-12-04T10:45:29.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.462+0000 7fb45affd640 1 -- 172.21.15.63:0/2187127959 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb45400bd50 con 0x7fb464070560 2023-12-04T10:45:29.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.463+0000 7fb45affd640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb44406ae40 0x7fb44406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.463+0000 7fb45affd640 1 -- 172.21.15.63:0/2187127959 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb4540899d0 con 0x7fb464070560 2023-12-04T10:45:29.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.463+0000 7fb45bfff640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb44406ae40 0x7fb44406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.465 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.464+0000 7fb45bfff640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb44406ae40 0x7fb44406d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4641f5c70 tx=0x7fb44c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:29.468 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.467+0000 7fb45affd640 1 -- 172.21.15.63:0/2187127959 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb454054c90 con 0x7fb464070560 2023-12-04T10:45:29.732 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.731+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fb46404e840 con 0x7fb464070560 2023-12-04T10:45:29.736 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.735+0000 7fb45affd640 1 -- 172.21.15.63:0/2187127959 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb4540582b0 con 0x7fb464070560 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb44406ae40 msgr2=0x7fb44406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb44406ae40 0x7fb44406d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb4641f5c70 tx=0x7fb44c009040 comp rx=0 tx=0).stop 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb464070560 msgr2=0x7fb46413cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb464070560 0x7fb46413cf70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb45400d800 tx=0x7fb45400dcc0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 shutdown_connections 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb44406ae40 0x7fb44406d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb46415bb80 0x7fb4640af3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb464144940 0x7fb46415a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 --2- 172.21.15.63:0/2187127959 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb464070560 0x7fb46413cf70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.738+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 >> 172.21.15.63:0/2187127959 conn(0x7fb4640b0860 msgr2=0x7fb46406cec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.739+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 shutdown_connections 2023-12-04T10:45:29.740 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.739+0000 7fb46359e640 1 -- 172.21.15.63:0/2187127959 wait complete. 2023-12-04T10:45:29.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:29.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.980+0000 7fb2118c9640 1 Processor -- start 2023-12-04T10:45:29.981 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.980+0000 7fb2118c9640 1 -- start start 2023-12-04T10:45:29.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.982+0000 7fb2118c9640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb20c0cad70 0x7fb20c0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.982+0000 7fb2118c9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb20c071600 0x7fb20c15bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.983 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.982+0000 7fb2118c9640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb20c15b5c0 con 0x7fb20c15b1e0 2023-12-04T10:45:29.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.982+0000 7fb2118c9640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c15aa30 con 0x7fb20c0cad70 2023-12-04T10:45:29.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.982+0000 7fb2118c9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb20c071dd0 con 0x7fb20c071600 2023-12-04T10:45:29.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.982+0000 7fb203fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb20c0cad70 0x7fb20c0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.983+0000 7fb203fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fb20c0cad70 0x7fb20c0710c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40106/0 (socket says 172.21.15.63:40106) 2023-12-04T10:45:29.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.983+0000 7fb203fff640 1 -- 172.21.15.63:0/2421272685 learned_addr learned my addr 172.21.15.63:0/2421272685 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:29.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.983+0000 7fb203fff640 1 -- 172.21.15.63:0/2421272685 >> v2:172.21.15.66:3300/0 conn(0x7fb20c071600 msgr2=0x7fb20c15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:29.984 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.983+0000 7fb203fff640 1 --2- 172.21.15.63:0/2421272685 >> v2:172.21.15.66:3300/0 conn(0x7fb20c071600 0x7fb20c15bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.983+0000 7fb203fff640 1 -- 172.21.15.63:0/2421272685 >> v1:172.21.15.66:6789/0 conn(0x7fb20c15b1e0 legacy=0x7fb20c0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:29.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.983+0000 7fb203fff640 1 -- 172.21.15.63:0/2421272685 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c0720b0 con 0x7fb20c0cad70 2023-12-04T10:45:29.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.984+0000 7fb203fff640 1 --2- 172.21.15.63:0/2421272685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c0cad70 0x7fb20c0710c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0aea50 tx=0x7fb1f402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebc4ac55cb2676c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:29.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb20a7fc640 1 -- 172.21.15.63:0/2421272685 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f40317e0 con 0x7fb20c0cad70 2023-12-04T10:45:29.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb20a7fc640 1 -- 172.21.15.63:0/2421272685 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1f4031940 con 0x7fb20c0cad70 2023-12-04T10:45:29.985 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb20a7fc640 1 -- 172.21.15.63:0/2421272685 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1f4031cd0 con 0x7fb20c0cad70 2023-12-04T10:45:29.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb2118c9640 1 -- 172.21.15.63:0/2421272685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c0cad70 msgr2=0x7fb20c0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2421272685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c0cad70 0x7fb20c0710c0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0aea50 tx=0x7fb1f402b880 comp rx=0 tx=0).stop 2023-12-04T10:45:29.986 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb2118c9640 1 -- 172.21.15.63:0/2421272685 shutdown_connections 2023-12-04T10:45:29.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2421272685 >> v2:172.21.15.66:3300/0 conn(0x7fb20c071600 0x7fb20c15bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2421272685 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c0cad70 0x7fb20c0710c0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb2118c9640 1 -- 172.21.15.63:0/2421272685 >> 172.21.15.63:0/2421272685 conn(0x7fb20c0cee80 msgr2=0x7fb20c0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:29.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb2118c9640 1 -- 172.21.15.63:0/2421272685 shutdown_connections 2023-12-04T10:45:29.987 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.985+0000 7fb2118c9640 1 -- 172.21.15.63:0/2421272685 wait complete. 2023-12-04T10:45:29.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.987+0000 7fb2118c9640 1 Processor -- start 2023-12-04T10:45:29.988 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.987+0000 7fb2118c9640 1 -- start start 2023-12-04T10:45:29.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb2118c9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20c071600 0x7fb20c143350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb2118c9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb20c0cad70 0x7fb20c153c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb2118c9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c15b1e0 0x7fb20c1518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb2118c9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0cba50 con 0x7fb20c15b1e0 2023-12-04T10:45:29.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb2118c9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0cde10 con 0x7fb20c0cad70 2023-12-04T10:45:29.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb2118c9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb20c0cbcf0 con 0x7fb20c071600 2023-12-04T10:45:29.989 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb20b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c15b1e0 0x7fb20c1518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb20b7fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c15b1e0 0x7fb20c1518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40116/0 (socket says 172.21.15.63:40116) 2023-12-04T10:45:29.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.988+0000 7fb20b7fe640 1 -- 172.21.15.63:0/2109303422 learned_addr learned my addr 172.21.15.63:0/2109303422 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb203fff640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb20c0cad70 0x7fb20c153c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb20affd640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20c071600 0x7fb20c143350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb20b7fe640 1 -- 172.21.15.63:0/2109303422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20c071600 msgr2=0x7fb20c143350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb20b7fe640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20c071600 0x7fb20c143350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb20b7fe640 1 -- 172.21.15.63:0/2109303422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb20c0cad70 msgr2=0x7fb20c153c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb20b7fe640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb20c0cad70 0x7fb20c153c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb20b7fe640 1 -- 172.21.15.63:0/2109303422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1f40094d0 con 0x7fb20c15b1e0 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb20b7fe640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c15b1e0 0x7fb20c1518c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb20400b970 tx=0x7fb20400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:29.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb208ff9640 1 -- 172.21.15.63:0/2109303422 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20400cb40 con 0x7fb20c15b1e0 2023-12-04T10:45:29.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb208ff9640 1 -- 172.21.15.63:0/2109303422 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20400ccc0 con 0x7fb20c15b1e0 2023-12-04T10:45:29.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.989+0000 7fb208ff9640 1 -- 172.21.15.63:0/2109303422 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb204014680 con 0x7fb20c15b1e0 2023-12-04T10:45:29.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.990+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb20c0ce0e0 con 0x7fb20c15b1e0 2023-12-04T10:45:29.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.990+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb20c1546e0 con 0x7fb20c15b1e0 2023-12-04T10:45:29.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.991+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb20c0ce600 con 0x7fb20c15b1e0 2023-12-04T10:45:29.992 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.992+0000 7fb208ff9640 1 -- 172.21.15.63:0/2109303422 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb20401d3b0 con 0x7fb20c15b1e0 2023-12-04T10:45:29.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.993+0000 7fb208ff9640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb1ec06ae90 0x7fb1ec06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:29.993 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.993+0000 7fb208ff9640 1 -- 172.21.15.63:0/2109303422 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb204089310 con 0x7fb20c15b1e0 2023-12-04T10:45:29.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.993+0000 7fb20affd640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb1ec06ae90 0x7fb1ec06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:29.994 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.994+0000 7fb20affd640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb1ec06ae90 0x7fb1ec06d350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0b00d0 tx=0x7fb1fc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:29.998 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:29.998+0000 7fb208ff9640 1 -- 172.21.15.63:0/2109303422 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb2040546b0 con 0x7fb20c15b1e0 2023-12-04T10:45:30.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.193+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb20c0cbeb0 con 0x7fb20c15b1e0 2023-12-04T10:45:30.196 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.195+0000 7fb208ff9640 1 -- 172.21.15.63:0/2109303422 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) v1 ==== 74+0+12990 (secure 0 0 0) 0x7fb204057cd0 con 0x7fb20c15b1e0 2023-12-04T10:45:30.196 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:30.196 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":37,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:45:26.028503+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":28,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:30.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.197+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb1ec06ae90 msgr2=0x7fb1ec06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.197+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb1ec06ae90 0x7fb1ec06d350 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0b00d0 tx=0x7fb1fc008040 comp rx=0 tx=0).stop 2023-12-04T10:45:30.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.197+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c15b1e0 msgr2=0x7fb20c1518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.197+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c15b1e0 0x7fb20c1518c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb20400b970 tx=0x7fb20400be30 comp rx=0 tx=0).stop 2023-12-04T10:45:30.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.198+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 shutdown_connections 2023-12-04T10:45:30.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.198+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fb1ec06ae90 0x7fb1ec06d350 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.199 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.198+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fb20c15b1e0 0x7fb20c1518c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.198+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb20c0cad70 0x7fb20c153c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.198+0000 7fb2118c9640 1 --2- 172.21.15.63:0/2109303422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fb20c071600 0x7fb20c143350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.198+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 >> 172.21.15.63:0/2109303422 conn(0x7fb20c0cee80 msgr2=0x7fb20c0b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.198+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 shutdown_connections 2023-12-04T10:45:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.198+0000 7fb2118c9640 1 -- 172.21.15.63:0/2109303422 wait complete. 2023-12-04T10:45:30.219 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-04T10:45:30.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T10:45:30.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.444+0000 7fc1b9625640 1 Processor -- start 2023-12-04T10:45:30.445 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.444+0000 7fc1b9625640 1 -- start start 2023-12-04T10:45:30.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.446+0000 7fc1b9625640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b4143ca0 0x7fc1b40b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.446+0000 7fc1b9625640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1b406c520 0x7fc1b40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.446+0000 7fc1b9625640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1b40cb800 con 0x7fc1b40b3350 2023-12-04T10:45:30.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.446+0000 7fc1b9625640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1b40cbae0 con 0x7fc1b406c520 2023-12-04T10:45:30.447 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.446+0000 7fc1b9625640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b40cbdc0 con 0x7fc1b4143ca0 2023-12-04T10:45:30.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.447+0000 7fc1b3fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b4143ca0 0x7fc1b40b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.447+0000 7fc1b8e24640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc1b406c520 0x7fc1b40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.447+0000 7fc1b37fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc1b40b3350 0x7fc1b406be10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:54802/0 (socket says 172.21.15.63:54802) 2023-12-04T10:45:30.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.447+0000 7fc1b37fe640 1 -- 172.21.15.63:0/399680163 learned_addr learned my addr 172.21.15.63:0/399680163 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:30.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.448+0000 7fc1b8e24640 1 -- 172.21.15.63:0/399680163 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b4143ca0 msgr2=0x7fc1b40b2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:30.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.448+0000 7fc1b8e24640 1 --2- 172.21.15.63:0/399680163 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b4143ca0 0x7fc1b40b2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.448+0000 7fc1b8e24640 1 -- 172.21.15.63:0/399680163 >> v1:172.21.15.66:6789/0 conn(0x7fc1b40b3350 legacy=0x7fc1b406be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.448+0000 7fc1b8e24640 1 -- 172.21.15.63:0/399680163 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b40b2610 con 0x7fc1b406c520 2023-12-04T10:45:30.450 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.449+0000 7fc1b8e24640 1 --2- 172.21.15.63:0/399680163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 0x7fc1b40cd370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009d90 tx=0x7fc1ac02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2926d42dc3cd4b29 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:30.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.450+0000 7fc1b2ffd640 1 -- 172.21.15.63:0/399680163 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac02cc60 con 0x7fc1b406c520 2023-12-04T10:45:30.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.450+0000 7fc1b2ffd640 1 -- 172.21.15.63:0/399680163 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac02cdc0 con 0x7fc1b406c520 2023-12-04T10:45:30.451 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.450+0000 7fc1b2ffd640 1 -- 172.21.15.63:0/399680163 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac034660 con 0x7fc1b406c520 2023-12-04T10:45:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.451+0000 7fc1b9625640 1 -- 172.21.15.63:0/399680163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 msgr2=0x7fc1b40cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.451+0000 7fc1b9625640 1 --2- 172.21.15.63:0/399680163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 0x7fc1b40cd370 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009d90 tx=0x7fc1ac02beb0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.451+0000 7fc1b9625640 1 -- 172.21.15.63:0/399680163 shutdown_connections 2023-12-04T10:45:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.451+0000 7fc1b9625640 1 --2- 172.21.15.63:0/399680163 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 0x7fc1b40cd370 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.451+0000 7fc1b9625640 1 --2- 172.21.15.63:0/399680163 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b4143ca0 0x7fc1b40b2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.451+0000 7fc1b9625640 1 -- 172.21.15.63:0/399680163 >> 172.21.15.63:0/399680163 conn(0x7fc1b40b0860 msgr2=0x7fc1b40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.451+0000 7fc1b9625640 1 -- 172.21.15.63:0/399680163 shutdown_connections 2023-12-04T10:45:30.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.451+0000 7fc1b9625640 1 -- 172.21.15.63:0/399680163 wait complete. 2023-12-04T10:45:30.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.453+0000 7fc1b9625640 1 Processor -- start 2023-12-04T10:45:30.454 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.453+0000 7fc1b9625640 1 -- start start 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b9625640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 0x7fc1b4159e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b9625640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b40b3350 0x7fc1b4140b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b9625640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4143ca0 0x7fc1b4158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b9625640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b4141040 con 0x7fc1b4143ca0 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b9625640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b415a500 con 0x7fc1b406c520 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b9625640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b415a7e0 con 0x7fc1b40b3350 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b8e24640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4143ca0 0x7fc1b4158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b8e24640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4143ca0 0x7fc1b4158c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40132/0 (socket says 172.21.15.63:40132) 2023-12-04T10:45:30.456 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b8e24640 1 -- 172.21.15.63:0/872806293 learned_addr learned my addr 172.21.15.63:0/872806293 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:30.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b3fff640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 0x7fc1b4159e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.455+0000 7fc1b37fe640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b40b3350 0x7fc1b4140b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.457 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.456+0000 7fc1b8e24640 1 -- 172.21.15.63:0/872806293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b40b3350 msgr2=0x7fc1b4140b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.456+0000 7fc1b8e24640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b40b3350 0x7fc1b4140b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.456+0000 7fc1b8e24640 1 -- 172.21.15.63:0/872806293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 msgr2=0x7fc1b4159e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.456+0000 7fc1b8e24640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 0x7fc1b4159e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.456+0000 7fc1b8e24640 1 -- 172.21.15.63:0/872806293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1ac009a70 con 0x7fc1b4143ca0 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.456+0000 7fc1b8e24640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4143ca0 0x7fc1b4158c60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009d90 tx=0x7fc1ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.457+0000 7fc1b0ff9640 1 -- 172.21.15.63:0/872806293 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac040650 con 0x7fc1b4143ca0 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.457+0000 7fc1b0ff9640 1 -- 172.21.15.63:0/872806293 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1ac0407b0 con 0x7fc1b4143ca0 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.457+0000 7fc1b0ff9640 1 -- 172.21.15.63:0/872806293 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac040b60 con 0x7fc1b4143ca0 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.457+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b412e330 con 0x7fc1b4143ca0 2023-12-04T10:45:30.458 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.457+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b41591a0 con 0x7fc1b4143ca0 2023-12-04T10:45:30.459 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.458+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b412e190 con 0x7fc1b4143ca0 2023-12-04T10:45:30.460 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.459+0000 7fc1b0ff9640 1 -- 172.21.15.63:0/872806293 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1ac040cc0 con 0x7fc1b4143ca0 2023-12-04T10:45:30.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.460+0000 7fc1b0ff9640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc1a006ae40 0x7fc1a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.460+0000 7fc1b0ff9640 1 -- 172.21.15.63:0/872806293 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc1ac0ac1c0 con 0x7fc1b4143ca0 2023-12-04T10:45:30.461 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.461+0000 7fc1b3fff640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc1a006ae40 0x7fc1a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.462 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.461+0000 7fc1b3fff640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc1a006ae40 0x7fc1a006d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009aa0 tx=0x7fc1a4009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:30.466 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.465+0000 7fc1b0ff9640 1 -- 172.21.15.63:0/872806293 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1b412e190 con 0x7fc1b4143ca0 2023-12-04T10:45:30.661 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.660+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc1b412e850 con 0x7fc1b4143ca0 2023-12-04T10:45:30.662 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.661+0000 7fc1b0ff9640 1 -- 172.21.15.63:0/872806293 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc1b412e850 con 0x7fc1b4143ca0 2023-12-04T10:45:30.662 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T10:45:30.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc1a006ae40 msgr2=0x7fc1a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.664 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc1a006ae40 0x7fc1a006d300 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fc1a4009aa0 tx=0x7fc1a4009190 comp rx=0 tx=0).stop 2023-12-04T10:45:30.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4143ca0 msgr2=0x7fc1b4158c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4143ca0 0x7fc1b4158c60 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac009d90 tx=0x7fc1ac004a40 comp rx=0 tx=0).stop 2023-12-04T10:45:30.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 shutdown_connections 2023-12-04T10:45:30.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc1a006ae40 0x7fc1a006d300 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc1b40b3350 0x7fc1b4140b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc1b4143ca0 0x7fc1b4158c60 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.665 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 --2- 172.21.15.63:0/872806293 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc1b406c520 0x7fc1b4159e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 >> 172.21.15.63:0/872806293 conn(0x7fc1b40b0860 msgr2=0x7fc1b40cdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:30.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 shutdown_connections 2023-12-04T10:45:30.666 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.663+0000 7fc1b9625640 1 -- 172.21.15.63:0/872806293 wait complete. 2023-12-04T10:45:30.684 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-04T10:45:30.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.909+0000 7fc4dca47640 1 Processor -- start 2023-12-04T10:45:30.910 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.909+0000 7fc4dca47640 1 -- start start 2023-12-04T10:45:30.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4dca47640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 0x7fc4d80cad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4dca47640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc4d8070df0 0x7fc4d8071250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4dca47640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc4d80cb630 0x7fc4d80cbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4dca47640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d80723f0 con 0x7fc4d8070df0 2023-12-04T10:45:30.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4dca47640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4d80cbfe0 con 0x7fc4d80cb630 2023-12-04T10:45:30.913 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4dca47640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d815a300 con 0x7fc4d8159f20 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4cffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc4d8070df0 0x7fc4d8071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4cffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fc4d8070df0 0x7fc4d8071250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40146/0 (socket says 172.21.15.63:40146) 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.911+0000 7fc4cffff640 1 -- 172.21.15.63:0/4092519728 learned_addr learned my addr 172.21.15.63:0/4092519728 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.912+0000 7fc4d6d9d640 1 --2- 172.21.15.63:0/4092519728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 0x7fc4d80cad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.912+0000 7fc4d759e640 1 --2- 172.21.15.63:0/4092519728 >> v2:172.21.15.66:3300/0 conn(0x7fc4d80cb630 0x7fc4d80cbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.912+0000 7fc4cffff640 1 -- 172.21.15.63:0/4092519728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 msgr2=0x7fc4d80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.912+0000 7fc4cffff640 1 --2- 172.21.15.63:0/4092519728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 0x7fc4d80cad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.912+0000 7fc4cffff640 1 -- 172.21.15.63:0/4092519728 >> v2:172.21.15.66:3300/0 conn(0x7fc4d80cb630 msgr2=0x7fc4d80cbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:30.914 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.912+0000 7fc4cffff640 1 --2- 172.21.15.63:0/4092519728 >> v2:172.21.15.66:3300/0 conn(0x7fc4d80cb630 0x7fc4d80cbaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.912+0000 7fc4cffff640 1 -- 172.21.15.63:0/4092519728 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4d80ca040 con 0x7fc4d8070df0 2023-12-04T10:45:30.915 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.912+0000 7fc4d759e640 1 --2- 172.21.15.63:0/4092519728 >> v2:172.21.15.66:3300/0 conn(0x7fc4d80cb630 0x7fc4d80cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.913+0000 7fc4cffff640 1 --2- 172.21.15.63:0/4092519728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d8071250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8070060 tx=0x7fc4c002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5020450bace2dcf server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.913+0000 7fc4d659c640 1 -- 172.21.15.63:0/4092519728 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0031640 con 0x7fc4d8070df0 2023-12-04T10:45:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4d659c640 1 -- 172.21.15.63:0/4092519728 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c00317a0 con 0x7fc4d8070df0 2023-12-04T10:45:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4d659c640 1 -- 172.21.15.63:0/4092519728 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c0031b30 con 0x7fc4d8070df0 2023-12-04T10:45:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4dca47640 1 -- 172.21.15.63:0/4092519728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 msgr2=0x7fc4d8071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4dca47640 1 --2- 172.21.15.63:0/4092519728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d8071250 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fc4d8070060 tx=0x7fc4c002b8f0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4dca47640 1 -- 172.21.15.63:0/4092519728 shutdown_connections 2023-12-04T10:45:30.921 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4dca47640 1 --2- 172.21.15.63:0/4092519728 >> v2:172.21.15.66:3300/0 conn(0x7fc4d80cb630 0x7fc4d80cbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4dca47640 1 --2- 172.21.15.63:0/4092519728 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d8071250 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4dca47640 1 --2- 172.21.15.63:0/4092519728 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 0x7fc4d80cad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.914+0000 7fc4dca47640 1 -- 172.21.15.63:0/4092519728 >> 172.21.15.63:0/4092519728 conn(0x7fc4d80b07f0 msgr2=0x7fc4d80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.915+0000 7fc4dca47640 1 -- 172.21.15.63:0/4092519728 shutdown_connections 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.915+0000 7fc4dca47640 1 -- 172.21.15.63:0/4092519728 wait complete. 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.916+0000 7fc4dca47640 1 Processor -- start 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.917+0000 7fc4dca47640 1 -- start start 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4dca47640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d81566f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4dca47640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4d80cb630 0x7fc4d80c4e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4dca47640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 0x7fc4d80cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4dca47640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d815a550 con 0x7fc4d8070df0 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4dca47640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d815a830 con 0x7fc4d80cb630 2023-12-04T10:45:30.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4dca47640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4d815ab10 con 0x7fc4d8159f20 2023-12-04T10:45:30.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4d6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d81566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4d6d9d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d81566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40150/0 (socket says 172.21.15.63:40150) 2023-12-04T10:45:30.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4d6d9d640 1 -- 172.21.15.63:0/2858064326 learned_addr learned my addr 172.21.15.63:0/2858064326 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:30.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4d6d9d640 1 -- 172.21.15.63:0/2858064326 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 msgr2=0x7fc4d80cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4d6d9d640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 0x7fc4d80cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4d6d9d640 1 -- 172.21.15.63:0/2858064326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4d80cb630 msgr2=0x7fc4d80c4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:30.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4d6d9d640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4d80cb630 0x7fc4d80c4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:30.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.918+0000 7fc4d6d9d640 1 -- 172.21.15.63:0/2858064326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c00094d0 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.919+0000 7fc4d6d9d640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d81566f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800d800 tx=0x7fc4c800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.919+0000 7fc4cf7fe640 1 -- 172.21.15.63:0/2858064326 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800b6c0 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.919+0000 7fc4cf7fe640 1 -- 172.21.15.63:0/2858064326 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4c800b820 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.919+0000 7fc4cf7fe640 1 -- 172.21.15.63:0/2858064326 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4c800bbb0 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.919+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4d815adf0 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.919+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4d80c53d0 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.920+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4d80c55f0 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.921+0000 7fc4cf7fe640 1 -- 172.21.15.63:0/2858064326 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc4c800bd10 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.922+0000 7fc4cf7fe640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc4b806ae40 0x7fc4b806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.923+0000 7fc4cf7fe640 1 -- 172.21.15.63:0/2858064326 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc4c8089a40 con 0x7fc4d8070df0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.923+0000 7fc4cffff640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc4b806ae40 0x7fc4b806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:30.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.923+0000 7fc4cffff640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc4b806ae40 0x7fc4b806d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0036000 tx=0x7fc4c0030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:30.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:30.927+0000 7fc4cf7fe640 1 -- 172.21.15.63:0/2858064326 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc4c8054c60 con 0x7fc4d8070df0 2023-12-04T10:45:31.126 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.124+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc4d804e840 con 0x7fc4d8070df0 2023-12-04T10:45:31.130 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.126+0000 7fc4cf7fe640 1 -- 172.21.15.63:0/2858064326 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v37) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc4c8058280 con 0x7fc4d8070df0 2023-12-04T10:45:31.130 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:31.130 INFO:teuthology.orchestra.run.smithi063.stdout:[ 2023-12-04T10:45:31.130 INFO:teuthology.orchestra.run.smithi063.stdout: { 2023-12-04T10:45:31.130 INFO:teuthology.orchestra.run.smithi063.stdout: "poolnum": 1, 2023-12-04T10:45:31.130 INFO:teuthology.orchestra.run.smithi063.stdout: "poolname": ".mgr" 2023-12-04T10:45:31.130 INFO:teuthology.orchestra.run.smithi063.stdout: } 2023-12-04T10:45:31.130 INFO:teuthology.orchestra.run.smithi063.stdout:] 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc4b806ae40 msgr2=0x7fc4b806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc4b806ae40 0x7fc4b806d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc4c0036000 tx=0x7fc4c0030000 comp rx=0 tx=0).stop 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 msgr2=0x7fc4d81566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d81566f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800d800 tx=0x7fc4c800dcc0 comp rx=0 tx=0).stop 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 shutdown_connections 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fc4b806ae40 0x7fc4b806d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fc4d8159f20 0x7fc4d80cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc4d80cb630 0x7fc4d80c4e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 --2- 172.21.15.63:0/2858064326 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fc4d8070df0 0x7fc4d81566f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 >> 172.21.15.63:0/2858064326 conn(0x7fc4d80b07f0 msgr2=0x7fc4d80b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 shutdown_connections 2023-12-04T10:45:31.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.128+0000 7fc4dca47640 1 -- 172.21.15.63:0/2858064326 wait complete. 2023-12-04T10:45:31.148 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-04T10:45:31.148 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-04T10:45:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.361+0000 7f5da4452640 1 Processor -- start 2023-12-04T10:45:31.362 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.361+0000 7f5da4452640 1 -- start start 2023-12-04T10:45:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.363+0000 7f5da4452640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c0b12b0 0x7f5d9c15ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.363+0000 7f5da4452640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c15fcc0 con 0x7f5d9c13e360 2023-12-04T10:45:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.363+0000 7f5da4452640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9c15c700 con 0x7f5d9c15f490 2023-12-04T10:45:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.363+0000 7f5da4452640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c13e740 con 0x7f5d9c0b12b0 2023-12-04T10:45:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.364+0000 7f5da21ee640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f5d9c13e360 0x7f5d9c0b0ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43672/0 (socket says 172.21.15.63:43672) 2023-12-04T10:45:31.365 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.364+0000 7f5da21ee640 1 -- 172.21.15.63:0/2451234511 learned_addr learned my addr 172.21.15.63:0/2451234511 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.364+0000 7f5da19ed640 1 --2- 172.21.15.63:0/2451234511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c0b12b0 0x7f5d9c15ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.364+0000 7f5da11ec640 1 -- 172.21.15.63:0/2451234511 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2175065081 0 0) 0x7f5d9c15fcc0 con 0x7f5d9c13e360 2023-12-04T10:45:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.364+0000 7f5da11ec640 1 -- 172.21.15.63:0/2451234511 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d88003520 con 0x7f5d9c13e360 2023-12-04T10:45:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.365+0000 7f5da11ec640 1 -- 172.21.15.63:0/2451234511 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3429909045 0 0) 0x7f5d9c15c700 con 0x7f5d9c15f490 2023-12-04T10:45:31.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.365+0000 7f5da11ec640 1 -- 172.21.15.63:0/2451234511 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d9c15fcc0 con 0x7f5d9c15f490 2023-12-04T10:45:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.365+0000 7f5da19ed640 1 -- 172.21.15.63:0/2451234511 >> v1:172.21.15.66:6789/0 conn(0x7f5d9c15f490 legacy=0x7f5d9c0cda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.365+0000 7f5da19ed640 1 -- 172.21.15.63:0/2451234511 >> v1:172.21.15.63:6789/0 conn(0x7f5d9c13e360 legacy=0x7f5d9c0b0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.365+0000 7f5da19ed640 1 -- 172.21.15.63:0/2451234511 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9c15b6b0 con 0x7f5d9c0b12b0 2023-12-04T10:45:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.366+0000 7f5da19ed640 1 --2- 172.21.15.63:0/2451234511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c0b12b0 0x7f5d9c15ef50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0097d0 tx=0x7f5d8c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca787860ac6f8d91 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da11ec640 1 -- 172.21.15.63:0/2451234511 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c031890 con 0x7f5d9c0b12b0 2023-12-04T10:45:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da11ec640 1 -- 172.21.15.63:0/2451234511 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c0319f0 con 0x7f5d9c0b12b0 2023-12-04T10:45:31.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da11ec640 1 -- 172.21.15.63:0/2451234511 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c031d80 con 0x7f5d9c0b12b0 2023-12-04T10:45:31.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da4452640 1 -- 172.21.15.63:0/2451234511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c0b12b0 msgr2=0x7f5d9c15ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da4452640 1 --2- 172.21.15.63:0/2451234511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c0b12b0 0x7f5d9c15ef50 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c0097d0 tx=0x7f5d8c02b930 comp rx=0 tx=0).stop 2023-12-04T10:45:31.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da4452640 1 -- 172.21.15.63:0/2451234511 shutdown_connections 2023-12-04T10:45:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da4452640 1 --2- 172.21.15.63:0/2451234511 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c0b12b0 0x7f5d9c15ef50 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da4452640 1 -- 172.21.15.63:0/2451234511 >> 172.21.15.63:0/2451234511 conn(0x7f5d9c06a450 msgr2=0x7f5d9c06a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da4452640 1 -- 172.21.15.63:0/2451234511 shutdown_connections 2023-12-04T10:45:31.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.367+0000 7f5da4452640 1 -- 172.21.15.63:0/2451234511 wait complete. 2023-12-04T10:45:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.369+0000 7f5da4452640 1 Processor -- start 2023-12-04T10:45:31.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.369+0000 7f5da4452640 1 -- start start 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da4452640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d9c0b12b0 0x7f5d9c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da4452640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d9c13e360 0x7f5d9c1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da4452640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c15f490 0x7f5d9c140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da4452640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c15c2e0 con 0x7f5d9c13e360 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da4452640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c13f530 con 0x7f5d9c0b12b0 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da4452640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9c158fd0 con 0x7f5d9c15f490 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da19ed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d9c13e360 0x7f5d9c1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da19ed640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d9c13e360 0x7f5d9c1402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40152/0 (socket says 172.21.15.63:40152) 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.370+0000 7f5da19ed640 1 -- 172.21.15.63:0/4184434331 learned_addr learned my addr 172.21.15.63:0/4184434331 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.371+0000 7f5da21ee640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d9c0b12b0 0x7f5d9c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.371+0000 7f5da19ed640 1 -- 172.21.15.63:0/4184434331 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c15f490 msgr2=0x7f5d9c140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.371+0000 7f5da19ed640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c15f490 0x7f5d9c140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.371+0000 7f5da19ed640 1 -- 172.21.15.63:0/4184434331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d9c0b12b0 msgr2=0x7f5d9c158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:31.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.371+0000 7f5da19ed640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d9c0b12b0 0x7f5d9c158a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.371+0000 7f5da19ed640 1 -- 172.21.15.63:0/4184434331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c009400 con 0x7f5d9c13e360 2023-12-04T10:45:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.371+0000 7f5da19ed640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d9c13e360 0x7f5d9c1402c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c034040 tx=0x7f5d8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.372+0000 7f5d92ffd640 1 -- 172.21.15.63:0/4184434331 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c03abe0 con 0x7f5d9c13e360 2023-12-04T10:45:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.372+0000 7f5d92ffd640 1 -- 172.21.15.63:0/4184434331 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c03ad80 con 0x7f5d9c13e360 2023-12-04T10:45:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.372+0000 7f5d92ffd640 1 -- 172.21.15.63:0/4184434331 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c044630 con 0x7f5d9c13e360 2023-12-04T10:45:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.372+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9c13e920 con 0x7f5d9c13e360 2023-12-04T10:45:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.372+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d9c13eee0 con 0x7f5d9c13e360 2023-12-04T10:45:31.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.373+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9c13f6c0 con 0x7f5d9c13e360 2023-12-04T10:45:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.374+0000 7f5d92ffd640 1 -- 172.21.15.63:0/4184434331 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d8c04d450 con 0x7f5d9c13e360 2023-12-04T10:45:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.375+0000 7f5d92ffd640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5d8006ae70 0x7f5d8006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.375+0000 7f5d92ffd640 1 -- 172.21.15.63:0/4184434331 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f5d8c0ab930 con 0x7f5d9c13e360 2023-12-04T10:45:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.375+0000 7f5da21ee640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5d8006ae70 0x7f5d8006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:31.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.376+0000 7f5da21ee640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5d8006ae70 0x7f5d8006d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d98000f60 tx=0x7f5d98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:31.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.379+0000 7f5d92ffd640 1 -- 172.21.15.63:0/4184434331 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5d8c076be0 con 0x7f5d9c13e360 2023-12-04T10:45:31.576 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:31.574+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5d9c068710 con 0x7f5d9c13e360 2023-12-04T10:45:32.045 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.044+0000 7f5d92ffd640 1 -- 172.21.15.63:0/4184434331 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v38) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5d8c035070 con 0x7f5d9c13e360 2023-12-04T10:45:32.046 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_metadata' created 2023-12-04T10:45:32.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5d8006ae70 msgr2=0x7f5d8006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:32.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5d8006ae70 0x7f5d8006d330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d98000f60 tx=0x7f5d98009040 comp rx=0 tx=0).stop 2023-12-04T10:45:32.049 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d9c13e360 msgr2=0x7f5d9c1402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d9c13e360 0x7f5d9c1402c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c034040 tx=0x7f5d8c0046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 shutdown_connections 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5d8006ae70 0x7f5d8006d330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5d9c15f490 0x7f5d9c140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5d9c13e360 0x7f5d9c1402c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 --2- 172.21.15.63:0/4184434331 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5d9c0b12b0 0x7f5d9c158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.048+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 >> 172.21.15.63:0/4184434331 conn(0x7f5d9c06a450 msgr2=0x7f5d9c072330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.049+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 shutdown_connections 2023-12-04T10:45:32.050 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.049+0000 7f5da4452640 1 -- 172.21.15.63:0/4184434331 wait complete. 2023-12-04T10:45:32.078 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-04T10:45:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.293+0000 7f222ce9b640 1 Processor -- start 2023-12-04T10:45:32.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.293+0000 7f222ce9b640 1 -- start start 2023-12-04T10:45:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.295+0000 7f222ce9b640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f22280b31f0 0x7f222806aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.295+0000 7f222ce9b640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222806a450 con 0x7f2228157880 2023-12-04T10:45:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.295+0000 7f222ce9b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222815df70 con 0x7f22280b2d40 2023-12-04T10:45:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.295+0000 7f222ce9b640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f222815e250 con 0x7f22280b31f0 2023-12-04T10:45:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.295+0000 7f222659c640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2228157880 0x7f22280b2630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43674/0 (socket says 172.21.15.63:43674) 2023-12-04T10:45:32.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.295+0000 7f222659c640 1 -- 172.21.15.63:0/619829559 learned_addr learned my addr 172.21.15.63:0/619829559 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:32.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.295+0000 7f2226d9d640 1 --2- 172.21.15.63:0/619829559 >> v2:172.21.15.63:3300/0 conn(0x7f22280b31f0 0x7f222806aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:32.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.296+0000 7f2225d9b640 1 -- 172.21.15.63:0/619829559 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1290739705 0 0) 0x7f222806a450 con 0x7f2228157880 2023-12-04T10:45:32.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.296+0000 7f2225d9b640 1 -- 172.21.15.63:0/619829559 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2214003520 con 0x7f2228157880 2023-12-04T10:45:32.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.296+0000 7f2226d9d640 1 -- 172.21.15.63:0/619829559 >> v1:172.21.15.66:6789/0 conn(0x7f22280b2d40 legacy=0x7f222806a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:32.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.296+0000 7f2226d9d640 1 -- 172.21.15.63:0/619829559 >> v1:172.21.15.63:6789/0 conn(0x7f2228157880 legacy=0x7f22280b2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:32.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.296+0000 7f2226d9d640 1 -- 172.21.15.63:0/619829559 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222815e530 con 0x7f22280b31f0 2023-12-04T10:45:32.298 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.297+0000 7f2226d9d640 1 --2- 172.21.15.63:0/619829559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806aff0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2220009d90 tx=0x7f222002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e62ed164feb2f471 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:32.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.297+0000 7f2225d9b640 1 -- 172.21.15.63:0/619829559 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f222002cd00 con 0x7f22280b31f0 2023-12-04T10:45:32.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f2225d9b640 1 -- 172.21.15.63:0/619829559 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f222002ce60 con 0x7f22280b31f0 2023-12-04T10:45:32.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f2225d9b640 1 -- 172.21.15.63:0/619829559 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2220034660 con 0x7f22280b31f0 2023-12-04T10:45:32.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f222ce9b640 1 -- 172.21.15.63:0/619829559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 msgr2=0x7f222806aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:32.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f222ce9b640 1 --2- 172.21.15.63:0/619829559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806aff0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2220009d90 tx=0x7f222002bf50 comp rx=0 tx=0).stop 2023-12-04T10:45:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f222ce9b640 1 -- 172.21.15.63:0/619829559 shutdown_connections 2023-12-04T10:45:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f222ce9b640 1 --2- 172.21.15.63:0/619829559 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806aff0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f222ce9b640 1 -- 172.21.15.63:0/619829559 >> 172.21.15.63:0/619829559 conn(0x7f22280cf6a0 msgr2=0x7f22280cfa80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f222ce9b640 1 -- 172.21.15.63:0/619829559 shutdown_connections 2023-12-04T10:45:32.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.298+0000 7f222ce9b640 1 -- 172.21.15.63:0/619829559 wait complete. 2023-12-04T10:45:32.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.301+0000 7f222ce9b640 1 Processor -- start 2023-12-04T10:45:32.301 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.301+0000 7f222ce9b640 1 -- start start 2023-12-04T10:45:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f222ce9b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22280b2d40 0x7f2228142140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f222ce9b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:32.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f222ce9b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2228157880 0x7f222806ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f222ce9b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2228142680 con 0x7f22280b31f0 2023-12-04T10:45:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f222ce9b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22281f2f30 con 0x7f22280b2d40 2023-12-04T10:45:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f222ce9b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22281f3d80 con 0x7f2228157880 2023-12-04T10:45:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f221ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f221ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40178/0 (socket says 172.21.15.63:40178) 2023-12-04T10:45:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.302+0000 7f221ffff640 1 -- 172.21.15.63:0/167819696 learned_addr learned my addr 172.21.15.63:0/167819696 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:32.304 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f222659c640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22280b2d40 0x7f2228142140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f2226d9d640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2228157880 0x7f222806ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f221ffff640 1 -- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2228157880 msgr2=0x7f222806ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f221ffff640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2228157880 0x7f222806ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f221ffff640 1 -- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22280b2d40 msgr2=0x7f2228142140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f221ffff640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22280b2d40 0x7f2228142140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f221ffff640 1 -- 172.21.15.63:0/167819696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2220009a70 con 0x7f22280b31f0 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f2226d9d640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2228157880 0x7f222806ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f221ffff640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806a7e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f221000c450 tx=0x7f221000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:32.306 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f221effd640 1 -- 172.21.15.63:0/167819696 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22100052d0 con 0x7f22280b31f0 2023-12-04T10:45:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.303+0000 7f221effd640 1 -- 172.21.15.63:0/167819696 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210005430 con 0x7f22280b31f0 2023-12-04T10:45:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.304+0000 7f221effd640 1 -- 172.21.15.63:0/167819696 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210003830 con 0x7f22280b31f0 2023-12-04T10:45:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.304+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22281f3170 con 0x7f22280b31f0 2023-12-04T10:45:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.304+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22281f3730 con 0x7f22280b31f0 2023-12-04T10:45:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.305+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22281f3f30 con 0x7f22280b31f0 2023-12-04T10:45:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.306+0000 7f221effd640 1 -- 172.21.15.63:0/167819696 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2210003990 con 0x7f22280b31f0 2023-12-04T10:45:32.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.307+0000 7f221effd640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f220806ae40 0x7f220806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:32.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.307+0000 7f221effd640 1 -- 172.21.15.63:0/167819696 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5547+0+0 (secure 0 0 0) 0x7f2210088bc0 con 0x7f22280b31f0 2023-12-04T10:45:32.308 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.307+0000 7f222659c640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f220806ae40 0x7f220806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:32.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.308+0000 7f222659c640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f220806ae40 0x7f220806d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22180011e0 tx=0x7f2218009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:32.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.312+0000 7f221effd640 1 -- 172.21.15.63:0/167819696 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f22281f3f30 con 0x7f22280b31f0 2023-12-04T10:45:32.506 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:32.505+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f22281f3ef0 con 0x7f22280b31f0 2023-12-04T10:45:33.051 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.049+0000 7f221effd640 1 -- 172.21.15.63:0/167819696 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v39) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2210053c70 con 0x7f22280b31f0 2023-12-04T10:45:33.051 INFO:teuthology.orchestra.run.smithi063.stderr:pool 'cephfs_data' created 2023-12-04T10:45:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.053+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f220806ae40 msgr2=0x7f220806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.053+0000 7f222ce9b640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f220806ae40 0x7f220806d300 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22180011e0 tx=0x7f2218009040 comp rx=0 tx=0).stop 2023-12-04T10:45:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.053+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 msgr2=0x7f222806a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:33.054 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.053+0000 7f222ce9b640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806a7e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f221000c450 tx=0x7f221000c910 comp rx=0 tx=0).stop 2023-12-04T10:45:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.053+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 shutdown_connections 2023-12-04T10:45:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.053+0000 7f222ce9b640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f220806ae40 0x7f220806d300 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.054+0000 7f222ce9b640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2228157880 0x7f222806ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.054+0000 7f222ce9b640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f22280b31f0 0x7f222806a7e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.054+0000 7f222ce9b640 1 --2- 172.21.15.63:0/167819696 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f22280b2d40 0x7f2228142140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.054+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 >> 172.21.15.63:0/167819696 conn(0x7f22280cf6a0 msgr2=0x7f222806b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.054+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 shutdown_connections 2023-12-04T10:45:33.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.054+0000 7f222ce9b640 1 -- 172.21.15.63:0/167819696 wait complete. 2023-12-04T10:45:33.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-04T10:45:33.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.283+0000 7f2bc2e6b640 1 Processor -- start 2023-12-04T10:45:33.284 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.283+0000 7f2bc2e6b640 1 -- start start 2023-12-04T10:45:33.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.285+0000 7f2bc2e6b640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f2bbc0cad70 0x7f2bbc0710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:33.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.285+0000 7f2bc2e6b640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc15b5c0 con 0x7f2bbc071600 2023-12-04T10:45:33.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.285+0000 7f2bc2e6b640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bbc071dd0 con 0x7f2bbc15b1e0 2023-12-04T10:45:33.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.285+0000 7f2bc2e6b640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bbc15aa30 con 0x7f2bbc0cad70 2023-12-04T10:45:33.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.285+0000 7f2bc1408640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f2bbc071600 0x7f2bbc15bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:43678/0 (socket says 172.21.15.63:43678) 2023-12-04T10:45:33.286 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.285+0000 7f2bc1408640 1 -- 172.21.15.63:0/3880039400 learned_addr learned my addr 172.21.15.63:0/3880039400 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:33.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.285+0000 7f2bbbfff640 1 --2- 172.21.15.63:0/3880039400 >> v2:172.21.15.63:3300/0 conn(0x7f2bbc0cad70 0x7f2bbc0710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:33.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.286+0000 7f2bbb7fe640 1 -- 172.21.15.63:0/3880039400 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3138436851 0 0) 0x7f2bbc15b5c0 con 0x7f2bbc071600 2023-12-04T10:45:33.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.286+0000 7f2bbb7fe640 1 -- 172.21.15.63:0/3880039400 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bac003520 con 0x7f2bbc071600 2023-12-04T10:45:33.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.286+0000 7f2bbbfff640 1 -- 172.21.15.63:0/3880039400 >> v1:172.21.15.66:6789/0 conn(0x7f2bbc15b1e0 legacy=0x7f2bbc0ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:33.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.286+0000 7f2bbbfff640 1 -- 172.21.15.63:0/3880039400 >> v1:172.21.15.63:6789/0 conn(0x7f2bbc071600 legacy=0x7f2bbc15bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:33.287 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.286+0000 7f2bbbfff640 1 -- 172.21.15.63:0/3880039400 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0720b0 con 0x7f2bbc0cad70 2023-12-04T10:45:33.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.287+0000 7f2bbbfff640 1 --2- 172.21.15.63:0/3880039400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc0710c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80097a0 tx=0x7f2ba802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd7699aaf4eec28e server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:33.288 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.288+0000 7f2bbb7fe640 1 -- 172.21.15.63:0/3880039400 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8031830 con 0x7f2bbc0cad70 2023-12-04T10:45:33.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.288+0000 7f2bbb7fe640 1 -- 172.21.15.63:0/3880039400 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba8031990 con 0x7f2bbc0cad70 2023-12-04T10:45:33.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.288+0000 7f2bbb7fe640 1 -- 172.21.15.63:0/3880039400 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba8031d20 con 0x7f2bbc0cad70 2023-12-04T10:45:33.289 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.288+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3880039400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 msgr2=0x7f2bbc0710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.288+0000 7f2bc2e6b640 1 --2- 172.21.15.63:0/3880039400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc0710c0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80097a0 tx=0x7f2ba802b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.288+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3880039400 shutdown_connections 2023-12-04T10:45:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.288+0000 7f2bc2e6b640 1 --2- 172.21.15.63:0/3880039400 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc0710c0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.288+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3880039400 >> 172.21.15.63:0/3880039400 conn(0x7f2bbc0cee80 msgr2=0x7f2bbc0cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.289+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3880039400 shutdown_connections 2023-12-04T10:45:33.290 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.289+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3880039400 wait complete. 2023-12-04T10:45:33.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.290+0000 7f2bc2e6b640 1 Processor -- start 2023-12-04T10:45:33.291 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.290+0000 7f2bc2e6b640 1 -- start start 2023-12-04T10:45:33.294 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.291+0000 7f2bc2e6b640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bbc071600 0x7f2bbc149260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.291+0000 7f2bc2e6b640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.291+0000 7f2bc2e6b640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bbc15b1e0 0x7f2bbc145130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bc2e6b640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc149fa0 con 0x7f2bbc0cad70 2023-12-04T10:45:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bc2e6b640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc156c10 con 0x7f2bbc071600 2023-12-04T10:45:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bc2e6b640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bbc156ef0 con 0x7f2bbc15b1e0 2023-12-04T10:45:33.295 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bbbfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:40192/0 (socket says 172.21.15.63:40192) 2023-12-04T10:45:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bbbfff640 1 -- 172.21.15.63:0/3553580482 learned_addr learned my addr 172.21.15.63:0/3553580482 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bc0c07640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bbc071600 0x7f2bbc149260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bbbfff640 1 -- 172.21.15.63:0/3553580482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bbc15b1e0 msgr2=0x7f2bbc145130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bc1408640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bbc15b1e0 0x7f2bbc145130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bbbfff640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bbc15b1e0 0x7f2bbc145130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:33.296 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bbbfff640 1 -- 172.21.15.63:0/3553580482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bbc071600 msgr2=0x7f2bbc149260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bbbfff640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bbc071600 0x7f2bbc149260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.292+0000 7f2bbbfff640 1 -- 172.21.15.63:0/3553580482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba8009400 con 0x7f2bbc0cad70 2023-12-04T10:45:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.293+0000 7f2bbbfff640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc159050 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80098c0 tx=0x7f2ba80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.293+0000 7f2bb97fa640 1 -- 172.21.15.63:0/3553580482 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba803b9f0 con 0x7f2bbc0cad70 2023-12-04T10:45:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.293+0000 7f2bb97fa640 1 -- 172.21.15.63:0/3553580482 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba803bb50 con 0x7f2bbc0cad70 2023-12-04T10:45:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.293+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bbc1571d0 con 0x7f2bbc0cad70 2023-12-04T10:45:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.293+0000 7f2bb97fa640 1 -- 172.21.15.63:0/3553580482 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba80453f0 con 0x7f2bbc0cad70 2023-12-04T10:45:33.297 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.293+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bbc157790 con 0x7f2bbc0cad70 2023-12-04T10:45:33.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.294+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bbc157980 con 0x7f2bbc0cad70 2023-12-04T10:45:33.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.296+0000 7f2bb97fa640 1 -- 172.21.15.63:0/3553580482 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2ba804e450 con 0x7f2bbc0cad70 2023-12-04T10:45:33.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.296+0000 7f2bb97fa640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2ba006ae40 0x7f2ba006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:33.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.297+0000 7f2bb97fa640 1 -- 172.21.15.63:0/3553580482 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5929+0+0 (secure 0 0 0) 0x7f2ba80ab8e0 con 0x7f2bbc0cad70 2023-12-04T10:45:33.299 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.297+0000 7f2bc0c07640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2ba006ae40 0x7f2ba006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:33.300 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.298+0000 7f2bc0c07640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2ba006ae40 0x7f2ba006d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0000f60 tx=0x7f2bb0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:33.303 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.302+0000 7f2bb97fa640 1 -- 172.21.15.63:0/3553580482 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2ba80769d0 con 0x7f2bbc0cad70 2023-12-04T10:45:33.538 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:33.537+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2bbc068710 con 0x7f2bbc0cad70 2023-12-04T10:45:34.100 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.098+0000 7f2bb97fa640 1 -- 172.21.15.63:0/3553580482 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f2ba8035020 con 0x7f2bbc0cad70 2023-12-04T10:45:34.103 INFO:teuthology.orchestra.run.smithi063.stderr:new fs with metadata pool 5 and data pool 6 2023-12-04T10:45:34.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.109+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2ba006ae40 msgr2=0x7f2ba006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.109+0000 7f2bc2e6b640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2ba006ae40 0x7f2ba006d300 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0000f60 tx=0x7f2bb0009040 comp rx=0 tx=0).stop 2023-12-04T10:45:34.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.109+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 msgr2=0x7f2bbc159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.110 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.109+0000 7f2bc2e6b640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc159050 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80098c0 tx=0x7f2ba80046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.111 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.110+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 shutdown_connections 2023-12-04T10:45:34.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.110+0000 7f2bc2e6b640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2ba006ae40 0x7f2ba006d300 secure :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0000f60 tx=0x7f2bb0009040 comp rx=0 tx=0).stop 2023-12-04T10:45:34.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.110+0000 7f2bc2e6b640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2bbc15b1e0 0x7f2bbc145130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.110+0000 7f2bc2e6b640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2bbc0cad70 0x7f2bbc159050 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.110+0000 7f2bc2e6b640 1 --2- 172.21.15.63:0/3553580482 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2bbc071600 0x7f2bbc149260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.110+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 >> 172.21.15.63:0/3553580482 conn(0x7f2bbc0cee80 msgr2=0x7f2bbc0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:34.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.112+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 shutdown_connections 2023-12-04T10:45:34.113 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.112+0000 7f2bc2e6b640 1 -- 172.21.15.63:0/3553580482 wait complete. 2023-12-04T10:45:34.146 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:34.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.330+0000 7f37cef93640 1 Processor -- start 2023-12-04T10:45:34.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.331+0000 7f37cef93640 1 -- start start 2023-12-04T10:45:34.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.332+0000 7f37cef93640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f37c80d16b0 0x7f37c80d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.332+0000 7f37cef93640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f37c815d710 0x7f37c80ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.332+0000 7f37cef93640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c80d3cd0 0x7f37c80cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.332+0000 7f37cef93640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c80d1fd0 con 0x7f37c815d710 2023-12-04T10:45:34.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.332+0000 7f37cef93640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c80cef40 con 0x7f37c80d16b0 2023-12-04T10:45:34.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.332+0000 7f37cef93640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80b25c0 con 0x7f37c80d3cd0 2023-12-04T10:45:34.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.332+0000 7f37cd790640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f37c815d710 0x7f37c80ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37cd790640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f37c815d710 0x7f37c80ce6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55896/0 (socket says 172.21.15.63:55896) 2023-12-04T10:45:34.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37cd790640 1 -- 172.21.15.63:0/433431736 learned_addr learned my addr 172.21.15.63:0/433431736 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:34.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37ce792640 1 --2- 172.21.15.63:0/433431736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c80d3cd0 0x7f37c80cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37cdf91640 1 --2- 172.21.15.63:0/433431736 >> v2:172.21.15.66:3300/0 conn(0x7f37c80d16b0 0x7f37c80d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37cd790640 1 -- 172.21.15.63:0/433431736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c80d3cd0 msgr2=0x7f37c80cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:34.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37cd790640 1 --2- 172.21.15.63:0/433431736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c80d3cd0 0x7f37c80cf770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37cd790640 1 -- 172.21.15.63:0/433431736 >> v2:172.21.15.66:3300/0 conn(0x7f37c80d16b0 msgr2=0x7f37c80d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:34.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37cd790640 1 --2- 172.21.15.63:0/433431736 >> v2:172.21.15.66:3300/0 conn(0x7f37c80d16b0 0x7f37c80d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.333+0000 7f37cd790640 1 -- 172.21.15.63:0/433431736 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c80b28a0 con 0x7f37c815d710 2023-12-04T10:45:34.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.334+0000 7f37cd790640 1 --2- 172.21.15.63:0/433431736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c815d710 0x7f37c80ce6f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f37c808d840 tx=0x7f37bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9caa07d54b2af075 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:34.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.334+0000 7f37ccf8f640 1 -- 172.21.15.63:0/433431736 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc0317e0 con 0x7f37c815d710 2023-12-04T10:45:34.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.334+0000 7f37ccf8f640 1 -- 172.21.15.63:0/433431736 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc031940 con 0x7f37c815d710 2023-12-04T10:45:34.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.334+0000 7f37ccf8f640 1 -- 172.21.15.63:0/433431736 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc031cd0 con 0x7f37c815d710 2023-12-04T10:45:34.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 -- 172.21.15.63:0/433431736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c815d710 msgr2=0x7f37c80ce6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 --2- 172.21.15.63:0/433431736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c815d710 0x7f37c80ce6f0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f37c808d840 tx=0x7f37bc02b880 comp rx=0 tx=0).stop 2023-12-04T10:45:34.336 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 -- 172.21.15.63:0/433431736 shutdown_connections 2023-12-04T10:45:34.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 --2- 172.21.15.63:0/433431736 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c80d3cd0 0x7f37c80cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 --2- 172.21.15.63:0/433431736 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c815d710 0x7f37c80ce6f0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 --2- 172.21.15.63:0/433431736 >> v2:172.21.15.66:3300/0 conn(0x7f37c80d16b0 0x7f37c80d1a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 -- 172.21.15.63:0/433431736 >> 172.21.15.63:0/433431736 conn(0x7f37c80d30d0 msgr2=0x7f37c80d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:34.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 -- 172.21.15.63:0/433431736 shutdown_connections 2023-12-04T10:45:34.337 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.335+0000 7f37cef93640 1 -- 172.21.15.63:0/433431736 wait complete. 2023-12-04T10:45:34.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.337+0000 7f37cef93640 1 Processor -- start 2023-12-04T10:45:34.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.337+0000 7f37cef93640 1 -- start start 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.338+0000 7f37cef93640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c80d16b0 0x7f37c815b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.338+0000 7f37cef93640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c80d3cd0 0x7f37c815f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.338+0000 7f37cef93640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c815d710 0x7f37c814b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.338+0000 7f37cef93640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c815fcb0 con 0x7f37c80d3cd0 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.338+0000 7f37cef93640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c814be20 con 0x7f37c80d16b0 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.338+0000 7f37cef93640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c815fec0 con 0x7f37c815d710 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.338+0000 7f37cd790640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c80d3cd0 0x7f37c815f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cd790640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c80d3cd0 0x7f37c815f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55898/0 (socket says 172.21.15.63:55898) 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cd790640 1 -- 172.21.15.63:0/1614491044 learned_addr learned my addr 172.21.15.63:0/1614491044 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:34.340 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cdf91640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c80d16b0 0x7f37c815b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37ce792640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c815d710 0x7f37c814b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cd790640 1 -- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c815d710 msgr2=0x7f37c814b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cd790640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c815d710 0x7f37c814b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cd790640 1 -- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c80d16b0 msgr2=0x7f37c815b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cd790640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c80d16b0 0x7f37c815b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cd790640 1 -- 172.21.15.63:0/1614491044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37bc0094d0 con 0x7f37c80d3cd0 2023-12-04T10:45:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cdf91640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c80d16b0 0x7f37c815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:34.341 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.339+0000 7f37cd790640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c80d3cd0 0x7f37c815f770 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0090b0 tx=0x7f37bc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.340+0000 7f37c67fc640 1 -- 172.21.15.63:0/1614491044 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc032980 con 0x7f37c80d3cd0 2023-12-04T10:45:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.340+0000 7f37c67fc640 1 -- 172.21.15.63:0/1614491044 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37bc032ae0 con 0x7f37c80d3cd0 2023-12-04T10:45:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.340+0000 7f37c67fc640 1 -- 172.21.15.63:0/1614491044 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37bc032e90 con 0x7f37c80d3cd0 2023-12-04T10:45:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.340+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c81601a0 con 0x7f37c80d3cd0 2023-12-04T10:45:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.340+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c8160760 con 0x7f37c80d3cd0 2023-12-04T10:45:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.341+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c814bf90 con 0x7f37c80d3cd0 2023-12-04T10:45:34.342 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.342+0000 7f37c67fc640 1 -- 172.21.15.63:0/1614491044 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f37bc04d3f0 con 0x7f37c80d3cd0 2023-12-04T10:45:34.343 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.343+0000 7f37c67fc640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37b406ae40 0x7f37b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.343+0000 7f37c67fc640 1 -- 172.21.15.63:0/1614491044 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f37bc0ab6e0 con 0x7f37c80d3cd0 2023-12-04T10:45:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.343+0000 7f37cdf91640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37b406ae40 0x7f37b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.344 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.344+0000 7f37cdf91640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37b406ae40 0x7f37b406d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37c815c760 tx=0x7f37b8008470 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:34.348 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.347+0000 7f37c67fc640 1 -- 172.21.15.63:0/1614491044 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37bc0766f0 con 0x7f37c80d3cd0 2023-12-04T10:45:34.540 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.539+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37c804e840 con 0x7f37c80d3cd0 2023-12-04T10:45:34.543 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.542+0000 7f37c67fc640 1 -- 172.21.15.63:0/1614491044 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16715 (secure 0 0 0) 0x7f37bc079d10 con 0x7f37c80d3cd0 2023-12-04T10:45:34.544 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:34.544 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:45:33.539033+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:45:31.631954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-04T10:45:32.554948+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37b406ae40 msgr2=0x7f37b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37b406ae40 0x7f37b406d300 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f37c815c760 tx=0x7f37b8008470 comp rx=0 tx=0).stop 2023-12-04T10:45:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c80d3cd0 msgr2=0x7f37c815f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c80d3cd0 0x7f37c815f770 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f37bc0090b0 tx=0x7f37bc0046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.546 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 shutdown_connections 2023-12-04T10:45:34.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f37b406ae40 0x7f37b406d300 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f37c815d710 0x7f37c814b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f37c80d3cd0 0x7f37c815f770 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 --2- 172.21.15.63:0/1614491044 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f37c80d16b0 0x7f37c815b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 >> 172.21.15.63:0/1614491044 conn(0x7f37c80d30d0 msgr2=0x7f37c806c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:34.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 shutdown_connections 2023-12-04T10:45:34.547 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.545+0000 7f37cef93640 1 -- 172.21.15.63:0/1614491044 wait complete. 2023-12-04T10:45:34.565 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:34.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.782+0000 7f9c4132e640 1 Processor -- start 2023-12-04T10:45:34.783 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.782+0000 7f9c4132e640 1 -- start start 2023-12-04T10:45:34.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.783+0000 7f9c4132e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 0x7f9c3c168060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.783+0000 7f9c4132e640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c0cef40 con 0x7f9c3c15d710 2023-12-04T10:45:34.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.783+0000 7f9c4132e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c3c0b25c0 con 0x7f9c3c0d16b0 2023-12-04T10:45:34.784 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.783+0000 7f9c4132e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b28a0 con 0x7f9c3c0b4390 2023-12-04T10:45:34.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.784+0000 7f9c3b7fe640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f9c3c15d710 0x7f9c3c0ce6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58238/0 (socket says 172.21.15.63:58238) 2023-12-04T10:45:34.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.784+0000 7f9c3b7fe640 1 -- 172.21.15.63:0/10214466 learned_addr learned my addr 172.21.15.63:0/10214466 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:34.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.784+0000 7f9c40b2d640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 0x7f9c3c168060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.784+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680026765 0 0) 0x7f9c3c0cef40 con 0x7f9c3c15d710 2023-12-04T10:45:34.785 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.784+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c24003520 con 0x7f9c3c15d710 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.784+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2569468278 0 0) 0x7f9c24003520 con 0x7f9c3c15d710 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.784+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 msgr2=0x7f9c3c168060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.784+0000 7f9c3affd640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 0x7f9c3c168060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 >> v1:172.21.15.66:6789/0 conn(0x7f9c3c0d16b0 legacy=0x7f9c3c0d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c0b2b80 con 0x7f9c3c15d710 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7f9c30001670 con 0x7f9c3c15d710 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 >> v1:172.21.15.63:6789/0 conn(0x7f9c3c15d710 legacy=0x7f9c3c0ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c240039a0 0x7f9c24003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 0x7f9c240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c24005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0b28a0 con 0x7f9c24004d00 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2400bae0 con 0x7f9c240039a0 2023-12-04T10:45:34.787 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2400bca0 con 0x7f9c3c0b4390 2023-12-04T10:45:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c40b2d640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c24005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3b7fe640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 0x7f9c240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c40b2d640 1 -- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 msgr2=0x7f9c240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c40b2d640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 0x7f9c240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c40b2d640 1 -- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c240039a0 msgr2=0x7f9c24003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c40b2d640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c240039a0 0x7f9c24003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c40b2d640 1 -- 172.21.15.63:0/10214466 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c24003520 con 0x7f9c24004d00 2023-12-04T10:45:34.788 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.785+0000 7f9c3b7fe640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0b4390 0x7f9c240047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c40b2d640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c24005180 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009a90 tx=0x7f9c240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5afe86028c276828 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3402c680 con 0x7f9c24004d00 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3402c7e0 con 0x7f9c24004d00 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c3affd640 1 -- 172.21.15.63:0/10214466 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3402cb90 con 0x7f9c24004d00 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c4132e640 1 -- 172.21.15.63:0/10214466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 msgr2=0x7f9c24005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c4132e640 1 --2- 172.21.15.63:0/10214466 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c24005180 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009a90 tx=0x7f9c240057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c40b2d640 1 -- 172.21.15.63:0/10214466 reap_dead start 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c4132e640 1 -- 172.21.15.63:0/10214466 shutdown_connections 2023-12-04T10:45:34.789 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.787+0000 7f9c4132e640 1 -- 172.21.15.63:0/10214466 >> 172.21.15.63:0/10214466 conn(0x7f9c3c0d30d0 msgr2=0x7f9c3c0d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:34.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.788+0000 7f9c4132e640 1 -- 172.21.15.63:0/10214466 shutdown_connections 2023-12-04T10:45:34.790 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.788+0000 7f9c4132e640 1 -- 172.21.15.63:0/10214466 wait complete. 2023-12-04T10:45:34.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.789+0000 7f9c4132e640 1 Processor -- start 2023-12-04T10:45:34.791 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.790+0000 7f9c4132e640 1 -- start start 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.790+0000 7f9c4132e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c3c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.790+0000 7f9c4132e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0cc530 0x7f9c3c15e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c4132e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c3c0cc9b0 0x7f9c3c14f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c4132e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0ca1a0 con 0x7f9c24004d00 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c4132e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0ca3f0 con 0x7f9c3c0cc9b0 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c4132e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3c0ca6d0 con 0x7f9c3c0cc530 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c3c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c3c0c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55924/0 (socket says 172.21.15.63:55924) 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 -- 172.21.15.63:0/2399544314 learned_addr learned my addr 172.21.15.63:0/2399544314 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:34.794 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 -- 172.21.15.63:0/2399544314 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0cc530 msgr2=0x7f9c3c15e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0cc530 0x7f9c3c15e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 -- 172.21.15.63:0/2399544314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c3c0cc9b0 msgr2=0x7f9c3c14f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c3c0cc9b0 0x7f9c3c14f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 -- 172.21.15.63:0/2399544314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3c0ca9b0 con 0x7f9c24004d00 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.791+0000 7f9c3bfff640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c3c0c9460 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c870 tx=0x7f9c2c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.792+0000 7f9c38ff9640 1 -- 172.21.15.63:0/2399544314 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c003b70 con 0x7f9c24004d00 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.792+0000 7f9c38ff9640 1 -- 172.21.15.63:0/2399544314 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c003cd0 con 0x7f9c24004d00 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.792+0000 7f9c38ff9640 1 -- 172.21.15.63:0/2399544314 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00aa10 con 0x7f9c24004d00 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.792+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3c0cac90 con 0x7f9c24004d00 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.792+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3c15be70 con 0x7f9c24004d00 2023-12-04T10:45:34.795 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.793+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3c0ca810 con 0x7f9c24004d00 2023-12-04T10:45:34.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.794+0000 7f9c38ff9640 1 -- 172.21.15.63:0/2399544314 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c2c00ab70 con 0x7f9c24004d00 2023-12-04T10:45:34.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.795+0000 7f9c38ff9640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9c2806ae40 0x7f9c2806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:34.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.795+0000 7f9c38ff9640 1 -- 172.21.15.63:0/2399544314 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9c2c089620 con 0x7f9c24004d00 2023-12-04T10:45:34.796 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.795+0000 7f9c3b7fe640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9c2806ae40 0x7f9c2806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:34.797 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.796+0000 7f9c3b7fe640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9c2806ae40 0x7f9c2806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c30001eb0 tx=0x7f9c30009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:34.800 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.799+0000 7f9c38ff9640 1 -- 172.21.15.63:0/2399544314 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c3c0ca810 con 0x7f9c24004d00 2023-12-04T10:45:34.990 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.989+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c3c0ca810 con 0x7f9c24004d00 2023-12-04T10:45:34.991 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.991+0000 7f9c38ff9640 1 -- 172.21.15.63:0/2399544314 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+16715 (secure 0 0 0) 0x7f9c3c0ca810 con 0x7f9c24004d00 2023-12-04T10:45:34.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:34.992 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":40,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:45:33.539033+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:45:31.631954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-04T10:45:32.554948+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9c2806ae40 msgr2=0x7f9c2806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9c2806ae40 0x7f9c2806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9c30001eb0 tx=0x7f9c30009040 comp rx=0 tx=0).stop 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 msgr2=0x7f9c3c0c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c3c0c9460 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f9c2c00c870 tx=0x7f9c2c00cd30 comp rx=0 tx=0).stop 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 shutdown_connections 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9c2806ae40 0x7f9c2806d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9c3c0cc530 0x7f9c3c15e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9c3c0cc9b0 0x7f9c3c14f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 --2- 172.21.15.63:0/2399544314 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9c24004d00 0x7f9c3c0c9460 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:34.995 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.993+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 >> 172.21.15.63:0/2399544314 conn(0x7f9c3c0d30d0 msgr2=0x7f9c3c06c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:34.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.994+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 shutdown_connections 2023-12-04T10:45:34.996 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:34.994+0000 7f9c4132e640 1 -- 172.21.15.63:0/2399544314 wait complete. 2023-12-04T10:45:35.014 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-04T10:45:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.231+0000 7fe053a17640 1 Processor -- start 2023-12-04T10:45:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.231+0000 7fe053a17640 1 -- start start 2023-12-04T10:45:35.234 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.233+0000 7fe053a17640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe04c071f00 0x7fe04c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.233+0000 7fe053a17640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c0ca820 con 0x7fe04c0ce240 2023-12-04T10:45:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.233+0000 7fe053a17640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04c15d8e0 con 0x7fe04c15d500 2023-12-04T10:45:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.233+0000 7fe053a17640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe04c06aca0 con 0x7fe04c071f00 2023-12-04T10:45:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe051fb4640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fe04c0ce240 0x7fe04c0c5410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58248/0 (socket says 172.21.15.63:58248) 2023-12-04T10:45:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe051fb4640 1 -- 172.21.15.63:0/3222508601 learned_addr learned my addr 172.21.15.63:0/3222508601 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe050fb2640 1 --2- 172.21.15.63:0/3222508601 >> v2:172.21.15.66:3300/0 conn(0x7fe04c071f00 0x7fe04c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146214338 0 0) 0x7fe04c0ca820 con 0x7fe04c0ce240 2023-12-04T10:45:35.235 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe038003520 con 0x7fe04c0ce240 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059357811 0 0) 0x7fe038003520 con 0x7fe04c0ce240 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 >> v2:172.21.15.66:3300/0 conn(0x7fe04c071f00 msgr2=0x7fe04c0cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 --2- 172.21.15.63:0/3222508601 >> v2:172.21.15.66:3300/0 conn(0x7fe04c071f00 0x7fe04c0cb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 >> v1:172.21.15.66:6789/0 conn(0x7fe04c15d500 legacy=0x7fe04c06a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0caac0 con 0x7fe04c0ce240 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fe0440019f0 con 0x7fe04c0ce240 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.234+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 >> v1:172.21.15.63:6789/0 conn(0x7fe04c0ce240 legacy=0x7fe04c0c5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe043fff640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe038003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe043fff640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0380047c0 0x7fe038004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe043fff640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0380052a0 0x7fe03800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c06aca0 con 0x7fe038003970 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe03800c170 con 0x7fe0380047c0 2023-12-04T10:45:35.237 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe03800c330 con 0x7fe0380052a0 2023-12-04T10:45:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe0517b3640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe038003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe0517b3640 1 -- 172.21.15.63:0/3222508601 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0380052a0 msgr2=0x7fe03800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe0517b3640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0380052a0 0x7fe03800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe0517b3640 1 -- 172.21.15.63:0/3222508601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0380047c0 msgr2=0x7fe038004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe0517b3640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0380047c0 0x7fe038004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe0517b3640 1 -- 172.21.15.63:0/3222508601 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038003520 con 0x7fe038003970 2023-12-04T10:45:35.238 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.235+0000 7fe051fb4640 1 -- 172.21.15.63:0/3222508601 reap_dead start 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.236+0000 7fe0517b3640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe038003d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe048001720 tx=0x7fe0380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d1b543c060869d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.236+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0480052d0 con 0x7fe038003970 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe04802e050 con 0x7fe038003970 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe043fff640 1 -- 172.21.15.63:0/3222508601 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048003830 con 0x7fe038003970 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe053a17640 1 -- 172.21.15.63:0/3222508601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 msgr2=0x7fe038003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe053a17640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe038003d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe048001720 tx=0x7fe0380057f0 comp rx=0 tx=0).stop 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe053a17640 1 -- 172.21.15.63:0/3222508601 shutdown_connections 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe053a17640 1 --2- 172.21.15.63:0/3222508601 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe038003d90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:35.239 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe053a17640 1 -- 172.21.15.63:0/3222508601 >> 172.21.15.63:0/3222508601 conn(0x7fe04c0b1bb0 msgr2=0x7fe04c0b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:35.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe053a17640 1 -- 172.21.15.63:0/3222508601 shutdown_connections 2023-12-04T10:45:35.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.237+0000 7fe053a17640 1 -- 172.21.15.63:0/3222508601 wait complete. 2023-12-04T10:45:35.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.239+0000 7fe053a17640 1 Processor -- start 2023-12-04T10:45:35.240 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.239+0000 7fe053a17640 1 -- start start 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe053a17640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe04c1f24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe053a17640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe04c0b2d10 0x7fe04c0b5490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe053a17640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe04c0b59d0 0x7fe04c0b3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe053a17640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0c8cb0 con 0x7fe038003970 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe053a17640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0c8f90 con 0x7fe04c0b59d0 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe053a17640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe04c0c9270 con 0x7fe04c0b2d10 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe0517b3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe04c1f24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe0517b3640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe04c1f24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55946/0 (socket says 172.21.15.63:55946) 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.240+0000 7fe0517b3640 1 -- 172.21.15.63:0/630120209 learned_addr learned my addr 172.21.15.63:0/630120209 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:35.242 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe0517b3640 1 -- 172.21.15.63:0/630120209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe04c0b2d10 msgr2=0x7fe04c0b5490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:35.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe051fb4640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe04c0b59d0 0x7fe04c0b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:35.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe050fb2640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe04c0b2d10 0x7fe04c0b5490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:35.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe0517b3640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe04c0b2d10 0x7fe04c0b5490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:35.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe0517b3640 1 -- 172.21.15.63:0/630120209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe04c0b59d0 msgr2=0x7fe04c0b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:35.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe0517b3640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe04c0b59d0 0x7fe04c0b3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:35.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe0517b3640 1 -- 172.21.15.63:0/630120209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe04c0c9550 con 0x7fe038003970 2023-12-04T10:45:35.243 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe0517b3640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe04c1f24d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe04802bbc0 tx=0x7fe048001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:35.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe041ffb640 1 -- 172.21.15.63:0/630120209 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0480076c0 con 0x7fe038003970 2023-12-04T10:45:35.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe041ffb640 1 -- 172.21.15.63:0/630120209 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe048007a30 con 0x7fe038003970 2023-12-04T10:45:35.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe041ffb640 1 -- 172.21.15.63:0/630120209 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe048006be0 con 0x7fe038003970 2023-12-04T10:45:35.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.241+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe04c0c9830 con 0x7fe038003970 2023-12-04T10:45:35.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.242+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe04c1f2bf0 con 0x7fe038003970 2023-12-04T10:45:35.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.243+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe04c0c99c0 con 0x7fe038003970 2023-12-04T10:45:35.244 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.244+0000 7fe041ffb640 1 -- 172.21.15.63:0/630120209 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe048006d40 con 0x7fe038003970 2023-12-04T10:45:35.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.244+0000 7fe041ffb640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe03006ae40 0x7fe03006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:35.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.245+0000 7fe041ffb640 1 -- 172.21.15.63:0/630120209 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fe0480ab4e0 con 0x7fe038003970 2023-12-04T10:45:35.245 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.245+0000 7fe050fb2640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe03006ae40 0x7fe03006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:35.246 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.245+0000 7fe050fb2640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe03006ae40 0x7fe03006d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe03c006fd0 tx=0x7fe03c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:35.250 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.249+0000 7fe041ffb640 1 -- 172.21.15.63:0/630120209 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe048079e40 con 0x7fe038003970 2023-12-04T10:45:35.482 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:35.481+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe04c068710 con 0x7fe038003970 2023-12-04T10:45:36.112 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.110+0000 7fe041ffb640 1 -- 172.21.15.63:0/630120209 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe0480799d0 con 0x7fe038003970 2023-12-04T10:45:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe03006ae40 msgr2=0x7fe03006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe03006ae40 0x7fe03006d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe03c006fd0 tx=0x7fe03c008040 comp rx=0 tx=0).stop 2023-12-04T10:45:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 msgr2=0x7fe04c1f24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:36.115 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe04c1f24d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe04802bbc0 tx=0x7fe048001120 comp rx=0 tx=0).stop 2023-12-04T10:45:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 shutdown_connections 2023-12-04T10:45:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe03006ae40 0x7fe03006d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe04c0b2d10 0x7fe04c0b5490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe04c0b59d0 0x7fe04c0b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 --2- 172.21.15.63:0/630120209 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe038003970 0x7fe04c1f24d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.114+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 >> 172.21.15.63:0/630120209 conn(0x7fe04c0b1bb0 msgr2=0x7fe04c0b0af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.115+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 shutdown_connections 2023-12-04T10:45:36.116 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.115+0000 7fe053a17640 1 -- 172.21.15.63:0/630120209 wait complete. 2023-12-04T10:45:36.136 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-04T10:45:36.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-04T10:45:36.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.363+0000 7f843cb5c640 1 Processor -- start 2023-12-04T10:45:36.364 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.363+0000 7f843cb5c640 1 -- start start 2023-12-04T10:45:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.365+0000 7f843cb5c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438143ca0 0x7f84380b2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.365+0000 7f843cb5c640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f84380b3350 0x7f843806be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.365+0000 7f843cb5c640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84380cb800 con 0x7f8438144370 2023-12-04T10:45:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.365+0000 7f843cb5c640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84380cbae0 con 0x7f84380b3350 2023-12-04T10:45:36.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.365+0000 7f843cb5c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380cbdc0 con 0x7f8438143ca0 2023-12-04T10:45:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.365+0000 7f8437fff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f8438144370 0x7f843815ebe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58264/0 (socket says 172.21.15.63:58264) 2023-12-04T10:45:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.365+0000 7f8437fff640 1 -- 172.21.15.63:0/643931184 learned_addr learned my addr 172.21.15.63:0/643931184 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f84377fe640 1 --2- 172.21.15.63:0/643931184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438143ca0 0x7f84380b2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f842ffff640 1 --2- 172.21.15.63:0/643931184 >> v2:172.21.15.66:3300/0 conn(0x7f84380b3350 0x7f843806be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f8436ffd640 1 -- 172.21.15.63:0/643931184 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 340396656 0 0) 0x7f84380cb800 con 0x7f8438144370 2023-12-04T10:45:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f8436ffd640 1 -- 172.21.15.63:0/643931184 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8424003520 con 0x7f8438144370 2023-12-04T10:45:36.367 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f84377fe640 1 -- 172.21.15.63:0/643931184 >> v2:172.21.15.66:3300/0 conn(0x7f84380b3350 msgr2=0x7f843806be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:36.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f8436ffd640 1 -- 172.21.15.63:0/643931184 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4190801243 0 0) 0x7f8424003520 con 0x7f8438144370 2023-12-04T10:45:36.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f84377fe640 1 --2- 172.21.15.63:0/643931184 >> v2:172.21.15.66:3300/0 conn(0x7f84380b3350 0x7f843806be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f84377fe640 1 -- 172.21.15.63:0/643931184 >> v1:172.21.15.63:6789/0 conn(0x7f8438144370 legacy=0x7f843815ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:36.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.366+0000 7f84377fe640 1 -- 172.21.15.63:0/643931184 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84380b2610 con 0x7f8438143ca0 2023-12-04T10:45:36.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.368+0000 7f84377fe640 1 --2- 172.21.15.63:0/643931184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438143ca0 0x7f84380b2e10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84280097a0 tx=0x7f842802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64333f323028897a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.368+0000 7f8436ffd640 1 -- 172.21.15.63:0/643931184 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84300019f0 con 0x7f8438143ca0 2023-12-04T10:45:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.368+0000 7f8436ffd640 1 -- 172.21.15.63:0/643931184 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842802e050 con 0x7f8438143ca0 2023-12-04T10:45:36.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.368+0000 7f8436ffd640 1 -- 172.21.15.63:0/643931184 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8428030730 con 0x7f8438143ca0 2023-12-04T10:45:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.369+0000 7f843cb5c640 1 -- 172.21.15.63:0/643931184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438143ca0 msgr2=0x7f84380b2e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.369+0000 7f843cb5c640 1 --2- 172.21.15.63:0/643931184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438143ca0 0x7f84380b2e10 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f84280097a0 tx=0x7f842802b790 comp rx=0 tx=0).stop 2023-12-04T10:45:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.369+0000 7f843cb5c640 1 -- 172.21.15.63:0/643931184 shutdown_connections 2023-12-04T10:45:36.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.369+0000 7f843cb5c640 1 --2- 172.21.15.63:0/643931184 >> v2:172.21.15.66:3300/0 conn(0x7f84380b3350 0x7f843806be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.369+0000 7f843cb5c640 1 --2- 172.21.15.63:0/643931184 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438143ca0 0x7f84380b2e10 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.369+0000 7f843cb5c640 1 -- 172.21.15.63:0/643931184 >> 172.21.15.63:0/643931184 conn(0x7f84380b0860 msgr2=0x7f84380b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.369+0000 7f843cb5c640 1 -- 172.21.15.63:0/643931184 shutdown_connections 2023-12-04T10:45:36.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.369+0000 7f843cb5c640 1 -- 172.21.15.63:0/643931184 wait complete. 2023-12-04T10:45:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.371+0000 7f843cb5c640 1 Processor -- start 2023-12-04T10:45:36.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.371+0000 7f843cb5c640 1 -- start start 2023-12-04T10:45:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.372+0000 7f843cb5c640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84380b3350 0x7f843814d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.372+0000 7f843cb5c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8438143ca0 0x7f8438142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.372+0000 7f843cb5c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438144370 0x7f8438142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.372+0000 7f843cb5c640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843814dbc0 con 0x7f8438143ca0 2023-12-04T10:45:36.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.372+0000 7f843cb5c640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8438150c00 con 0x7f84380b3350 2023-12-04T10:45:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.372+0000 7f843cb5c640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843814dfc0 con 0x7f8438144370 2023-12-04T10:45:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.372+0000 7f842ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8438143ca0 0x7f8438142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f842ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8438143ca0 0x7f8438142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55956/0 (socket says 172.21.15.63:55956) 2023-12-04T10:45:36.374 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f842ffff640 1 -- 172.21.15.63:0/481288230 learned_addr learned my addr 172.21.15.63:0/481288230 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f8437fff640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438144370 0x7f8438142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f842ffff640 1 -- 172.21.15.63:0/481288230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438144370 msgr2=0x7f8438142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f842ffff640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438144370 0x7f8438142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f842ffff640 1 -- 172.21.15.63:0/481288230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84380b3350 msgr2=0x7f843814d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f842ffff640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84380b3350 0x7f843814d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f842ffff640 1 -- 172.21.15.63:0/481288230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8428009400 con 0x7f8438143ca0 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f8437fff640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438144370 0x7f8438142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.373+0000 7f842ffff640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8438143ca0 0x7f8438142610 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f842000e900 tx=0x7f842000edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:36.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.374+0000 7f8434ff9640 1 -- 172.21.15.63:0/481288230 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8420009660 con 0x7f8438143ca0 2023-12-04T10:45:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.374+0000 7f8434ff9640 1 -- 172.21.15.63:0/481288230 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842000ca00 con 0x7f8438143ca0 2023-12-04T10:45:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.374+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f843814e2a0 con 0x7f8438143ca0 2023-12-04T10:45:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.374+0000 7f8434ff9640 1 -- 172.21.15.63:0/481288230 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842000cd70 con 0x7f8438143ca0 2023-12-04T10:45:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.374+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843814fed0 con 0x7f8438143ca0 2023-12-04T10:45:36.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.375+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843804e840 con 0x7f8438143ca0 2023-12-04T10:45:36.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.376+0000 7f8434ff9640 1 -- 172.21.15.63:0/481288230 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8420013470 con 0x7f8438143ca0 2023-12-04T10:45:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.378+0000 7f8434ff9640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f841806ae40 0x7f841806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.378+0000 7f8434ff9640 1 -- 172.21.15.63:0/481288230 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8420089d70 con 0x7f8438143ca0 2023-12-04T10:45:36.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.378+0000 7f84377fe640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f841806ae40 0x7f841806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:36.380 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.379+0000 7f84377fe640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f841806ae40 0x7f841806d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8428034000 tx=0x7f842802d000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:36.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.383+0000 7f8434ff9640 1 -- 172.21.15.63:0/481288230 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8420054c50 con 0x7f8438143ca0 2023-12-04T10:45:36.617 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:36.616+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f843806db90 con 0x7f8438143ca0 2023-12-04T10:45:37.029 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T10:45:37.028+0000 7effe60dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-04T10:45:37.121 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.120+0000 7f8434ff9640 1 -- 172.21.15.63:0/481288230 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8420021020 con 0x7f8438143ca0 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f841806ae40 msgr2=0x7f841806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f841806ae40 0x7f841806d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8428034000 tx=0x7f842802d000 comp rx=0 tx=0).stop 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8438143ca0 msgr2=0x7f8438142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8438143ca0 0x7f8438142610 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f842000e900 tx=0x7f842000edc0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 shutdown_connections 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f841806ae40 0x7f841806d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f8438144370 0x7f8438142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f8438143ca0 0x7f8438142610 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.123+0000 7f843cb5c640 1 --2- 172.21.15.63:0/481288230 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f84380b3350 0x7f843814d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.124+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 >> 172.21.15.63:0/481288230 conn(0x7f84380b0860 msgr2=0x7f84380b1710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.124+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 shutdown_connections 2023-12-04T10:45:37.125 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.124+0000 7f843cb5c640 1 -- 172.21.15.63:0/481288230 wait complete. 2023-12-04T10:45:37.147 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-04T10:45:37.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:45:37.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.365+0000 7f0f84fcb640 1 Processor -- start 2023-12-04T10:45:37.366 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.365+0000 7f0f84fcb640 1 -- start start 2023-12-04T10:45:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.366+0000 7f0f84fcb640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0f80159640 0x7f0f80070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f84fcb640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f80071000 con 0x7f0f800c9ff0 2023-12-04T10:45:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f84fcb640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f800cd570 con 0x7f0f800cda00 2023-12-04T10:45:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f84fcb640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f80159a20 con 0x7f0f80159640 2023-12-04T10:45:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f7f7fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0f80159640 0x7f0f80070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f7f7fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f0f80159640 0x7f0f80070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55966/0 (socket says 172.21.15.63:55966) 2023-12-04T10:45:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f7ffff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f0f800c9ff0 0x7f0f8006c1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58266/0 (socket says 172.21.15.63:58266) 2023-12-04T10:45:37.368 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f7f7fe640 1 -- 172.21.15.63:0/366988092 learned_addr learned my addr 172.21.15.63:0/366988092 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:37.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f7f7fe640 1 -- 172.21.15.63:0/366988092 >> v1:172.21.15.66:6789/0 conn(0x7f0f800cda00 legacy=0x7f0f800c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:37.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f7f7fe640 1 -- 172.21.15.63:0/366988092 >> v1:172.21.15.63:6789/0 conn(0x7f0f800c9ff0 legacy=0x7f0f8006c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.368+0000 7f0f7f7fe640 1 -- 172.21.15.63:0/366988092 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f8006d400 con 0x7f0f80159640 2023-12-04T10:45:37.369 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.367+0000 7f0f7effd640 1 -- 172.21.15.63:0/366988092 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2330322725 0 0) 0x7f0f78001490 con 0x7f0f800c9ff0 2023-12-04T10:45:37.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.369+0000 7f0f7f7fe640 1 --2- 172.21.15.63:0/366988092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f80070ac0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000aa10 tx=0x7f0f7002ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b5dcfa22a71a51 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:37.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.369+0000 7f0f7effd640 1 -- 172.21.15.63:0/366988092 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7002dc10 con 0x7f0f80159640 2023-12-04T10:45:37.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.369+0000 7f0f7effd640 1 -- 172.21.15.63:0/366988092 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7002dd70 con 0x7f0f80159640 2023-12-04T10:45:37.370 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.369+0000 7f0f7effd640 1 -- 172.21.15.63:0/366988092 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f70035660 con 0x7f0f80159640 2023-12-04T10:45:37.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.369+0000 7f0f84fcb640 1 -- 172.21.15.63:0/366988092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 msgr2=0x7f0f80070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.369+0000 7f0f84fcb640 1 --2- 172.21.15.63:0/366988092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f80070ac0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0f7000aa10 tx=0x7f0f7002ce60 comp rx=0 tx=0).stop 2023-12-04T10:45:37.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.370+0000 7f0f84fcb640 1 -- 172.21.15.63:0/366988092 shutdown_connections 2023-12-04T10:45:37.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.370+0000 7f0f84fcb640 1 --2- 172.21.15.63:0/366988092 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f80070ac0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.370+0000 7f0f84fcb640 1 -- 172.21.15.63:0/366988092 >> 172.21.15.63:0/366988092 conn(0x7f0f800b07f0 msgr2=0x7f0f800b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:37.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.370+0000 7f0f84fcb640 1 -- 172.21.15.63:0/366988092 shutdown_connections 2023-12-04T10:45:37.371 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.370+0000 7f0f84fcb640 1 -- 172.21.15.63:0/366988092 wait complete. 2023-12-04T10:45:37.372 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.371+0000 7f0f84fcb640 1 Processor -- start 2023-12-04T10:45:37.373 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.372+0000 7f0f84fcb640 1 -- start start 2023-12-04T10:45:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f84fcb640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f800c9ff0 0x7f0f80149fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f84fcb640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f800cda00 0x7f0f800b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f84fcb640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f800b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f84fcb640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800c6b40 con 0x7f0f80159640 2023-12-04T10:45:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f84fcb640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800c6e20 con 0x7f0f800c9ff0 2023-12-04T10:45:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f84fcb640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f800c7100 con 0x7f0f800cda00 2023-12-04T10:45:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f800b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.375 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f800b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55980/0 (socket says 172.21.15.63:55980) 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7ffff640 1 -- 172.21.15.63:0/4265310238 learned_addr learned my addr 172.21.15.63:0/4265310238 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7ffff640 1 -- 172.21.15.63:0/4265310238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f800cda00 msgr2=0x7f0f800b3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7ffff640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f800cda00 0x7f0f800b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7ffff640 1 -- 172.21.15.63:0/4265310238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f800c9ff0 msgr2=0x7f0f80149fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7f7fe640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f800c9ff0 0x7f0f80149fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7ffff640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f800c9ff0 0x7f0f80149fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.373+0000 7f0f7ffff640 1 -- 172.21.15.63:0/4265310238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7000a670 con 0x7f0f80159640 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.374+0000 7f0f7ffff640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f800b3a40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c7d0 tx=0x7f0f7800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.374+0000 7f0f7cff9640 1 -- 172.21.15.63:0/4265310238 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800a640 con 0x7f0f80159640 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.374+0000 7f0f7cff9640 1 -- 172.21.15.63:0/4265310238 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7800a7c0 con 0x7f0f80159640 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.374+0000 7f0f7cff9640 1 -- 172.21.15.63:0/4265310238 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7800abb0 con 0x7f0f80159640 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.374+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f800c73e0 con 0x7f0f80159640 2023-12-04T10:45:37.376 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.374+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f8014a520 con 0x7f0f80159640 2023-12-04T10:45:37.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.375+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f800cde70 con 0x7f0f80159640 2023-12-04T10:45:37.377 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.376+0000 7f0f7cff9640 1 -- 172.21.15.63:0/4265310238 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f7800ad10 con 0x7f0f80159640 2023-12-04T10:45:37.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.378+0000 7f0f7cff9640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0f6006ae40 0x7f0f6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.378 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.378+0000 7f0f7cff9640 1 -- 172.21.15.63:0/4265310238 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f0f78088b20 con 0x7f0f80159640 2023-12-04T10:45:37.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.378+0000 7f0f7f7fe640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0f6006ae40 0x7f0f6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.379 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.379+0000 7f0f7f7fe640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0f6006ae40 0x7f0f6006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f70037000 tx=0x7f0f70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:37.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.382+0000 7f0f7cff9640 1 -- 172.21.15.63:0/4265310238 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f800cde70 con 0x7f0f80159640 2023-12-04T10:45:37.614 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.613+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0f800c7900 con 0x7f0f80159640 2023-12-04T10:45:37.615 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.614+0000 7f0f7cff9640 1 -- 172.21.15.63:0/4265310238 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4904 (secure 0 0 0) 0x7f0f800c7900 con 0x7f0f80159640 2023-12-04T10:45:37.615 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:37.615 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/879175015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":879175015},{"type":"v1","addr":"172.21.15.66:6834","nonce":879175015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2396111024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2396111024},{"type":"v1","addr":"172.21.15.66:6835","nonce":2396111024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/815330279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":815330279},{"type":"v1","addr":"172.21.15.63:6836","nonce":815330279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:45:33.539949+0000","modified":"2023-12-04T10:45:36.617364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6837/954829121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":954829121},{"type":"v1","addr":"172.21.15.63:6837","nonce":954829121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-04T10:45:37.616 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 18 2023-12-04T10:45:37.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0f6006ae40 msgr2=0x7f0f6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0f6006ae40 0x7f0f6006d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0f70037000 tx=0x7f0f70008040 comp rx=0 tx=0).stop 2023-12-04T10:45:37.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 msgr2=0x7f0f800b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f800b3a40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0f7800c7d0 tx=0x7f0f7800cc90 comp rx=0 tx=0).stop 2023-12-04T10:45:37.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 shutdown_connections 2023-12-04T10:45:37.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f0f6006ae40 0x7f0f6006d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f0f800cda00 0x7f0f800b3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.618 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f0f80159640 0x7f0f800b3a40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 --2- 172.21.15.63:0/4265310238 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0f800c9ff0 0x7f0f80149fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 >> 172.21.15.63:0/4265310238 conn(0x7f0f800b07f0 msgr2=0x7f0f8006ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:37.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 shutdown_connections 2023-12-04T10:45:37.619 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.617+0000 7f0f84fcb640 1 -- 172.21.15.63:0/4265310238 wait complete. 2023-12-04T10:45:37.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T10:45:37.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.856+0000 7f1508390640 1 Processor -- start 2023-12-04T10:45:37.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.856+0000 7f1508390640 1 -- start start 2023-12-04T10:45:37.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f1508390640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1500144a00 0x7f15000b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f1508390640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f15000701b0 0x7f15000705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f1508390640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 0x7f15000ca6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f1508390640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15000b2370 con 0x7f1500144a00 2023-12-04T10:45:37.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f1508390640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1500070b00 con 0x7f15000701b0 2023-12-04T10:45:37.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f1508390640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15000cabe0 con 0x7f15000ca290 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f150612c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1500144a00 0x7f15000b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f150612c640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f1500144a00 0x7f15000b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55988/0 (socket says 172.21.15.63:55988) 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.858+0000 7f150612c640 1 -- 172.21.15.63:0/3548963078 learned_addr learned my addr 172.21.15.63:0/3548963078 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.859+0000 7f150592b640 1 --2- 172.21.15.63:0/3548963078 >> v2:172.21.15.66:3300/0 conn(0x7f15000701b0 0x7f15000705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.859+0000 7f150692d640 1 --2- 172.21.15.63:0/3548963078 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 0x7f15000ca6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.859+0000 7f150612c640 1 -- 172.21.15.63:0/3548963078 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 msgr2=0x7f15000ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.859+0000 7f150612c640 1 --2- 172.21.15.63:0/3548963078 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 0x7f15000ca6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.859+0000 7f150612c640 1 -- 172.21.15.63:0/3548963078 >> v2:172.21.15.66:3300/0 conn(0x7f15000701b0 msgr2=0x7f15000705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:37.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.859+0000 7f150612c640 1 --2- 172.21.15.63:0/3548963078 >> v2:172.21.15.66:3300/0 conn(0x7f15000701b0 0x7f15000705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.859+0000 7f150612c640 1 -- 172.21.15.63:0/3548963078 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15000cae80 con 0x7f1500144a00 2023-12-04T10:45:37.861 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.861+0000 7f150612c640 1 --2- 172.21.15.63:0/3548963078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1500144a00 0x7f15000b1e30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f15000cb3d0 tx=0x7f14fc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e01fc3130a1a1d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:37.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.861+0000 7f150512a640 1 -- 172.21.15.63:0/3548963078 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc031870 con 0x7f1500144a00 2023-12-04T10:45:37.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.861+0000 7f150512a640 1 -- 172.21.15.63:0/3548963078 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc0319d0 con 0x7f1500144a00 2023-12-04T10:45:37.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.861+0000 7f150512a640 1 -- 172.21.15.63:0/3548963078 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc031d60 con 0x7f1500144a00 2023-12-04T10:45:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 -- 172.21.15.63:0/3548963078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1500144a00 msgr2=0x7f15000b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 --2- 172.21.15.63:0/3548963078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1500144a00 0x7f15000b1e30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f15000cb3d0 tx=0x7f14fc02b910 comp rx=0 tx=0).stop 2023-12-04T10:45:37.863 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 -- 172.21.15.63:0/3548963078 shutdown_connections 2023-12-04T10:45:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 --2- 172.21.15.63:0/3548963078 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 0x7f15000ca6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 --2- 172.21.15.63:0/3548963078 >> v2:172.21.15.66:3300/0 conn(0x7f15000701b0 0x7f15000705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 --2- 172.21.15.63:0/3548963078 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f1500144a00 0x7f15000b1e30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 -- 172.21.15.63:0/3548963078 >> 172.21.15.63:0/3548963078 conn(0x7f15000cee80 msgr2=0x7f15000cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 -- 172.21.15.63:0/3548963078 shutdown_connections 2023-12-04T10:45:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.862+0000 7f1508390640 1 -- 172.21.15.63:0/3548963078 wait complete. 2023-12-04T10:45:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.864+0000 7f1508390640 1 Processor -- start 2023-12-04T10:45:37.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.864+0000 7f1508390640 1 -- start start 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f1508390640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15000701b0 0x7f15001e4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f1508390640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 0x7f15000cda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f1508390640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500144a00 0x7f150013e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f1508390640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1500141c10 con 0x7f15000701b0 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f1508390640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f150013fb60 con 0x7f1500144a00 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f1508390640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15001f6a30 con 0x7f15000ca290 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f150612c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15000701b0 0x7f15001e4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f150612c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15000701b0 0x7f15001e4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55996/0 (socket says 172.21.15.63:55996) 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f150612c640 1 -- 172.21.15.63:0/1977363613 learned_addr learned my addr 172.21.15.63:0/1977363613 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f150692d640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500144a00 0x7f150013e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.865+0000 7f150592b640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 0x7f15000cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f150612c640 1 -- 172.21.15.63:0/1977363613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 msgr2=0x7f15000cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f150612c640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 0x7f15000cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f150612c640 1 -- 172.21.15.63:0/1977363613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500144a00 msgr2=0x7f150013e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f150612c640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500144a00 0x7f150013e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f150612c640 1 -- 172.21.15.63:0/1977363613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14fc0094d0 con 0x7f15000701b0 2023-12-04T10:45:37.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f150612c640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15000701b0 0x7f15001e4e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f14fc02b950 tx=0x7f14fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f14f6ffd640 1 -- 172.21.15.63:0/1977363613 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc03ad30 con 0x7f15000701b0 2023-12-04T10:45:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f14f6ffd640 1 -- 172.21.15.63:0/1977363613 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14fc0443f0 con 0x7f15000701b0 2023-12-04T10:45:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f14f6ffd640 1 -- 172.21.15.63:0/1977363613 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14fc0447a0 con 0x7f15000701b0 2023-12-04T10:45:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.866+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15001f6d10 con 0x7f15000701b0 2023-12-04T10:45:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.867+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15001f72d0 con 0x7f15000701b0 2023-12-04T10:45:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.868+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1500068710 con 0x7f15000701b0 2023-12-04T10:45:37.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.869+0000 7f14f6ffd640 1 -- 172.21.15.63:0/1977363613 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14fc04d450 con 0x7f15000701b0 2023-12-04T10:45:37.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.870+0000 7f14f6ffd640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f14e406ae40 0x7f14e406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:37.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.870+0000 7f14f6ffd640 1 -- 172.21.15.63:0/1977363613 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f14fc02d040 con 0x7f15000701b0 2023-12-04T10:45:37.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.870+0000 7f150592b640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f14e406ae40 0x7f14e406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:37.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.871+0000 7f150592b640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f14e406ae40 0x7f14e406d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1500141b70 tx=0x7f14f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:37.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:37.875+0000 7f14f6ffd640 1 -- 172.21.15.63:0/1977363613 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14fc076c70 con 0x7f15000701b0 2023-12-04T10:45:38.074 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.073+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f150006e2a0 con 0x7f15000701b0 2023-12-04T10:45:38.077 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.076+0000 7f14f6ffd640 1 -- 172.21.15.63:0/1977363613 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v41) v1 ==== 74+0+16702 (secure 0 0 0) 0x7f14fc035070 con 0x7f15000701b0 2023-12-04T10:45:38.077 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:38.077 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":41,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T10:45:35.070916+0000","last_up_change":"2023-12-04T10:43:45.304569+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:45:31.631954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-04T10:45:32.554948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists","up"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists","up"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f14e406ae40 msgr2=0x7f14e406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f14e406ae40 0x7f14e406d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1500141b70 tx=0x7f14f0008040 comp rx=0 tx=0).stop 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15000701b0 msgr2=0x7f15001e4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15000701b0 0x7f15001e4e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f14fc02b950 tx=0x7f14fc0046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 shutdown_connections 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f14e406ae40 0x7f14e406d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f15000ca290 0x7f15000cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1500144a00 0x7f150013e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.080 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 --2- 172.21.15.63:0/1977363613 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f15000701b0 0x7f15001e4e20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 >> 172.21.15.63:0/1977363613 conn(0x7f15000cee80 msgr2=0x7f15000cb900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:38.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 shutdown_connections 2023-12-04T10:45:38.081 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.079+0000 7f1508390640 1 -- 172.21.15.63:0/1977363613 wait complete. 2023-12-04T10:45:38.100 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-04T10:45:38.100 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T10:45:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.319+0000 7f6343fff640 1 Processor -- start 2023-12-04T10:45:38.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.319+0000 7f6343fff640 1 -- start start 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.320+0000 7f6343fff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63440d16b0 0x7f63440d1a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.320+0000 7f6343fff640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f634415d710 0x7f63440ce6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f6343fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440cf770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f6343fff640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440d1fd0 con 0x7f63440d16b0 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f6343fff640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440cef40 con 0x7f634415d710 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f6343fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63440b25c0 con 0x7f63440d3cd0 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f6342ffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63440d16b0 0x7f63440d1a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f6342ffd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f63440d16b0 0x7f63440d1a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55998/0 (socket says 172.21.15.63:55998) 2023-12-04T10:45:38.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f6342ffd640 1 -- 172.21.15.63:0/2541382479 learned_addr learned my addr 172.21.15.63:0/2541382479 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:38.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f63437fe640 1 --2- 172.21.15.63:0/2541382479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440cf770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.321+0000 7f63427fc640 1 --2- 172.21.15.63:0/2541382479 >> v2:172.21.15.66:3300/0 conn(0x7f634415d710 0x7f63440ce6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.322+0000 7f6342ffd640 1 -- 172.21.15.63:0/2541382479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 msgr2=0x7f63440cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:38.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.322+0000 7f6342ffd640 1 --2- 172.21.15.63:0/2541382479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440cf770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.322+0000 7f6342ffd640 1 -- 172.21.15.63:0/2541382479 >> v2:172.21.15.66:3300/0 conn(0x7f634415d710 msgr2=0x7f63440ce6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:38.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.322+0000 7f6342ffd640 1 --2- 172.21.15.63:0/2541382479 >> v2:172.21.15.66:3300/0 conn(0x7f634415d710 0x7f63440ce6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.322+0000 7f6342ffd640 1 -- 172.21.15.63:0/2541382479 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440b28a0 con 0x7f63440d16b0 2023-12-04T10:45:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.323+0000 7f6342ffd640 1 --2- 172.21.15.63:0/2541382479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440d1a90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f634408c0a0 tx=0x7f633402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88bcfca83befa74 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.323+0000 7f6341ffb640 1 -- 172.21.15.63:0/2541382479 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633402c9f0 con 0x7f63440d16b0 2023-12-04T10:45:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.323+0000 7f6341ffb640 1 -- 172.21.15.63:0/2541382479 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633402cb50 con 0x7f63440d16b0 2023-12-04T10:45:38.324 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.323+0000 7f6341ffb640 1 -- 172.21.15.63:0/2541382479 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63340343f0 con 0x7f63440d16b0 2023-12-04T10:45:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 -- 172.21.15.63:0/2541382479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 msgr2=0x7f63440d1a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 --2- 172.21.15.63:0/2541382479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440d1a90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f634408c0a0 tx=0x7f633402be50 comp rx=0 tx=0).stop 2023-12-04T10:45:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 -- 172.21.15.63:0/2541382479 shutdown_connections 2023-12-04T10:45:38.325 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 --2- 172.21.15.63:0/2541382479 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440cf770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 --2- 172.21.15.63:0/2541382479 >> v2:172.21.15.66:3300/0 conn(0x7f634415d710 0x7f63440ce6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 --2- 172.21.15.63:0/2541382479 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440d1a90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 -- 172.21.15.63:0/2541382479 >> 172.21.15.63:0/2541382479 conn(0x7f63440d30d0 msgr2=0x7f63440d34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:38.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 -- 172.21.15.63:0/2541382479 shutdown_connections 2023-12-04T10:45:38.326 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.324+0000 7f6343fff640 1 -- 172.21.15.63:0/2541382479 wait complete. 2023-12-04T10:45:38.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.327+0000 7f6343fff640 1 Processor -- start 2023-12-04T10:45:38.328 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.327+0000 7f6343fff640 1 -- start start 2023-12-04T10:45:38.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.328+0000 7f6343fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440c8c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.329 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.328+0000 7f6343fff640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440b68c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.328+0000 7f6343fff640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f634415d710 0x7f634414f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.328+0000 7f6343fff640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634415dc50 con 0x7f63440d16b0 2023-12-04T10:45:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.328+0000 7f6343fff640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f634415df30 con 0x7f634415d710 2023-12-04T10:45:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.328+0000 7f6343fff640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634415e210 con 0x7f63440d3cd0 2023-12-04T10:45:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.328+0000 7f6342ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440c8c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.328+0000 7f6342ffd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440c8c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56000/0 (socket says 172.21.15.63:56000) 2023-12-04T10:45:38.330 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f6342ffd640 1 -- 172.21.15.63:0/43474445 learned_addr learned my addr 172.21.15.63:0/43474445 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f63427fc640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440b68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f63437fe640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f634415d710 0x7f634414f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f6342ffd640 1 -- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 msgr2=0x7f63440b68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f6342ffd640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440b68c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f6342ffd640 1 -- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f634415d710 msgr2=0x7f634414f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f6342ffd640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f634415d710 0x7f634414f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.331 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f6342ffd640 1 -- 172.21.15.63:0/43474445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6334009b30 con 0x7f63440d16b0 2023-12-04T10:45:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f63427fc640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.329+0000 7f6342ffd640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440c8c90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6334000f80 tx=0x7f6334004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.330+0000 7f633bfff640 1 -- 172.21.15.63:0/43474445 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334009510 con 0x7f63440d16b0 2023-12-04T10:45:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.330+0000 7f633bfff640 1 -- 172.21.15.63:0/43474445 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633403e450 con 0x7f63440d16b0 2023-12-04T10:45:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.330+0000 7f633bfff640 1 -- 172.21.15.63:0/43474445 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633403e800 con 0x7f63440d16b0 2023-12-04T10:45:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.330+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f634415e4f0 con 0x7f63440d16b0 2023-12-04T10:45:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.330+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63440c91d0 con 0x7f63440d16b0 2023-12-04T10:45:38.332 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.331+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63440c9360 con 0x7f63440d16b0 2023-12-04T10:45:38.333 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.332+0000 7f633bfff640 1 -- 172.21.15.63:0/43474445 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f633403e960 con 0x7f63440d16b0 2023-12-04T10:45:38.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.333+0000 7f633bfff640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f632406ae40 0x7f632406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.333+0000 7f633bfff640 1 -- 172.21.15.63:0/43474445 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f63340ac580 con 0x7f63440d16b0 2023-12-04T10:45:38.334 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.333+0000 7f63427fc640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f632406ae40 0x7f632406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.335 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.334+0000 7f63427fc640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f632406ae40 0x7f632406d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f632c006fd0 tx=0x7f632c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:38.338 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.337+0000 7f633bfff640 1 -- 172.21.15.63:0/43474445 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f63340774e0 con 0x7f63440d16b0 2023-12-04T10:45:38.531 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.530+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 --> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63440cec30 con 0x7f632406ae40 2023-12-04T10:45:38.549 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.548+0000 7f633bfff640 1 -- 172.21.15.63:0/43474445 <== mgr.4107 v2:172.21.15.63:6832/2779630096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286565 (secure 0 0 0) 0x7f632c009530 con 0x7f632406ae40 2023-12-04T10:45:38.553 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:38.555 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.553+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f632406ae40 msgr2=0x7f632406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.553+0000 7f6343fff640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f632406ae40 0x7f632406d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f632c006fd0 tx=0x7f632c008040 comp rx=0 tx=0).stop 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 msgr2=0x7f63440c8c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440c8c90 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f6334000f80 tx=0x7f6334004a40 comp rx=0 tx=0).stop 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 shutdown_connections 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f632406ae40 0x7f632406d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f63440d3cd0 0x7f63440b68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f634415d710 0x7f634414f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.558 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 --2- 172.21.15.63:0/43474445 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f63440d16b0 0x7f63440c8c90 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 >> 172.21.15.63:0/43474445 conn(0x7f63440d30d0 msgr2=0x7f63440cf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:38.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 shutdown_connections 2023-12-04T10:45:38.560 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.554+0000 7f6343fff640 1 -- 172.21.15.63:0/43474445 wait complete. 2023-12-04T10:45:38.575 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-12-04T10:45:38.000663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225196,"kb_used_data":4836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749524,"statfs":{"total":773094113280,"available":772863512576,"internally_reserved":0,"allocated":4952064,"data_stored":2770936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.954666"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085578+0000","last_change":"2023-12-04T10:45:34.100693+0000","last_active":"2023-12-04T10:45:35.085578+0000","last_peered":"2023-12-04T10:45:35.085578+0000","last_clean":"2023-12-04T10:45:35.085578+0000","last_became_active":"2023-12-04T10:45:34.100365+0000","last_became_peered":"2023-12-04T10:45:34.100365+0000","last_unstale":"2023-12-04T10:45:35.085578+0000","last_undegraded":"2023-12-04T10:45:35.085578+0000","last_fullsized":"2023-12-04T10:45:35.085578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:53:22.050103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085116+0000","last_change":"2023-12-04T10:45:34.108738+0000","last_active":"2023-12-04T10:45:35.085116+0000","last_peered":"2023-12-04T10:45:35.085116+0000","last_clean":"2023-12-04T10:45:35.085116+0000","last_became_active":"2023-12-04T10:45:34.108390+0000","last_became_peered":"2023-12-04T10:45:34.108390+0000","last_unstale":"2023-12-04T10:45:35.085116+0000","last_undegraded":"2023-12-04T10:45:35.085116+0000","last_fullsized":"2023-12-04T10:45:35.085116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:56:02.526424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130545+0000","last_change":"2023-12-04T10:45:34.128275+0000","last_active":"2023-12-04T10:45:35.130545+0000","last_peered":"2023-12-04T10:45:35.130545+0000","last_clean":"2023-12-04T10:45:35.130545+0000","last_became_active":"2023-12-04T10:45:34.127723+0000","last_became_peered":"2023-12-04T10:45:34.127723+0000","last_unstale":"2023-12-04T10:45:35.130545+0000","last_undegraded":"2023-12-04T10:45:35.130545+0000","last_fullsized":"2023-12-04T10:45:35.130545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:46:48.342189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.113104+0000","last_change":"2023-12-04T10:45:34.107644+0000","last_active":"2023-12-04T10:45:34.113104+0000","last_peered":"2023-12-04T10:45:34.113104+0000","last_clean":"2023-12-04T10:45:34.113104+0000","last_became_active":"2023-12-04T10:45:34.107322+0000","last_became_peered":"2023-12-04T10:45:34.107322+0000","last_unstale":"2023-12-04T10:45:34.113104+0000","last_undegraded":"2023-12-04T10:45:34.113104+0000","last_fullsized":"2023-12-04T10:45:34.113104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:41:56.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.110131+0000","last_change":"2023-12-04T10:45:34.106968+0000","last_active":"2023-12-04T10:45:34.110131+0000","last_peered":"2023-12-04T10:45:34.110131+0000","last_clean":"2023-12-04T10:45:34.110131+0000","last_became_active":"2023-12-04T10:45:34.106709+0000","last_became_peered":"2023-12-04T10:45:34.106709+0000","last_unstale":"2023-12-04T10:45:34.110131+0000","last_undegraded":"2023-12-04T10:45:34.110131+0000","last_fullsized":"2023-12-04T10:45:34.110131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:48:57.597937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.112788+0000","last_change":"2023-12-04T10:45:34.103695+0000","last_active":"2023-12-04T10:45:34.112788+0000","last_peered":"2023-12-04T10:45:34.112788+0000","last_clean":"2023-12-04T10:45:34.112788+0000","last_became_active":"2023-12-04T10:45:34.103398+0000","last_became_peered":"2023-12-04T10:45:34.103398+0000","last_unstale":"2023-12-04T10:45:34.112788+0000","last_undegraded":"2023-12-04T10:45:34.112788+0000","last_fullsized":"2023-12-04T10:45:34.112788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:50:24.778209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089074+0000","last_change":"2023-12-04T10:45:34.119742+0000","last_active":"2023-12-04T10:45:35.089074+0000","last_peered":"2023-12-04T10:45:35.089074+0000","last_clean":"2023-12-04T10:45:35.089074+0000","last_became_active":"2023-12-04T10:45:34.119402+0000","last_became_peered":"2023-12-04T10:45:34.119402+0000","last_unstale":"2023-12-04T10:45:35.089074+0000","last_undegraded":"2023-12-04T10:45:35.089074+0000","last_fullsized":"2023-12-04T10:45:35.089074+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:50:48.159119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084323+0000","last_change":"2023-12-04T10:45:34.119084+0000","last_active":"2023-12-04T10:45:35.084323+0000","last_peered":"2023-12-04T10:45:35.084323+0000","last_clean":"2023-12-04T10:45:35.084323+0000","last_became_active":"2023-12-04T10:45:34.118661+0000","last_became_peered":"2023-12-04T10:45:34.118661+0000","last_unstale":"2023-12-04T10:45:35.084323+0000","last_undegraded":"2023-12-04T10:45:35.084323+0000","last_fullsized":"2023-12-04T10:45:35.084323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:50:48.159119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130783+0000","last_change":"2023-12-04T10:45:34.121264+0000","last_active":"2023-12-04T10:45:35.130783+0000","last_peered":"2023-12-04T10:45:35.130783+0000","last_clean":"2023-12-04T10:45:35.130783+0000","last_became_active":"2023-12-04T10:45:34.119746+0000","last_became_peered":"2023-12-04T10:45:34.119746+0000","last_unstale":"2023-12-04T10:45:35.130783+0000","last_undegraded":"2023-12-04T10:45:35.130783+0000","last_fullsized":"2023-12-04T10:45:35.130783+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:42:20.988056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091346+0000","last_change":"2023-12-04T10:45:34.126223+0000","last_active":"2023-12-04T10:45:35.091346+0000","last_peered":"2023-12-04T10:45:35.091346+0000","last_clean":"2023-12-04T10:45:35.091346+0000","last_became_active":"2023-12-04T10:45:34.125917+0000","last_became_peered":"2023-12-04T10:45:34.125917+0000","last_unstale":"2023-12-04T10:45:35.091346+0000","last_undegraded":"2023-12-04T10:45:35.091346+0000","last_fullsized":"2023-12-04T10:45:35.091346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:53:22.050103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090361+0000","last_change":"2023-12-04T10:45:34.122262+0000","last_active":"2023-12-04T10:45:35.090361+0000","last_peered":"2023-12-04T10:45:35.090361+0000","last_clean":"2023-12-04T10:45:35.090361+0000","last_became_active":"2023-12-04T10:45:34.121205+0000","last_became_peered":"2023-12-04T10:45:34.121205+0000","last_unstale":"2023-12-04T10:45:35.090361+0000","last_undegraded":"2023-12-04T10:45:35.090361+0000","last_fullsized":"2023-12-04T10:45:35.090361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:27:43.683219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130684+0000","last_change":"2023-12-04T10:45:34.117818+0000","last_active":"2023-12-04T10:45:35.130684+0000","last_peered":"2023-12-04T10:45:35.130684+0000","last_clean":"2023-12-04T10:45:35.130684+0000","last_became_active":"2023-12-04T10:45:34.117155+0000","last_became_peered":"2023-12-04T10:45:34.117155+0000","last_unstale":"2023-12-04T10:45:35.130684+0000","last_undegraded":"2023-12-04T10:45:35.130684+0000","last_fullsized":"2023-12-04T10:45:35.130684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:07:41.161586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089360+0000","last_change":"2023-12-04T10:45:34.125096+0000","last_active":"2023-12-04T10:45:35.089360+0000","last_peered":"2023-12-04T10:45:35.089360+0000","last_clean":"2023-12-04T10:45:35.089360+0000","last_became_active":"2023-12-04T10:45:34.124808+0000","last_became_peered":"2023-12-04T10:45:34.124808+0000","last_unstale":"2023-12-04T10:45:35.089360+0000","last_undegraded":"2023-12-04T10:45:35.089360+0000","last_fullsized":"2023-12-04T10:45:35.089360+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:17.785361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.106286+0000","last_change":"2023-12-04T10:45:34.100930+0000","last_active":"2023-12-04T10:45:34.106286+0000","last_peered":"2023-12-04T10:45:34.106286+0000","last_clean":"2023-12-04T10:45:34.106286+0000","last_became_active":"2023-12-04T10:45:34.100209+0000","last_became_peered":"2023-12-04T10:45:34.100209+0000","last_unstale":"2023-12-04T10:45:34.106286+0000","last_undegraded":"2023-12-04T10:45:34.106286+0000","last_fullsized":"2023-12-04T10:45:34.106286+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:29:32.254118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089076+0000","last_change":"2023-12-04T10:45:34.130538+0000","last_active":"2023-12-04T10:45:35.089076+0000","last_peered":"2023-12-04T10:45:35.089076+0000","last_clean":"2023-12-04T10:45:35.089076+0000","last_became_active":"2023-12-04T10:45:34.127618+0000","last_became_peered":"2023-12-04T10:45:34.127618+0000","last_unstale":"2023-12-04T10:45:35.089076+0000","last_undegraded":"2023-12-04T10:45:35.089076+0000","last_fullsized":"2023-12-04T10:45:35.089076+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:53:36.311196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132415+0000","last_change":"2023-12-04T10:45:34.128785+0000","last_active":"2023-12-04T10:45:35.132415+0000","last_peered":"2023-12-04T10:45:35.132415+0000","last_clean":"2023-12-04T10:45:35.132415+0000","last_became_active":"2023-12-04T10:45:34.128451+0000","last_became_peered":"2023-12-04T10:45:34.128451+0000","last_unstale":"2023-12-04T10:45:35.132415+0000","last_undegraded":"2023-12-04T10:45:35.132415+0000","last_fullsized":"2023-12-04T10:45:35.132415+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:42:20.988056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.135256+0000","last_change":"2023-12-04T10:45:34.119944+0000","last_active":"2023-12-04T10:45:35.135256+0000","last_peered":"2023-12-04T10:45:35.135256+0000","last_clean":"2023-12-04T10:45:35.135256+0000","last_became_active":"2023-12-04T10:45:34.119644+0000","last_became_peered":"2023-12-04T10:45:34.119644+0000","last_unstale":"2023-12-04T10:45:35.135256+0000","last_undegraded":"2023-12-04T10:45:35.135256+0000","last_fullsized":"2023-12-04T10:45:35.135256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:17.785361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133288+0000","last_change":"2023-12-04T10:45:34.110492+0000","last_active":"2023-12-04T10:45:35.133288+0000","last_peered":"2023-12-04T10:45:35.133288+0000","last_clean":"2023-12-04T10:45:35.133288+0000","last_became_active":"2023-12-04T10:45:34.110205+0000","last_became_peered":"2023-12-04T10:45:34.110205+0000","last_unstale":"2023-12-04T10:45:35.133288+0000","last_undegraded":"2023-12-04T10:45:35.133288+0000","last_fullsized":"2023-12-04T10:45:35.133288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:21.490281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.109544+0000","last_change":"2023-12-04T10:45:34.104502+0000","last_active":"2023-12-04T10:45:34.109544+0000","last_peered":"2023-12-04T10:45:34.109544+0000","last_clean":"2023-12-04T10:45:34.109544+0000","last_became_active":"2023-12-04T10:45:34.104198+0000","last_became_peered":"2023-12-04T10:45:34.104198+0000","last_unstale":"2023-12-04T10:45:34.109544+0000","last_undegraded":"2023-12-04T10:45:34.109544+0000","last_fullsized":"2023-12-04T10:45:34.109544+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:54:07.424272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133080+0000","last_change":"2023-12-04T10:45:34.103523+0000","last_active":"2023-12-04T10:45:35.133080+0000","last_peered":"2023-12-04T10:45:35.133080+0000","last_clean":"2023-12-04T10:45:35.133080+0000","last_became_active":"2023-12-04T10:45:34.103009+0000","last_became_peered":"2023-12-04T10:45:34.103009+0000","last_unstale":"2023-12-04T10:45:35.133080+0000","last_undegraded":"2023-12-04T10:45:35.133080+0000","last_fullsized":"2023-12-04T10:45:35.133080+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:47:18.394455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089745+0000","last_change":"2023-12-04T10:45:34.128919+0000","last_active":"2023-12-04T10:45:35.089745+0000","last_peered":"2023-12-04T10:45:35.089745+0000","last_clean":"2023-12-04T10:45:35.089745+0000","last_became_active":"2023-12-04T10:45:34.128638+0000","last_became_peered":"2023-12-04T10:45:34.128638+0000","last_unstale":"2023-12-04T10:45:35.089745+0000","last_undegraded":"2023-12-04T10:45:35.089745+0000","last_fullsized":"2023-12-04T10:45:35.089745+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:39:15.362938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.112209+0000","last_change":"2023-12-04T10:45:34.105881+0000","last_active":"2023-12-04T10:45:34.112209+0000","last_peered":"2023-12-04T10:45:34.112209+0000","last_clean":"2023-12-04T10:45:34.112209+0000","last_became_active":"2023-12-04T10:45:34.105414+0000","last_became_peered":"2023-12-04T10:45:34.105414+0000","last_unstale":"2023-12-04T10:45:34.112209+0000","last_undegraded":"2023-12-04T10:45:34.112209+0000","last_fullsized":"2023-12-04T10:45:34.112209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:23:36.342055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132906+0000","last_change":"2023-12-04T10:45:34.118048+0000","last_active":"2023-12-04T10:45:35.132906+0000","last_peered":"2023-12-04T10:45:35.132906+0000","last_clean":"2023-12-04T10:45:35.132906+0000","last_became_active":"2023-12-04T10:45:34.117742+0000","last_became_peered":"2023-12-04T10:45:34.117742+0000","last_unstale":"2023-12-04T10:45:35.132906+0000","last_undegraded":"2023-12-04T10:45:35.132906+0000","last_fullsized":"2023-12-04T10:45:35.132906+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:57:59.767141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.118839+0000","last_change":"2023-12-04T10:45:34.112570+0000","last_active":"2023-12-04T10:45:34.118839+0000","last_peered":"2023-12-04T10:45:34.118839+0000","last_clean":"2023-12-04T10:45:34.118839+0000","last_became_active":"2023-12-04T10:45:34.112178+0000","last_became_peered":"2023-12-04T10:45:34.112178+0000","last_unstale":"2023-12-04T10:45:34.118839+0000","last_undegraded":"2023-12-04T10:45:34.118839+0000","last_fullsized":"2023-12-04T10:45:34.118839+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:09:46.713133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133675+0000","last_change":"2023-12-04T10:45:34.104233+0000","last_active":"2023-12-04T10:45:35.133675+0000","last_peered":"2023-12-04T10:45:35.133675+0000","last_clean":"2023-12-04T10:45:35.133675+0000","last_became_active":"2023-12-04T10:45:34.101572+0000","last_became_peered":"2023-12-04T10:45:34.101572+0000","last_unstale":"2023-12-04T10:45:35.133675+0000","last_undegraded":"2023-12-04T10:45:35.133675+0000","last_fullsized":"2023-12-04T10:45:35.133675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:41:39.912748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.127831+0000","last_change":"2023-12-04T10:45:34.121111+0000","last_active":"2023-12-04T10:45:34.127831+0000","last_peered":"2023-12-04T10:45:34.127831+0000","last_clean":"2023-12-04T10:45:34.127831+0000","last_became_active":"2023-12-04T10:45:34.120833+0000","last_became_peered":"2023-12-04T10:45:34.120833+0000","last_unstale":"2023-12-04T10:45:34.127831+0000","last_undegraded":"2023-12-04T10:45:34.127831+0000","last_fullsized":"2023-12-04T10:45:34.127831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:36:43.746710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133506+0000","last_change":"2023-12-04T10:45:34.108936+0000","last_active":"2023-12-04T10:45:35.133506+0000","last_peered":"2023-12-04T10:45:35.133506+0000","last_clean":"2023-12-04T10:45:35.133506+0000","last_became_active":"2023-12-04T10:45:34.108532+0000","last_became_peered":"2023-12-04T10:45:34.108532+0000","last_unstale":"2023-12-04T10:45:35.133506+0000","last_undegraded":"2023-12-04T10:45:35.133506+0000","last_fullsized":"2023-12-04T10:45:35.133506+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:55.351864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090591+0000","last_change":"2023-12-04T10:45:34.121308+0000","last_active":"2023-12-04T10:45:35.090591+0000","last_peered":"2023-12-04T10:45:35.090591+0000","last_clean":"2023-12-04T10:45:35.090591+0000","last_became_active":"2023-12-04T10:45:34.119719+0000","last_became_peered":"2023-12-04T10:45:34.119719+0000","last_unstale":"2023-12-04T10:45:35.090591+0000","last_undegraded":"2023-12-04T10:45:35.090591+0000","last_fullsized":"2023-12-04T10:45:35.090591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:56:02.526424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132515+0000","last_change":"2023-12-04T10:45:34.106557+0000","last_active":"2023-12-04T10:45:35.132515+0000","last_peered":"2023-12-04T10:45:35.132515+0000","last_clean":"2023-12-04T10:45:35.132515+0000","last_became_active":"2023-12-04T10:45:34.106232+0000","last_became_peered":"2023-12-04T10:45:34.106232+0000","last_unstale":"2023-12-04T10:45:35.132515+0000","last_undegraded":"2023-12-04T10:45:35.132515+0000","last_fullsized":"2023-12-04T10:45:35.132515+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:05:54.353270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132280+0000","last_change":"2023-12-04T10:45:34.103829+0000","last_active":"2023-12-04T10:45:35.132280+0000","last_peered":"2023-12-04T10:45:35.132280+0000","last_clean":"2023-12-04T10:45:35.132280+0000","last_became_active":"2023-12-04T10:45:34.102582+0000","last_became_peered":"2023-12-04T10:45:34.102582+0000","last_unstale":"2023-12-04T10:45:35.132280+0000","last_undegraded":"2023-12-04T10:45:35.132280+0000","last_fullsized":"2023-12-04T10:45:35.132280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:15:29.038889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133651+0000","last_change":"2023-12-04T10:45:34.121263+0000","last_active":"2023-12-04T10:45:35.133651+0000","last_peered":"2023-12-04T10:45:35.133651+0000","last_clean":"2023-12-04T10:45:35.133651+0000","last_became_active":"2023-12-04T10:45:34.120648+0000","last_became_peered":"2023-12-04T10:45:34.120648+0000","last_unstale":"2023-12-04T10:45:35.133651+0000","last_undegraded":"2023-12-04T10:45:35.133651+0000","last_fullsized":"2023-12-04T10:45:35.133651+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:54:25.846936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.116085+0000","last_change":"2023-12-04T10:45:34.110770+0000","last_active":"2023-12-04T10:45:34.116085+0000","last_peered":"2023-12-04T10:45:34.116085+0000","last_clean":"2023-12-04T10:45:34.116085+0000","last_became_active":"2023-12-04T10:45:34.110427+0000","last_became_peered":"2023-12-04T10:45:34.110427+0000","last_unstale":"2023-12-04T10:45:34.116085+0000","last_undegraded":"2023-12-04T10:45:34.116085+0000","last_fullsized":"2023-12-04T10:45:34.116085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:23:36.342055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134788+0000","last_change":"2023-12-04T10:45:34.128714+0000","last_active":"2023-12-04T10:45:35.134788+0000","last_peered":"2023-12-04T10:45:35.134788+0000","last_clean":"2023-12-04T10:45:35.134788+0000","last_became_active":"2023-12-04T10:45:34.128409+0000","last_became_peered":"2023-12-04T10:45:34.128409+0000","last_unstale":"2023-12-04T10:45:35.134788+0000","last_undegraded":"2023-12-04T10:45:35.134788+0000","last_fullsized":"2023-12-04T10:45:35.134788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:50:48.159119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133654+0000","last_change":"2023-12-04T10:45:33.094065+0000","last_active":"2023-12-04T10:45:35.133654+0000","last_peered":"2023-12-04T10:45:35.133654+0000","last_clean":"2023-12-04T10:45:35.133654+0000","last_became_active":"2023-12-04T10:45:33.093782+0000","last_became_peered":"2023-12-04T10:45:33.093782+0000","last_unstale":"2023-12-04T10:45:35.133654+0000","last_undegraded":"2023-12-04T10:45:35.133654+0000","last_fullsized":"2023-12-04T10:45:35.133654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:54:49.202109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.129910+0000","last_change":"2023-12-04T10:45:34.125273+0000","last_active":"2023-12-04T10:45:34.129910+0000","last_peered":"2023-12-04T10:45:34.129910+0000","last_clean":"2023-12-04T10:45:34.129910+0000","last_became_active":"2023-12-04T10:45:34.124843+0000","last_became_peered":"2023-12-04T10:45:34.124843+0000","last_unstale":"2023-12-04T10:45:34.129910+0000","last_undegraded":"2023-12-04T10:45:34.129910+0000","last_fullsized":"2023-12-04T10:45:34.129910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:57:47.484649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130305+0000","last_change":"2023-12-04T10:45:33.084245+0000","last_active":"2023-12-04T10:45:35.130305+0000","last_peered":"2023-12-04T10:45:35.130305+0000","last_clean":"2023-12-04T10:45:35.130305+0000","last_became_active":"2023-12-04T10:45:33.083982+0000","last_became_peered":"2023-12-04T10:45:33.083982+0000","last_unstale":"2023-12-04T10:45:35.130305+0000","last_undegraded":"2023-12-04T10:45:35.130305+0000","last_fullsized":"2023-12-04T10:45:35.130305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:47:17.379638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.108366+0000","last_change":"2023-12-04T10:45:34.095675+0000","last_active":"2023-12-04T10:45:34.108366+0000","last_peered":"2023-12-04T10:45:34.108366+0000","last_clean":"2023-12-04T10:45:34.108366+0000","last_became_active":"2023-12-04T10:45:34.094911+0000","last_became_peered":"2023-12-04T10:45:34.094911+0000","last_unstale":"2023-12-04T10:45:34.108366+0000","last_undegraded":"2023-12-04T10:45:34.108366+0000","last_fullsized":"2023-12-04T10:45:34.108366+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:22:42.797382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.130242+0000","last_change":"2023-12-04T10:45:33.090258+0000","last_active":"2023-12-04T10:45:34.130242+0000","last_peered":"2023-12-04T10:45:34.130242+0000","last_clean":"2023-12-04T10:45:34.130242+0000","last_became_active":"2023-12-04T10:45:33.089935+0000","last_became_peered":"2023-12-04T10:45:33.089935+0000","last_unstale":"2023-12-04T10:45:34.130242+0000","last_undegraded":"2023-12-04T10:45:34.130242+0000","last_fullsized":"2023-12-04T10:45:34.130242+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:31:08.521400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085438+0000","last_change":"2023-12-04T10:45:34.092556+0000","last_active":"2023-12-04T10:45:35.085438+0000","last_peered":"2023-12-04T10:45:35.085438+0000","last_clean":"2023-12-04T10:45:35.085438+0000","last_became_active":"2023-12-04T10:45:34.092134+0000","last_became_peered":"2023-12-04T10:45:34.092134+0000","last_unstale":"2023-12-04T10:45:35.085438+0000","last_undegraded":"2023-12-04T10:45:35.085438+0000","last_fullsized":"2023-12-04T10:45:35.085438+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:08:09.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.136266+0000","last_change":"2023-12-04T10:45:33.086534+0000","last_active":"2023-12-04T10:45:34.136266+0000","last_peered":"2023-12-04T10:45:34.136266+0000","last_clean":"2023-12-04T10:45:34.136266+0000","last_became_active":"2023-12-04T10:45:33.085351+0000","last_became_peered":"2023-12-04T10:45:33.085351+0000","last_unstale":"2023-12-04T10:45:34.136266+0000","last_undegraded":"2023-12-04T10:45:34.136266+0000","last_fullsized":"2023-12-04T10:45:34.136266+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:36:42.731893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.129733+0000","last_change":"2023-12-04T10:45:34.105081+0000","last_active":"2023-12-04T10:45:35.129733+0000","last_peered":"2023-12-04T10:45:35.129733+0000","last_clean":"2023-12-04T10:45:35.129733+0000","last_became_active":"2023-12-04T10:45:34.104811+0000","last_became_peered":"2023-12-04T10:45:34.104811+0000","last_unstale":"2023-12-04T10:45:35.129733+0000","last_undegraded":"2023-12-04T10:45:35.129733+0000","last_fullsized":"2023-12-04T10:45:35.129733+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:55:26.077684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090076+0000","last_change":"2023-12-04T10:45:33.077415+0000","last_active":"2023-12-04T10:45:35.090076+0000","last_peered":"2023-12-04T10:45:35.090076+0000","last_clean":"2023-12-04T10:45:35.090076+0000","last_became_active":"2023-12-04T10:45:33.076904+0000","last_became_peered":"2023-12-04T10:45:33.076904+0000","last_unstale":"2023-12-04T10:45:35.090076+0000","last_undegraded":"2023-12-04T10:45:35.090076+0000","last_fullsized":"2023-12-04T10:45:35.090076+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:57:58.752325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089484+0000","last_change":"2023-12-04T10:45:34.119025+0000","last_active":"2023-12-04T10:45:35.089484+0000","last_peered":"2023-12-04T10:45:35.089484+0000","last_clean":"2023-12-04T10:45:35.089484+0000","last_became_active":"2023-12-04T10:45:34.118559+0000","last_became_peered":"2023-12-04T10:45:34.118559+0000","last_unstale":"2023-12-04T10:45:35.089484+0000","last_undegraded":"2023-12-04T10:45:35.089484+0000","last_fullsized":"2023-12-04T10:45:35.089484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:38:38.594954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134096+0000","last_change":"2023-12-04T10:45:33.090801+0000","last_active":"2023-12-04T10:45:35.134096+0000","last_peered":"2023-12-04T10:45:35.134096+0000","last_clean":"2023-12-04T10:45:35.134096+0000","last_became_active":"2023-12-04T10:45:33.090506+0000","last_became_peered":"2023-12-04T10:45:33.090506+0000","last_unstale":"2023-12-04T10:45:35.134096+0000","last_undegraded":"2023-12-04T10:45:35.134096+0000","last_fullsized":"2023-12-04T10:45:35.134096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:54:49.202109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.126670+0000","last_change":"2023-12-04T10:45:34.120804+0000","last_active":"2023-12-04T10:45:34.126670+0000","last_peered":"2023-12-04T10:45:34.126670+0000","last_clean":"2023-12-04T10:45:34.126670+0000","last_became_active":"2023-12-04T10:45:34.120485+0000","last_became_peered":"2023-12-04T10:45:34.120485+0000","last_unstale":"2023-12-04T10:45:34.126670+0000","last_undegraded":"2023-12-04T10:45:34.126670+0000","last_fullsized":"2023-12-04T10:45:34.126670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:02:36.623447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.093728+0000","last_change":"2023-12-04T10:45:33.084346+0000","last_active":"2023-12-04T10:45:34.093728+0000","last_peered":"2023-12-04T10:45:34.093728+0000","last_clean":"2023-12-04T10:45:34.093728+0000","last_became_active":"2023-12-04T10:45:33.084172+0000","last_became_peered":"2023-12-04T10:45:33.084172+0000","last_unstale":"2023-12-04T10:45:34.093728+0000","last_undegraded":"2023-12-04T10:45:34.093728+0000","last_fullsized":"2023-12-04T10:45:34.093728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:51:30.763983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084640+0000","last_change":"2023-12-04T10:45:34.115666+0000","last_active":"2023-12-04T10:45:35.084640+0000","last_peered":"2023-12-04T10:45:35.084640+0000","last_clean":"2023-12-04T10:45:35.084640+0000","last_became_active":"2023-12-04T10:45:34.115384+0000","last_became_peered":"2023-12-04T10:45:34.115384+0000","last_unstale":"2023-12-04T10:45:35.084640+0000","last_undegraded":"2023-12-04T10:45:35.084640+0000","last_fullsized":"2023-12-04T10:45:35.084640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:17.785361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.085629+0000","last_change":"2023-12-04T10:45:33.089922+0000","last_active":"2023-12-04T10:45:34.085629+0000","last_peered":"2023-12-04T10:45:34.085629+0000","last_clean":"2023-12-04T10:45:34.085629+0000","last_became_active":"2023-12-04T10:45:33.089579+0000","last_became_peered":"2023-12-04T10:45:33.089579+0000","last_unstale":"2023-12-04T10:45:34.085629+0000","last_undegraded":"2023-12-04T10:45:34.085629+0000","last_fullsized":"2023-12-04T10:45:34.085629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:45:05.812639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.114980+0000","last_change":"2023-12-04T10:45:34.108809+0000","last_active":"2023-12-04T10:45:34.114980+0000","last_peered":"2023-12-04T10:45:34.114980+0000","last_clean":"2023-12-04T10:45:34.114980+0000","last_became_active":"2023-12-04T10:45:34.105828+0000","last_became_peered":"2023-12-04T10:45:34.105828+0000","last_unstale":"2023-12-04T10:45:34.114980+0000","last_undegraded":"2023-12-04T10:45:34.114980+0000","last_fullsized":"2023-12-04T10:45:34.114980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:28:09.665581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085694+0000","last_change":"2023-12-04T10:45:33.081093+0000","last_active":"2023-12-04T10:45:35.085694+0000","last_peered":"2023-12-04T10:45:35.085694+0000","last_clean":"2023-12-04T10:45:35.085694+0000","last_became_active":"2023-12-04T10:45:33.080819+0000","last_became_peered":"2023-12-04T10:45:33.080819+0000","last_unstale":"2023-12-04T10:45:35.085694+0000","last_undegraded":"2023-12-04T10:45:35.085694+0000","last_fullsized":"2023-12-04T10:45:35.085694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:12:24.442812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134708+0000","last_change":"2023-12-04T10:45:34.111801+0000","last_active":"2023-12-04T10:45:35.134708+0000","last_peered":"2023-12-04T10:45:35.134708+0000","last_clean":"2023-12-04T10:45:35.134708+0000","last_became_active":"2023-12-04T10:45:34.111351+0000","last_became_peered":"2023-12-04T10:45:34.111351+0000","last_unstale":"2023-12-04T10:45:35.134708+0000","last_undegraded":"2023-12-04T10:45:35.134708+0000","last_fullsized":"2023-12-04T10:45:35.134708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:12:25.457628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091574+0000","last_change":"2023-12-04T10:45:33.083939+0000","last_active":"2023-12-04T10:45:35.091574+0000","last_peered":"2023-12-04T10:45:35.091574+0000","last_clean":"2023-12-04T10:45:35.091574+0000","last_became_active":"2023-12-04T10:45:33.083540+0000","last_became_peered":"2023-12-04T10:45:33.083540+0000","last_unstale":"2023-12-04T10:45:35.091574+0000","last_undegraded":"2023-12-04T10:45:35.091574+0000","last_fullsized":"2023-12-04T10:45:35.091574+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:54:24.832119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130496+0000","last_change":"2023-12-04T10:45:34.116144+0000","last_active":"2023-12-04T10:45:35.130496+0000","last_peered":"2023-12-04T10:45:35.130496+0000","last_clean":"2023-12-04T10:45:35.130496+0000","last_became_active":"2023-12-04T10:45:34.115821+0000","last_became_peered":"2023-12-04T10:45:34.115821+0000","last_unstale":"2023-12-04T10:45:35.130496+0000","last_undegraded":"2023-12-04T10:45:35.130496+0000","last_fullsized":"2023-12-04T10:45:35.130496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:46:24.788437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090965+0000","last_change":"2023-12-04T10:45:33.088706+0000","last_active":"2023-12-04T10:45:35.090965+0000","last_peered":"2023-12-04T10:45:35.090965+0000","last_clean":"2023-12-04T10:45:35.090965+0000","last_became_active":"2023-12-04T10:45:33.087297+0000","last_became_peered":"2023-12-04T10:45:33.087297+0000","last_unstale":"2023-12-04T10:45:35.090965+0000","last_undegraded":"2023-12-04T10:45:35.090965+0000","last_fullsized":"2023-12-04T10:45:35.090965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:25:38.355536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.114304+0000","last_change":"2023-12-04T10:45:34.108569+0000","last_active":"2023-12-04T10:45:34.114304+0000","last_peered":"2023-12-04T10:45:34.114304+0000","last_clean":"2023-12-04T10:45:34.114304+0000","last_became_active":"2023-12-04T10:45:34.108264+0000","last_became_peered":"2023-12-04T10:45:34.108264+0000","last_unstale":"2023-12-04T10:45:34.114304+0000","last_undegraded":"2023-12-04T10:45:34.114304+0000","last_fullsized":"2023-12-04T10:45:34.114304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:57:44.026584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085180+0000","last_change":"2023-12-04T10:45:33.085611+0000","last_active":"2023-12-04T10:45:35.085180+0000","last_peered":"2023-12-04T10:45:35.085180+0000","last_clean":"2023-12-04T10:45:35.085180+0000","last_became_active":"2023-12-04T10:45:33.085146+0000","last_became_peered":"2023-12-04T10:45:33.085146+0000","last_unstale":"2023-12-04T10:45:35.085180+0000","last_undegraded":"2023-12-04T10:45:35.085180+0000","last_fullsized":"2023-12-04T10:45:35.085180+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:55:25.062868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.129450+0000","last_change":"2023-12-04T10:45:34.124698+0000","last_active":"2023-12-04T10:45:35.129450+0000","last_peered":"2023-12-04T10:45:35.129450+0000","last_clean":"2023-12-04T10:45:35.129450+0000","last_became_active":"2023-12-04T10:45:34.123842+0000","last_became_peered":"2023-12-04T10:45:34.123842+0000","last_unstale":"2023-12-04T10:45:35.129450+0000","last_undegraded":"2023-12-04T10:45:35.129450+0000","last_fullsized":"2023-12-04T10:45:35.129450+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:55.351864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084813+0000","last_change":"2023-12-04T10:45:33.077176+0000","last_active":"2023-12-04T10:45:35.084813+0000","last_peered":"2023-12-04T10:45:35.084813+0000","last_clean":"2023-12-04T10:45:35.084813+0000","last_became_active":"2023-12-04T10:45:33.076872+0000","last_became_peered":"2023-12-04T10:45:33.076872+0000","last_unstale":"2023-12-04T10:45:35.084813+0000","last_undegraded":"2023-12-04T10:45:35.084813+0000","last_fullsized":"2023-12-04T10:45:35.084813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:40:05.587536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084583+0000","last_change":"2023-12-04T10:45:34.105764+0000","last_active":"2023-12-04T10:45:35.084583+0000","last_peered":"2023-12-04T10:45:35.084583+0000","last_clean":"2023-12-04T10:45:35.084583+0000","last_became_active":"2023-12-04T10:45:34.105394+0000","last_became_peered":"2023-12-04T10:45:34.105394+0000","last_unstale":"2023-12-04T10:45:35.084583+0000","last_undegraded":"2023-12-04T10:45:35.084583+0000","last_fullsized":"2023-12-04T10:45:35.084583+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:53:36.311196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.090123+0000","last_change":"2023-12-04T10:45:33.084345+0000","last_active":"2023-12-04T10:45:34.090123+0000","last_peered":"2023-12-04T10:45:34.090123+0000","last_clean":"2023-12-04T10:45:34.090123+0000","last_became_active":"2023-12-04T10:45:33.084036+0000","last_became_peered":"2023-12-04T10:45:33.084036+0000","last_unstale":"2023-12-04T10:45:34.090123+0000","last_undegraded":"2023-12-04T10:45:34.090123+0000","last_fullsized":"2023-12-04T10:45:34.090123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:29:31.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134167+0000","last_change":"2023-12-04T10:45:34.114303+0000","last_active":"2023-12-04T10:45:35.134167+0000","last_peered":"2023-12-04T10:45:35.134167+0000","last_clean":"2023-12-04T10:45:35.134167+0000","last_became_active":"2023-12-04T10:45:34.112494+0000","last_became_peered":"2023-12-04T10:45:34.112494+0000","last_unstale":"2023-12-04T10:45:35.134167+0000","last_undegraded":"2023-12-04T10:45:35.134167+0000","last_fullsized":"2023-12-04T10:45:35.134167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:03:30.057211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.131792+0000","last_change":"2023-12-04T10:45:33.090873+0000","last_active":"2023-12-04T10:45:35.131792+0000","last_peered":"2023-12-04T10:45:35.131792+0000","last_clean":"2023-12-04T10:45:35.131792+0000","last_became_active":"2023-12-04T10:45:33.090466+0000","last_became_peered":"2023-12-04T10:45:33.090466+0000","last_unstale":"2023-12-04T10:45:35.131792+0000","last_undegraded":"2023-12-04T10:45:35.131792+0000","last_fullsized":"2023-12-04T10:45:35.131792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:27:59.946789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084718+0000","last_change":"2023-12-04T10:45:34.105204+0000","last_active":"2023-12-04T10:45:35.084718+0000","last_peered":"2023-12-04T10:45:35.084718+0000","last_clean":"2023-12-04T10:45:35.084718+0000","last_became_active":"2023-12-04T10:45:34.104960+0000","last_became_peered":"2023-12-04T10:45:34.104960+0000","last_unstale":"2023-12-04T10:45:35.084718+0000","last_undegraded":"2023-12-04T10:45:35.084718+0000","last_fullsized":"2023-12-04T10:45:35.084718+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:38:38.594954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133162+0000","last_change":"2023-12-04T10:45:33.090176+0000","last_active":"2023-12-04T10:45:35.133162+0000","last_peered":"2023-12-04T10:45:35.133162+0000","last_clean":"2023-12-04T10:45:35.133162+0000","last_became_active":"2023-12-04T10:45:33.089856+0000","last_became_peered":"2023-12-04T10:45:33.089856+0000","last_unstale":"2023-12-04T10:45:35.133162+0000","last_undegraded":"2023-12-04T10:45:35.133162+0000","last_fullsized":"2023-12-04T10:45:35.133162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:46:23.773621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085098+0000","last_change":"2023-12-04T10:45:34.096331+0000","last_active":"2023-12-04T10:45:35.085098+0000","last_peered":"2023-12-04T10:45:35.085098+0000","last_clean":"2023-12-04T10:45:35.085098+0000","last_became_active":"2023-12-04T10:45:34.093449+0000","last_became_peered":"2023-12-04T10:45:34.093449+0000","last_unstale":"2023-12-04T10:45:35.085098+0000","last_undegraded":"2023-12-04T10:45:35.085098+0000","last_fullsized":"2023-12-04T10:45:35.085098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:27:43.683219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091653+0000","last_change":"2023-12-04T10:45:33.092446+0000","last_active":"2023-12-04T10:45:35.091653+0000","last_peered":"2023-12-04T10:45:35.091653+0000","last_clean":"2023-12-04T10:45:35.091653+0000","last_became_active":"2023-12-04T10:45:33.091983+0000","last_became_peered":"2023-12-04T10:45:33.091983+0000","last_unstale":"2023-12-04T10:45:35.091653+0000","last_undegraded":"2023-12-04T10:45:35.091653+0000","last_fullsized":"2023-12-04T10:45:35.091653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:03:29.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090692+0000","last_change":"2023-12-04T10:45:34.122681+0000","last_active":"2023-12-04T10:45:35.090692+0000","last_peered":"2023-12-04T10:45:35.090692+0000","last_clean":"2023-12-04T10:45:35.090692+0000","last_became_active":"2023-12-04T10:45:34.122140+0000","last_became_peered":"2023-12-04T10:45:34.122140+0000","last_unstale":"2023-12-04T10:45:35.090692+0000","last_undegraded":"2023-12-04T10:45:35.090692+0000","last_fullsized":"2023-12-04T10:45:35.090692+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:08:09.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.133844+0000","last_change":"2023-12-04T10:45:33.086008+0000","last_active":"2023-12-04T10:45:34.133844+0000","last_peered":"2023-12-04T10:45:34.133844+0000","last_clean":"2023-12-04T10:45:34.133844+0000","last_became_active":"2023-12-04T10:45:33.085563+0000","last_became_peered":"2023-12-04T10:45:33.085563+0000","last_unstale":"2023-12-04T10:45:34.133844+0000","last_undegraded":"2023-12-04T10:45:34.133844+0000","last_fullsized":"2023-12-04T10:45:34.133844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:57:46.469833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.108391+0000","last_change":"2023-12-04T10:45:34.100880+0000","last_active":"2023-12-04T10:45:34.108391+0000","last_peered":"2023-12-04T10:45:34.108391+0000","last_clean":"2023-12-04T10:45:34.108391+0000","last_became_active":"2023-12-04T10:45:34.100464+0000","last_became_peered":"2023-12-04T10:45:34.100464+0000","last_unstale":"2023-12-04T10:45:34.108391+0000","last_undegraded":"2023-12-04T10:45:34.108391+0000","last_fullsized":"2023-12-04T10:45:34.108391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:26:59.418604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.132881+0000","last_change":"2023-12-04T10:45:33.083381+0000","last_active":"2023-12-04T10:45:34.132881+0000","last_peered":"2023-12-04T10:45:34.132881+0000","last_clean":"2023-12-04T10:45:34.132881+0000","last_became_active":"2023-12-04T10:45:33.083167+0000","last_became_peered":"2023-12-04T10:45:33.083167+0000","last_unstale":"2023-12-04T10:45:34.132881+0000","last_undegraded":"2023-12-04T10:45:34.132881+0000","last_fullsized":"2023-12-04T10:45:34.132881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:51:17.352561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.109886+0000","last_change":"2023-12-04T10:45:34.107879+0000","last_active":"2023-12-04T10:45:34.109886+0000","last_peered":"2023-12-04T10:45:34.109886+0000","last_clean":"2023-12-04T10:45:34.109886+0000","last_became_active":"2023-12-04T10:45:34.105709+0000","last_became_peered":"2023-12-04T10:45:34.105709+0000","last_unstale":"2023-12-04T10:45:34.109886+0000","last_undegraded":"2023-12-04T10:45:34.109886+0000","last_fullsized":"2023-12-04T10:45:34.109886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:35:48.756116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.097365+0000","last_change":"2023-12-04T10:45:33.090431+0000","last_active":"2023-12-04T10:45:34.097365+0000","last_peered":"2023-12-04T10:45:34.097365+0000","last_clean":"2023-12-04T10:45:34.097365+0000","last_became_active":"2023-12-04T10:45:33.090183+0000","last_became_peered":"2023-12-04T10:45:33.090183+0000","last_unstale":"2023-12-04T10:45:34.097365+0000","last_undegraded":"2023-12-04T10:45:34.097365+0000","last_fullsized":"2023-12-04T10:45:34.097365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:45:34.034455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132906+0000","last_change":"2023-12-04T10:45:34.112887+0000","last_active":"2023-12-04T10:45:35.132906+0000","last_peered":"2023-12-04T10:45:35.132906+0000","last_clean":"2023-12-04T10:45:35.132906+0000","last_became_active":"2023-12-04T10:45:34.111949+0000","last_became_peered":"2023-12-04T10:45:34.111949+0000","last_unstale":"2023-12-04T10:45:35.132906+0000","last_undegraded":"2023-12-04T10:45:35.132906+0000","last_fullsized":"2023-12-04T10:45:35.132906+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:25:39.370353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.130565+0000","last_change":"2023-12-04T10:45:33.077118+0000","last_active":"2023-12-04T10:45:34.130565+0000","last_peered":"2023-12-04T10:45:34.130565+0000","last_clean":"2023-12-04T10:45:34.130565+0000","last_became_active":"2023-12-04T10:45:33.076750+0000","last_became_peered":"2023-12-04T10:45:33.076750+0000","last_unstale":"2023-12-04T10:45:34.130565+0000","last_undegraded":"2023-12-04T10:45:34.130565+0000","last_fullsized":"2023-12-04T10:45:34.130565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:06:04.114725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.129712+0000","last_change":"2023-12-04T10:45:34.111752+0000","last_active":"2023-12-04T10:45:35.129712+0000","last_peered":"2023-12-04T10:45:35.129712+0000","last_clean":"2023-12-04T10:45:35.129712+0000","last_became_active":"2023-12-04T10:45:34.111360+0000","last_became_peered":"2023-12-04T10:45:34.111360+0000","last_unstale":"2023-12-04T10:45:35.129712+0000","last_undegraded":"2023-12-04T10:45:35.129712+0000","last_fullsized":"2023-12-04T10:45:35.129712+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:41:39.912748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.103859+0000","last_change":"2023-12-04T10:45:33.089787+0000","last_active":"2023-12-04T10:45:34.103859+0000","last_peered":"2023-12-04T10:45:34.103859+0000","last_clean":"2023-12-04T10:45:34.103859+0000","last_became_active":"2023-12-04T10:45:33.089494+0000","last_became_peered":"2023-12-04T10:45:33.089494+0000","last_unstale":"2023-12-04T10:45:34.103859+0000","last_undegraded":"2023-12-04T10:45:34.103859+0000","last_fullsized":"2023-12-04T10:45:34.103859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:26:58.403788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089726+0000","last_change":"2023-12-04T10:45:34.124528+0000","last_active":"2023-12-04T10:45:35.089726+0000","last_peered":"2023-12-04T10:45:35.089726+0000","last_clean":"2023-12-04T10:45:35.089726+0000","last_became_active":"2023-12-04T10:45:34.124206+0000","last_became_peered":"2023-12-04T10:45:34.124206+0000","last_unstale":"2023-12-04T10:45:35.089726+0000","last_undegraded":"2023-12-04T10:45:35.089726+0000","last_fullsized":"2023-12-04T10:45:35.089726+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:13:34.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133631+0000","last_change":"2023-12-04T10:45:33.089384+0000","last_active":"2023-12-04T10:45:35.133631+0000","last_peered":"2023-12-04T10:45:35.133631+0000","last_clean":"2023-12-04T10:45:35.133631+0000","last_became_active":"2023-12-04T10:45:33.089091+0000","last_became_peered":"2023-12-04T10:45:33.089091+0000","last_unstale":"2023-12-04T10:45:35.133631+0000","last_undegraded":"2023-12-04T10:45:35.133631+0000","last_fullsized":"2023-12-04T10:45:35.133631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:55:25.062868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084829+0000","last_change":"2023-12-04T10:45:34.112430+0000","last_active":"2023-12-04T10:45:35.084829+0000","last_peered":"2023-12-04T10:45:35.084829+0000","last_clean":"2023-12-04T10:45:35.084829+0000","last_became_active":"2023-12-04T10:45:34.112157+0000","last_became_peered":"2023-12-04T10:45:34.112157+0000","last_unstale":"2023-12-04T10:45:35.084829+0000","last_undegraded":"2023-12-04T10:45:35.084829+0000","last_fullsized":"2023-12-04T10:45:35.084829+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:13:34.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.103430+0000","last_change":"2023-12-04T10:45:33.076361+0000","last_active":"2023-12-04T10:45:34.103430+0000","last_peered":"2023-12-04T10:45:34.103430+0000","last_clean":"2023-12-04T10:45:34.103430+0000","last_became_active":"2023-12-04T10:45:33.076174+0000","last_became_peered":"2023-12-04T10:45:33.076174+0000","last_unstale":"2023-12-04T10:45:34.103430+0000","last_undegraded":"2023-12-04T10:45:34.103430+0000","last_fullsized":"2023-12-04T10:45:34.103430+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:15:22.162045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.130026+0000","last_change":"2023-12-04T10:45:34.124710+0000","last_active":"2023-12-04T10:45:34.130026+0000","last_peered":"2023-12-04T10:45:34.130026+0000","last_clean":"2023-12-04T10:45:34.130026+0000","last_became_active":"2023-12-04T10:45:34.124400+0000","last_became_peered":"2023-12-04T10:45:34.124400+0000","last_unstale":"2023-12-04T10:45:34.130026+0000","last_undegraded":"2023-12-04T10:45:34.130026+0000","last_fullsized":"2023-12-04T10:45:34.130026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:16:16.422323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091849+0000","last_change":"2023-12-04T10:45:33.087597+0000","last_active":"2023-12-04T10:45:35.091849+0000","last_peered":"2023-12-04T10:45:35.091849+0000","last_clean":"2023-12-04T10:45:35.091849+0000","last_became_active":"2023-12-04T10:45:33.085690+0000","last_became_peered":"2023-12-04T10:45:33.085690+0000","last_unstale":"2023-12-04T10:45:35.091849+0000","last_undegraded":"2023-12-04T10:45:35.091849+0000","last_fullsized":"2023-12-04T10:45:35.091849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:40:05.587536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134831+0000","last_change":"2023-12-04T10:45:34.115423+0000","last_active":"2023-12-04T10:45:35.134831+0000","last_peered":"2023-12-04T10:45:35.134831+0000","last_clean":"2023-12-04T10:45:35.134831+0000","last_became_active":"2023-12-04T10:45:34.115132+0000","last_became_peered":"2023-12-04T10:45:34.115132+0000","last_unstale":"2023-12-04T10:45:35.134831+0000","last_undegraded":"2023-12-04T10:45:35.134831+0000","last_fullsized":"2023-12-04T10:45:35.134831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:53:36.311196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.103842+0000","last_change":"2023-12-04T10:45:33.085032+0000","last_active":"2023-12-04T10:45:34.103842+0000","last_peered":"2023-12-04T10:45:34.103842+0000","last_clean":"2023-12-04T10:45:34.103842+0000","last_became_active":"2023-12-04T10:45:33.084813+0000","last_became_peered":"2023-12-04T10:45:33.084813+0000","last_unstale":"2023-12-04T10:45:34.103842+0000","last_undegraded":"2023-12-04T10:45:34.103842+0000","last_fullsized":"2023-12-04T10:45:34.103842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:22:41.782565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085041+0000","last_change":"2023-12-04T10:45:34.104741+0000","last_active":"2023-12-04T10:45:35.085041+0000","last_peered":"2023-12-04T10:45:35.085041+0000","last_clean":"2023-12-04T10:45:35.085041+0000","last_became_active":"2023-12-04T10:45:34.104178+0000","last_became_peered":"2023-12-04T10:45:34.104178+0000","last_unstale":"2023-12-04T10:45:35.085041+0000","last_undegraded":"2023-12-04T10:45:35.085041+0000","last_fullsized":"2023-12-04T10:45:35.085041+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:39:15.362938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130631+0000","last_change":"2023-12-04T10:45:33.081275+0000","last_active":"2023-12-04T10:45:35.130631+0000","last_peered":"2023-12-04T10:45:35.130631+0000","last_clean":"2023-12-04T10:45:35.130631+0000","last_became_active":"2023-12-04T10:45:33.081034+0000","last_became_peered":"2023-12-04T10:45:33.081034+0000","last_unstale":"2023-12-04T10:45:35.130631+0000","last_undegraded":"2023-12-04T10:45:35.130631+0000","last_fullsized":"2023-12-04T10:45:35.130631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:11:10.396239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.129741+0000","last_change":"2023-12-04T10:45:34.107843+0000","last_active":"2023-12-04T10:45:35.129741+0000","last_peered":"2023-12-04T10:45:35.129741+0000","last_clean":"2023-12-04T10:45:35.129741+0000","last_became_active":"2023-12-04T10:45:34.107574+0000","last_became_peered":"2023-12-04T10:45:34.107574+0000","last_unstale":"2023-12-04T10:45:35.129741+0000","last_undegraded":"2023-12-04T10:45:35.129741+0000","last_fullsized":"2023-12-04T10:45:35.129741+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:24:30.631490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130297+0000","last_change":"2023-12-04T10:45:33.086423+0000","last_active":"2023-12-04T10:45:35.130297+0000","last_peered":"2023-12-04T10:45:35.130297+0000","last_clean":"2023-12-04T10:45:35.130297+0000","last_became_active":"2023-12-04T10:45:33.085795+0000","last_became_peered":"2023-12-04T10:45:33.085795+0000","last_unstale":"2023-12-04T10:45:35.130297+0000","last_undegraded":"2023-12-04T10:45:35.130297+0000","last_fullsized":"2023-12-04T10:45:35.130297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:37:09.629258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.113264+0000","last_change":"2023-12-04T10:45:34.101974+0000","last_active":"2023-12-04T10:45:34.113264+0000","last_peered":"2023-12-04T10:45:34.113264+0000","last_clean":"2023-12-04T10:45:34.113264+0000","last_became_active":"2023-12-04T10:45:34.101616+0000","last_became_peered":"2023-12-04T10:45:34.101616+0000","last_unstale":"2023-12-04T10:45:34.113264+0000","last_undegraded":"2023-12-04T10:45:34.113264+0000","last_fullsized":"2023-12-04T10:45:34.113264+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:36:50.302216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132207+0000","last_change":"2023-12-04T10:45:33.086695+0000","last_active":"2023-12-04T10:45:35.132207+0000","last_peered":"2023-12-04T10:45:35.132207+0000","last_clean":"2023-12-04T10:45:35.132207+0000","last_became_active":"2023-12-04T10:45:33.086214+0000","last_became_peered":"2023-12-04T10:45:33.086214+0000","last_unstale":"2023-12-04T10:45:35.132207+0000","last_undegraded":"2023-12-04T10:45:35.132207+0000","last_fullsized":"2023-12-04T10:45:35.132207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:37.117599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.112350+0000","last_change":"2023-12-04T10:45:34.106662+0000","last_active":"2023-12-04T10:45:34.112350+0000","last_peered":"2023-12-04T10:45:34.112350+0000","last_clean":"2023-12-04T10:45:34.112350+0000","last_became_active":"2023-12-04T10:45:34.105530+0000","last_became_peered":"2023-12-04T10:45:34.105530+0000","last_unstale":"2023-12-04T10:45:34.112350+0000","last_undegraded":"2023-12-04T10:45:34.112350+0000","last_fullsized":"2023-12-04T10:45:34.112350+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:50:24.778209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.087145+0000","last_change":"2023-12-04T10:45:33.087897+0000","last_active":"2023-12-04T10:45:34.087145+0000","last_peered":"2023-12-04T10:45:34.087145+0000","last_clean":"2023-12-04T10:45:34.087145+0000","last_became_active":"2023-12-04T10:45:33.086375+0000","last_became_peered":"2023-12-04T10:45:33.086375+0000","last_unstale":"2023-12-04T10:45:34.087145+0000","last_undegraded":"2023-12-04T10:45:34.087145+0000","last_fullsized":"2023-12-04T10:45:34.087145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:36:06.657049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134678+0000","last_change":"2023-12-04T10:45:34.110609+0000","last_active":"2023-12-04T10:45:35.134678+0000","last_peered":"2023-12-04T10:45:35.134678+0000","last_clean":"2023-12-04T10:45:35.134678+0000","last_became_active":"2023-12-04T10:45:34.110237+0000","last_became_peered":"2023-12-04T10:45:34.110237+0000","last_unstale":"2023-12-04T10:45:35.134678+0000","last_undegraded":"2023-12-04T10:45:35.134678+0000","last_fullsized":"2023-12-04T10:45:35.134678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:40:06.602352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084317+0000","last_change":"2023-12-04T10:45:33.073924+0000","last_active":"2023-12-04T10:45:35.084317+0000","last_peered":"2023-12-04T10:45:35.084317+0000","last_clean":"2023-12-04T10:45:35.084317+0000","last_became_active":"2023-12-04T10:45:33.073654+0000","last_became_peered":"2023-12-04T10:45:33.073654+0000","last_unstale":"2023-12-04T10:45:35.084317+0000","last_undegraded":"2023-12-04T10:45:35.084317+0000","last_fullsized":"2023-12-04T10:45:35.084317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:54.337047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091545+0000","last_change":"2023-12-04T10:45:34.120582+0000","last_active":"2023-12-04T10:45:35.091545+0000","last_peered":"2023-12-04T10:45:35.091545+0000","last_clean":"2023-12-04T10:45:35.091545+0000","last_became_active":"2023-12-04T10:45:34.120273+0000","last_became_peered":"2023-12-04T10:45:34.120273+0000","last_unstale":"2023-12-04T10:45:35.091545+0000","last_undegraded":"2023-12-04T10:45:35.091545+0000","last_fullsized":"2023-12-04T10:45:35.091545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:47:40.126347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134805+0000","last_change":"2023-12-04T10:45:33.085306+0000","last_active":"2023-12-04T10:45:35.134805+0000","last_peered":"2023-12-04T10:45:35.134805+0000","last_clean":"2023-12-04T10:45:35.134805+0000","last_became_active":"2023-12-04T10:45:33.084901+0000","last_became_peered":"2023-12-04T10:45:33.084901+0000","last_unstale":"2023-12-04T10:45:35.134805+0000","last_undegraded":"2023-12-04T10:45:35.134805+0000","last_fullsized":"2023-12-04T10:45:35.134805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:24:30.025521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":183,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.104632+0000","last_change":"2023-12-04T10:43:48.111279+0000","last_active":"2023-12-04T10:45:34.104632+0000","last_peered":"2023-12-04T10:45:34.104632+0000","last_clean":"2023-12-04T10:45:34.104632+0000","last_became_active":"2023-12-04T10:43:48.108038+0000","last_became_peered":"2023-12-04T10:43:48.108038+0000","last_unstale":"2023-12-04T10:45:34.104632+0000","last_undegraded":"2023-12-04T10:45:34.104632+0000","last_fullsized":"2023-12-04T10:45:34.104632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_clean_scrub_stamp":"2023-12-04T10:43:46.528449+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:31:15.475210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":792705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.1739999999999999}]},{"osd":1,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.3560000000000001}]},{"osd":2,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.081}]},{"osd":3,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.2929999999999999}]},{"osd":4,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.448},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.018}]},{"osd":5,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.425},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":1.5129999999999999}]},{"osd":6,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":1.161,"5min":1.161,"15min":1.161},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.744,"5min":1.744,"15min":1.744},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.2270000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":201237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1}]},{"osd":1,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.4059999999999999}]},{"osd":2,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.222}]},{"osd":4,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.0460000000000003,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.728,"5min":1.728,"15min":1.728},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":4.1589999999999998,"5min":4.1589999999999998,"15min":4.1589999999999998},"last":1.1240000000000001}]},{"osd":5,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":1.054},{"interface":"front","average":{"1min":1.778,"5min":1.778,"15min":1.778},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":4.21,"5min":4.21,"15min":4.21},"last":1.359}]},{"osd":7,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.7330000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.2110000000000001}]},{"osd":1,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.98399999999999999}]},{"osd":2,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.5529999999999999}]},{"osd":3,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.155}]},{"osd":4,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.504},{"interface":"front","average":{"1min":1.849,"5min":1.849,"15min":1.849},"min":{"1min":1.079,"5min":1.079,"15min":1.079},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":1.3360000000000001}]},{"osd":6,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.754,"15min":1.754},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.718,"5min":4.718,"15min":4.718},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.73,"5min":1.73,"15min":1.73},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.649}]},{"osd":7,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":3.6859999999999999,"5min":3.6859999999999999,"15min":3.6859999999999999},"last":1.611},{"interface":"front","average":{"1min":1.859,"5min":1.859,"15min":1.859},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.696}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":202301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.375},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.55500000000000005}]},{"osd":1,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.498},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.625}]},{"osd":2,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":3.653,"5min":3.653,"15min":3.653},"last":1.647},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.109}]},{"osd":5,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.6020000000000001}]},{"osd":7,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":3.7679999999999998,"5min":3.7679999999999998,"15min":3.7679999999999998},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.752}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":791057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.7649999999999999}]},{"osd":2,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.135}]},{"osd":3,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.2050000000000001}]},{"osd":4,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.4890000000000001}]},{"osd":5,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.593}]},{"osd":6,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.264},{"interface":"front","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3149999999999999}]},{"osd":7,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.665},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.806}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":194639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.085}]},{"osd":1,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.238}]},{"osd":2,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4079999999999999}]},{"osd":3,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.7509999999999999,"5min":2.7509999999999999,"15min":2.7509999999999999},"last":1.355},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3009999999999999}]},{"osd":5,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.609},{"interface":"front","average":{"1min":1.673,"5min":1.673,"15min":1.673},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":1.4630000000000001}]},{"osd":6,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.522},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.7070000000000001}]},{"osd":7,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.123,"5min":1.123,"15min":1.123},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.724,"5min":1.724,"15min":1.724},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.653}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.56299999999999994}]},{"osd":1,"last update":"Mon Dec 4 10:44:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.81899999999999995}]},{"osd":3,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.71399999999999997}]},{"osd":4,"last update":"Mon Dec 4 10:44:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":1.3149999999999999}]},{"osd":5,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.448}]},{"osd":6,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.0840000000000001}]},{"osd":7,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":3.48,"5min":3.48,"15min":3.48},"last":1.393},{"interface":"front","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.2789999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.6120000000000001,"5min":5.6120000000000001,"15min":5.6120000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.649,"5min":5.649,"15min":5.649},"last":1.0449999999999999}]},{"osd":3,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.603},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":1.1910000000000001}]},{"osd":4,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.5140000000000002,"5min":5.5140000000000002,"15min":5.5140000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.2669999999999999,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":1.1359999999999999}]},{"osd":5,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":5.4720000000000004,"5min":5.4720000000000004,"15min":5.4720000000000004},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":1.052,"5min":1.052,"15min":1.052},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":5.3490000000000002,"5min":5.3490000000000002,"15min":5.3490000000000002},"last":1.657},{"interface":"front","average":{"1min":1.673,"5min":1.673,"15min":1.673},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.6629999999999998,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":1.7110000000000001}]},{"osd":7,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":6.0170000000000003,"5min":6.0170000000000003,"15min":6.0170000000000003},"last":1.282},{"interface":"front","average":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":5.4359999999999999,"5min":5.4359999999999999,"15min":5.4359999999999999},"last":1.5149999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T10:45:38.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-04T10:45:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.844+0000 7f92bdab4640 1 Processor -- start 2023-12-04T10:45:38.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.844+0000 7f92bdab4640 1 -- start start 2023-12-04T10:45:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.846+0000 7f92bdab4640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f92b80cf850 0x7f92b80cee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.846+0000 7f92bdab4640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f92b80b3e50 0x7f92b80b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.846+0000 7f92bdab4640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b80cf3d0 con 0x7f92b80cfc30 2023-12-04T10:45:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.846+0000 7f92bdab4640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b80b4800 con 0x7f92b80b3e50 2023-12-04T10:45:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.846+0000 7f92bdab4640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b80b2480 con 0x7f92b80cf850 2023-12-04T10:45:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.847+0000 7f92affff640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7f92b80cfc30 0x7f92b80cc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58278/0 (socket says 172.21.15.63:58278) 2023-12-04T10:45:38.848 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.847+0000 7f92affff640 1 -- 172.21.15.63:0/1481502670 learned_addr learned my addr 172.21.15.63:0/1481502670 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:45:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.847+0000 7f92b7fff640 1 --2- 172.21.15.63:0/1481502670 >> v2:172.21.15.63:3300/0 conn(0x7f92b80b3e50 0x7f92b80b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.847+0000 7f92b77fe640 1 --2- 172.21.15.63:0/1481502670 >> v2:172.21.15.66:3300/0 conn(0x7f92b80cf850 0x7f92b80cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.847+0000 7f92b7fff640 1 -- 172.21.15.63:0/1481502670 >> v2:172.21.15.66:3300/0 conn(0x7f92b80cf850 msgr2=0x7f92b80cee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.847+0000 7f92b7fff640 1 --2- 172.21.15.63:0/1481502670 >> v2:172.21.15.66:3300/0 conn(0x7f92b80cf850 0x7f92b80cee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.847+0000 7f92b7fff640 1 -- 172.21.15.63:0/1481502670 >> v1:172.21.15.63:6789/0 conn(0x7f92b80cfc30 legacy=0x7f92b80cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.849 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.847+0000 7f92b7fff640 1 -- 172.21.15.63:0/1481502670 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80b2760 con 0x7f92b80b3e50 2023-12-04T10:45:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.848+0000 7f92b7fff640 1 --2- 172.21.15.63:0/1481502670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80b3e50 0x7f92b80b42c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f92b8066c10 tx=0x7f92b002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33026411f7e6dad3 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92b6ffd640 1 -- 172.21.15.63:0/1481502670 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0031830 con 0x7f92b80b3e50 2023-12-04T10:45:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92b6ffd640 1 -- 172.21.15.63:0/1481502670 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b0031990 con 0x7f92b80b3e50 2023-12-04T10:45:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92b6ffd640 1 -- 172.21.15.63:0/1481502670 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0031d20 con 0x7f92b80b3e50 2023-12-04T10:45:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92bdab4640 1 -- 172.21.15.63:0/1481502670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80b3e50 msgr2=0x7f92b80b42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92bdab4640 1 --2- 172.21.15.63:0/1481502670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80b3e50 0x7f92b80b42c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f92b8066c10 tx=0x7f92b002b8d0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92bdab4640 1 -- 172.21.15.63:0/1481502670 shutdown_connections 2023-12-04T10:45:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92bdab4640 1 --2- 172.21.15.63:0/1481502670 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80b3e50 0x7f92b80b42c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92bdab4640 1 --2- 172.21.15.63:0/1481502670 >> v2:172.21.15.66:3300/0 conn(0x7f92b80cf850 0x7f92b80cee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92bdab4640 1 -- 172.21.15.63:0/1481502670 >> 172.21.15.63:0/1481502670 conn(0x7f92b80d1000 msgr2=0x7f92b80d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92bdab4640 1 -- 172.21.15.63:0/1481502670 shutdown_connections 2023-12-04T10:45:38.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.849+0000 7f92bdab4640 1 -- 172.21.15.63:0/1481502670 wait complete. 2023-12-04T10:45:38.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.851+0000 7f92bdab4640 1 Processor -- start 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.851+0000 7f92bdab4640 1 -- start start 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.852+0000 7f92bdab4640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92b80b3e50 0x7f92b80b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.852+0000 7f92bdab4640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92b80cf850 0x7f92b80c9960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.852+0000 7f92bdab4640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80cfc30 0x7f92b80c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.852+0000 7f92bdab4640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80ca700 con 0x7f92b80cfc30 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.852+0000 7f92bdab4640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80ca420 con 0x7f92b80b3e50 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.852+0000 7f92bdab4640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b81f6700 con 0x7f92b80cf850 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80cfc30 0x7f92b80c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80cfc30 0x7f92b80c80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56012/0 (socket says 172.21.15.63:56012) 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 -- 172.21.15.63:0/4265962195 learned_addr learned my addr 172.21.15.63:0/4265962195 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 -- 172.21.15.63:0/4265962195 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92b80cf850 msgr2=0x7f92b80c9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92b80cf850 0x7f92b80c9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 -- 172.21.15.63:0/4265962195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92b80b3e50 msgr2=0x7f92b80b5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92b80b3e50 0x7f92b80b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 -- 172.21.15.63:0/4265962195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b0009400 con 0x7f92b80cfc30 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.853+0000 7f92b7fff640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80cfc30 0x7f92b80c80d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034040 tx=0x7f92b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.854+0000 7f92b4ff9640 1 -- 172.21.15.63:0/4265962195 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b00317d0 con 0x7f92b80cfc30 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.854+0000 7f92b4ff9640 1 -- 172.21.15.63:0/4265962195 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b003a9e0 con 0x7f92b80cfc30 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.854+0000 7f92b4ff9640 1 -- 172.21.15.63:0/4265962195 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b003ad90 con 0x7f92b80cfc30 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.854+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b81f69e0 con 0x7f92b80cfc30 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.854+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b8150820 con 0x7f92b80cfc30 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.855+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b81f6560 con 0x7f92b80cfc30 2023-12-04T10:45:38.856 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.856+0000 7f92b4ff9640 1 -- 172.21.15.63:0/4265962195 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f92b00443f0 con 0x7f92b80cfc30 2023-12-04T10:45:38.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.857+0000 7f92b4ff9640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f929806ae40 0x7f929806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:38.857 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.857+0000 7f92b4ff9640 1 -- 172.21.15.63:0/4265962195 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f92b00ab8f0 con 0x7f92b80cfc30 2023-12-04T10:45:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.857+0000 7f92b77fe640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f929806ae40 0x7f929806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:38.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.858+0000 7f92b77fe640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f929806ae40 0x7f929806d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f92a80070b0 tx=0x7f92a8007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:38.862 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:38.861+0000 7f92b4ff9640 1 -- 172.21.15.63:0/4265962195 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f92b81f6560 con 0x7f92b80cfc30 2023-12-04T10:45:39.055 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.054+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 --> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f92b80cc370 con 0x7f929806ae40 2023-12-04T10:45:39.078 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.077+0000 7f92b4ff9640 1 -- 172.21.15.63:0/4265962195 <== mgr.4107 v2:172.21.15.63:6832/2779630096 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286565 (secure 0 0 0) 0x7f92a8009b10 con 0x7f929806ae40 2023-12-04T10:45:39.083 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:39.084 INFO:teuthology.orchestra.run.smithi063.stderr:dumped all 2023-12-04T10:45:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f929806ae40 msgr2=0x7f929806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f929806ae40 0x7f929806d300 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f92a80070b0 tx=0x7f92a8007040 comp rx=0 tx=0).stop 2023-12-04T10:45:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80cfc30 msgr2=0x7f92b80c80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80cfc30 0x7f92b80c80d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f92b0034040 tx=0x7f92b00046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 shutdown_connections 2023-12-04T10:45:39.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f929806ae40 0x7f929806d300 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.087 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f92b80cf850 0x7f92b80c9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.087 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f92b80cfc30 0x7f92b80c80d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.087 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 --2- 172.21.15.63:0/4265962195 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f92b80b3e50 0x7f92b80b5dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.084+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 >> 172.21.15.63:0/4265962195 conn(0x7f92b80d1000 msgr2=0x7f92b815b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:39.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.085+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 shutdown_connections 2023-12-04T10:45:39.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.085+0000 7f92bdab4640 1 -- 172.21.15.63:0/4265962195 wait complete. 2023-12-04T10:45:39.107 INFO:teuthology.orchestra.run.smithi063.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-12-04T10:45:38.000663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":130,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225196,"kb_used_data":4836,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749524,"statfs":{"total":773094113280,"available":772863512576,"internally_reserved":0,"allocated":4952064,"data_stored":2770936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":37,"apply_latency_ms":37,"commit_latency_ns":37000000,"apply_latency_ns":37000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.954666"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085578+0000","last_change":"2023-12-04T10:45:34.100693+0000","last_active":"2023-12-04T10:45:35.085578+0000","last_peered":"2023-12-04T10:45:35.085578+0000","last_clean":"2023-12-04T10:45:35.085578+0000","last_became_active":"2023-12-04T10:45:34.100365+0000","last_became_peered":"2023-12-04T10:45:34.100365+0000","last_unstale":"2023-12-04T10:45:35.085578+0000","last_undegraded":"2023-12-04T10:45:35.085578+0000","last_fullsized":"2023-12-04T10:45:35.085578+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:53:22.050103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085116+0000","last_change":"2023-12-04T10:45:34.108738+0000","last_active":"2023-12-04T10:45:35.085116+0000","last_peered":"2023-12-04T10:45:35.085116+0000","last_clean":"2023-12-04T10:45:35.085116+0000","last_became_active":"2023-12-04T10:45:34.108390+0000","last_became_peered":"2023-12-04T10:45:34.108390+0000","last_unstale":"2023-12-04T10:45:35.085116+0000","last_undegraded":"2023-12-04T10:45:35.085116+0000","last_fullsized":"2023-12-04T10:45:35.085116+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:56:02.526424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130545+0000","last_change":"2023-12-04T10:45:34.128275+0000","last_active":"2023-12-04T10:45:35.130545+0000","last_peered":"2023-12-04T10:45:35.130545+0000","last_clean":"2023-12-04T10:45:35.130545+0000","last_became_active":"2023-12-04T10:45:34.127723+0000","last_became_peered":"2023-12-04T10:45:34.127723+0000","last_unstale":"2023-12-04T10:45:35.130545+0000","last_undegraded":"2023-12-04T10:45:35.130545+0000","last_fullsized":"2023-12-04T10:45:35.130545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:46:48.342189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.113104+0000","last_change":"2023-12-04T10:45:34.107644+0000","last_active":"2023-12-04T10:45:34.113104+0000","last_peered":"2023-12-04T10:45:34.113104+0000","last_clean":"2023-12-04T10:45:34.113104+0000","last_became_active":"2023-12-04T10:45:34.107322+0000","last_became_peered":"2023-12-04T10:45:34.107322+0000","last_unstale":"2023-12-04T10:45:34.113104+0000","last_undegraded":"2023-12-04T10:45:34.113104+0000","last_fullsized":"2023-12-04T10:45:34.113104+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:41:56.914399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.110131+0000","last_change":"2023-12-04T10:45:34.106968+0000","last_active":"2023-12-04T10:45:34.110131+0000","last_peered":"2023-12-04T10:45:34.110131+0000","last_clean":"2023-12-04T10:45:34.110131+0000","last_became_active":"2023-12-04T10:45:34.106709+0000","last_became_peered":"2023-12-04T10:45:34.106709+0000","last_unstale":"2023-12-04T10:45:34.110131+0000","last_undegraded":"2023-12-04T10:45:34.110131+0000","last_fullsized":"2023-12-04T10:45:34.110131+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:48:57.597937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.112788+0000","last_change":"2023-12-04T10:45:34.103695+0000","last_active":"2023-12-04T10:45:34.112788+0000","last_peered":"2023-12-04T10:45:34.112788+0000","last_clean":"2023-12-04T10:45:34.112788+0000","last_became_active":"2023-12-04T10:45:34.103398+0000","last_became_peered":"2023-12-04T10:45:34.103398+0000","last_unstale":"2023-12-04T10:45:34.112788+0000","last_undegraded":"2023-12-04T10:45:34.112788+0000","last_fullsized":"2023-12-04T10:45:34.112788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:50:24.778209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089074+0000","last_change":"2023-12-04T10:45:34.119742+0000","last_active":"2023-12-04T10:45:35.089074+0000","last_peered":"2023-12-04T10:45:35.089074+0000","last_clean":"2023-12-04T10:45:35.089074+0000","last_became_active":"2023-12-04T10:45:34.119402+0000","last_became_peered":"2023-12-04T10:45:34.119402+0000","last_unstale":"2023-12-04T10:45:35.089074+0000","last_undegraded":"2023-12-04T10:45:35.089074+0000","last_fullsized":"2023-12-04T10:45:35.089074+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:50:48.159119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084323+0000","last_change":"2023-12-04T10:45:34.119084+0000","last_active":"2023-12-04T10:45:35.084323+0000","last_peered":"2023-12-04T10:45:35.084323+0000","last_clean":"2023-12-04T10:45:35.084323+0000","last_became_active":"2023-12-04T10:45:34.118661+0000","last_became_peered":"2023-12-04T10:45:34.118661+0000","last_unstale":"2023-12-04T10:45:35.084323+0000","last_undegraded":"2023-12-04T10:45:35.084323+0000","last_fullsized":"2023-12-04T10:45:35.084323+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:50:48.159119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130783+0000","last_change":"2023-12-04T10:45:34.121264+0000","last_active":"2023-12-04T10:45:35.130783+0000","last_peered":"2023-12-04T10:45:35.130783+0000","last_clean":"2023-12-04T10:45:35.130783+0000","last_became_active":"2023-12-04T10:45:34.119746+0000","last_became_peered":"2023-12-04T10:45:34.119746+0000","last_unstale":"2023-12-04T10:45:35.130783+0000","last_undegraded":"2023-12-04T10:45:35.130783+0000","last_fullsized":"2023-12-04T10:45:35.130783+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:42:20.988056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091346+0000","last_change":"2023-12-04T10:45:34.126223+0000","last_active":"2023-12-04T10:45:35.091346+0000","last_peered":"2023-12-04T10:45:35.091346+0000","last_clean":"2023-12-04T10:45:35.091346+0000","last_became_active":"2023-12-04T10:45:34.125917+0000","last_became_peered":"2023-12-04T10:45:34.125917+0000","last_unstale":"2023-12-04T10:45:35.091346+0000","last_undegraded":"2023-12-04T10:45:35.091346+0000","last_fullsized":"2023-12-04T10:45:35.091346+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:53:22.050103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090361+0000","last_change":"2023-12-04T10:45:34.122262+0000","last_active":"2023-12-04T10:45:35.090361+0000","last_peered":"2023-12-04T10:45:35.090361+0000","last_clean":"2023-12-04T10:45:35.090361+0000","last_became_active":"2023-12-04T10:45:34.121205+0000","last_became_peered":"2023-12-04T10:45:34.121205+0000","last_unstale":"2023-12-04T10:45:35.090361+0000","last_undegraded":"2023-12-04T10:45:35.090361+0000","last_fullsized":"2023-12-04T10:45:35.090361+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:27:43.683219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130684+0000","last_change":"2023-12-04T10:45:34.117818+0000","last_active":"2023-12-04T10:45:35.130684+0000","last_peered":"2023-12-04T10:45:35.130684+0000","last_clean":"2023-12-04T10:45:35.130684+0000","last_became_active":"2023-12-04T10:45:34.117155+0000","last_became_peered":"2023-12-04T10:45:34.117155+0000","last_unstale":"2023-12-04T10:45:35.130684+0000","last_undegraded":"2023-12-04T10:45:35.130684+0000","last_fullsized":"2023-12-04T10:45:35.130684+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:07:41.161586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089360+0000","last_change":"2023-12-04T10:45:34.125096+0000","last_active":"2023-12-04T10:45:35.089360+0000","last_peered":"2023-12-04T10:45:35.089360+0000","last_clean":"2023-12-04T10:45:35.089360+0000","last_became_active":"2023-12-04T10:45:34.124808+0000","last_became_peered":"2023-12-04T10:45:34.124808+0000","last_unstale":"2023-12-04T10:45:35.089360+0000","last_undegraded":"2023-12-04T10:45:35.089360+0000","last_fullsized":"2023-12-04T10:45:35.089360+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:17.785361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.106286+0000","last_change":"2023-12-04T10:45:34.100930+0000","last_active":"2023-12-04T10:45:34.106286+0000","last_peered":"2023-12-04T10:45:34.106286+0000","last_clean":"2023-12-04T10:45:34.106286+0000","last_became_active":"2023-12-04T10:45:34.100209+0000","last_became_peered":"2023-12-04T10:45:34.100209+0000","last_unstale":"2023-12-04T10:45:34.106286+0000","last_undegraded":"2023-12-04T10:45:34.106286+0000","last_fullsized":"2023-12-04T10:45:34.106286+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:29:32.254118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089076+0000","last_change":"2023-12-04T10:45:34.130538+0000","last_active":"2023-12-04T10:45:35.089076+0000","last_peered":"2023-12-04T10:45:35.089076+0000","last_clean":"2023-12-04T10:45:35.089076+0000","last_became_active":"2023-12-04T10:45:34.127618+0000","last_became_peered":"2023-12-04T10:45:34.127618+0000","last_unstale":"2023-12-04T10:45:35.089076+0000","last_undegraded":"2023-12-04T10:45:35.089076+0000","last_fullsized":"2023-12-04T10:45:35.089076+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:53:36.311196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132415+0000","last_change":"2023-12-04T10:45:34.128785+0000","last_active":"2023-12-04T10:45:35.132415+0000","last_peered":"2023-12-04T10:45:35.132415+0000","last_clean":"2023-12-04T10:45:35.132415+0000","last_became_active":"2023-12-04T10:45:34.128451+0000","last_became_peered":"2023-12-04T10:45:34.128451+0000","last_unstale":"2023-12-04T10:45:35.132415+0000","last_undegraded":"2023-12-04T10:45:35.132415+0000","last_fullsized":"2023-12-04T10:45:35.132415+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:42:20.988056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.135256+0000","last_change":"2023-12-04T10:45:34.119944+0000","last_active":"2023-12-04T10:45:35.135256+0000","last_peered":"2023-12-04T10:45:35.135256+0000","last_clean":"2023-12-04T10:45:35.135256+0000","last_became_active":"2023-12-04T10:45:34.119644+0000","last_became_peered":"2023-12-04T10:45:34.119644+0000","last_unstale":"2023-12-04T10:45:35.135256+0000","last_undegraded":"2023-12-04T10:45:35.135256+0000","last_fullsized":"2023-12-04T10:45:35.135256+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:17.785361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133288+0000","last_change":"2023-12-04T10:45:34.110492+0000","last_active":"2023-12-04T10:45:35.133288+0000","last_peered":"2023-12-04T10:45:35.133288+0000","last_clean":"2023-12-04T10:45:35.133288+0000","last_became_active":"2023-12-04T10:45:34.110205+0000","last_became_peered":"2023-12-04T10:45:34.110205+0000","last_unstale":"2023-12-04T10:45:35.133288+0000","last_undegraded":"2023-12-04T10:45:35.133288+0000","last_fullsized":"2023-12-04T10:45:35.133288+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:25:21.490281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.109544+0000","last_change":"2023-12-04T10:45:34.104502+0000","last_active":"2023-12-04T10:45:34.109544+0000","last_peered":"2023-12-04T10:45:34.109544+0000","last_clean":"2023-12-04T10:45:34.109544+0000","last_became_active":"2023-12-04T10:45:34.104198+0000","last_became_peered":"2023-12-04T10:45:34.104198+0000","last_unstale":"2023-12-04T10:45:34.109544+0000","last_undegraded":"2023-12-04T10:45:34.109544+0000","last_fullsized":"2023-12-04T10:45:34.109544+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:54:07.424272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133080+0000","last_change":"2023-12-04T10:45:34.103523+0000","last_active":"2023-12-04T10:45:35.133080+0000","last_peered":"2023-12-04T10:45:35.133080+0000","last_clean":"2023-12-04T10:45:35.133080+0000","last_became_active":"2023-12-04T10:45:34.103009+0000","last_became_peered":"2023-12-04T10:45:34.103009+0000","last_unstale":"2023-12-04T10:45:35.133080+0000","last_undegraded":"2023-12-04T10:45:35.133080+0000","last_fullsized":"2023-12-04T10:45:35.133080+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:47:18.394455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089745+0000","last_change":"2023-12-04T10:45:34.128919+0000","last_active":"2023-12-04T10:45:35.089745+0000","last_peered":"2023-12-04T10:45:35.089745+0000","last_clean":"2023-12-04T10:45:35.089745+0000","last_became_active":"2023-12-04T10:45:34.128638+0000","last_became_peered":"2023-12-04T10:45:34.128638+0000","last_unstale":"2023-12-04T10:45:35.089745+0000","last_undegraded":"2023-12-04T10:45:35.089745+0000","last_fullsized":"2023-12-04T10:45:35.089745+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:39:15.362938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.112209+0000","last_change":"2023-12-04T10:45:34.105881+0000","last_active":"2023-12-04T10:45:34.112209+0000","last_peered":"2023-12-04T10:45:34.112209+0000","last_clean":"2023-12-04T10:45:34.112209+0000","last_became_active":"2023-12-04T10:45:34.105414+0000","last_became_peered":"2023-12-04T10:45:34.105414+0000","last_unstale":"2023-12-04T10:45:34.112209+0000","last_undegraded":"2023-12-04T10:45:34.112209+0000","last_fullsized":"2023-12-04T10:45:34.112209+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:23:36.342055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132906+0000","last_change":"2023-12-04T10:45:34.118048+0000","last_active":"2023-12-04T10:45:35.132906+0000","last_peered":"2023-12-04T10:45:35.132906+0000","last_clean":"2023-12-04T10:45:35.132906+0000","last_became_active":"2023-12-04T10:45:34.117742+0000","last_became_peered":"2023-12-04T10:45:34.117742+0000","last_unstale":"2023-12-04T10:45:35.132906+0000","last_undegraded":"2023-12-04T10:45:35.132906+0000","last_fullsized":"2023-12-04T10:45:35.132906+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:57:59.767141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.118839+0000","last_change":"2023-12-04T10:45:34.112570+0000","last_active":"2023-12-04T10:45:34.118839+0000","last_peered":"2023-12-04T10:45:34.118839+0000","last_clean":"2023-12-04T10:45:34.118839+0000","last_became_active":"2023-12-04T10:45:34.112178+0000","last_became_peered":"2023-12-04T10:45:34.112178+0000","last_unstale":"2023-12-04T10:45:34.118839+0000","last_undegraded":"2023-12-04T10:45:34.118839+0000","last_fullsized":"2023-12-04T10:45:34.118839+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:09:46.713133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133675+0000","last_change":"2023-12-04T10:45:34.104233+0000","last_active":"2023-12-04T10:45:35.133675+0000","last_peered":"2023-12-04T10:45:35.133675+0000","last_clean":"2023-12-04T10:45:35.133675+0000","last_became_active":"2023-12-04T10:45:34.101572+0000","last_became_peered":"2023-12-04T10:45:34.101572+0000","last_unstale":"2023-12-04T10:45:35.133675+0000","last_undegraded":"2023-12-04T10:45:35.133675+0000","last_fullsized":"2023-12-04T10:45:35.133675+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:41:39.912748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.127831+0000","last_change":"2023-12-04T10:45:34.121111+0000","last_active":"2023-12-04T10:45:34.127831+0000","last_peered":"2023-12-04T10:45:34.127831+0000","last_clean":"2023-12-04T10:45:34.127831+0000","last_became_active":"2023-12-04T10:45:34.120833+0000","last_became_peered":"2023-12-04T10:45:34.120833+0000","last_unstale":"2023-12-04T10:45:34.127831+0000","last_undegraded":"2023-12-04T10:45:34.127831+0000","last_fullsized":"2023-12-04T10:45:34.127831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:36:43.746710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133506+0000","last_change":"2023-12-04T10:45:34.108936+0000","last_active":"2023-12-04T10:45:35.133506+0000","last_peered":"2023-12-04T10:45:35.133506+0000","last_clean":"2023-12-04T10:45:35.133506+0000","last_became_active":"2023-12-04T10:45:34.108532+0000","last_became_peered":"2023-12-04T10:45:34.108532+0000","last_unstale":"2023-12-04T10:45:35.133506+0000","last_undegraded":"2023-12-04T10:45:35.133506+0000","last_fullsized":"2023-12-04T10:45:35.133506+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:55.351864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090591+0000","last_change":"2023-12-04T10:45:34.121308+0000","last_active":"2023-12-04T10:45:35.090591+0000","last_peered":"2023-12-04T10:45:35.090591+0000","last_clean":"2023-12-04T10:45:35.090591+0000","last_became_active":"2023-12-04T10:45:34.119719+0000","last_became_peered":"2023-12-04T10:45:34.119719+0000","last_unstale":"2023-12-04T10:45:35.090591+0000","last_undegraded":"2023-12-04T10:45:35.090591+0000","last_fullsized":"2023-12-04T10:45:35.090591+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:56:02.526424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132515+0000","last_change":"2023-12-04T10:45:34.106557+0000","last_active":"2023-12-04T10:45:35.132515+0000","last_peered":"2023-12-04T10:45:35.132515+0000","last_clean":"2023-12-04T10:45:35.132515+0000","last_became_active":"2023-12-04T10:45:34.106232+0000","last_became_peered":"2023-12-04T10:45:34.106232+0000","last_unstale":"2023-12-04T10:45:35.132515+0000","last_undegraded":"2023-12-04T10:45:35.132515+0000","last_fullsized":"2023-12-04T10:45:35.132515+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:05:54.353270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132280+0000","last_change":"2023-12-04T10:45:34.103829+0000","last_active":"2023-12-04T10:45:35.132280+0000","last_peered":"2023-12-04T10:45:35.132280+0000","last_clean":"2023-12-04T10:45:35.132280+0000","last_became_active":"2023-12-04T10:45:34.102582+0000","last_became_peered":"2023-12-04T10:45:34.102582+0000","last_unstale":"2023-12-04T10:45:35.132280+0000","last_undegraded":"2023-12-04T10:45:35.132280+0000","last_fullsized":"2023-12-04T10:45:35.132280+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:15:29.038889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133651+0000","last_change":"2023-12-04T10:45:34.121263+0000","last_active":"2023-12-04T10:45:35.133651+0000","last_peered":"2023-12-04T10:45:35.133651+0000","last_clean":"2023-12-04T10:45:35.133651+0000","last_became_active":"2023-12-04T10:45:34.120648+0000","last_became_peered":"2023-12-04T10:45:34.120648+0000","last_unstale":"2023-12-04T10:45:35.133651+0000","last_undegraded":"2023-12-04T10:45:35.133651+0000","last_fullsized":"2023-12-04T10:45:35.133651+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:54:25.846936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.116085+0000","last_change":"2023-12-04T10:45:34.110770+0000","last_active":"2023-12-04T10:45:34.116085+0000","last_peered":"2023-12-04T10:45:34.116085+0000","last_clean":"2023-12-04T10:45:34.116085+0000","last_became_active":"2023-12-04T10:45:34.110427+0000","last_became_peered":"2023-12-04T10:45:34.110427+0000","last_unstale":"2023-12-04T10:45:34.116085+0000","last_undegraded":"2023-12-04T10:45:34.116085+0000","last_fullsized":"2023-12-04T10:45:34.116085+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:23:36.342055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134788+0000","last_change":"2023-12-04T10:45:34.128714+0000","last_active":"2023-12-04T10:45:35.134788+0000","last_peered":"2023-12-04T10:45:35.134788+0000","last_clean":"2023-12-04T10:45:35.134788+0000","last_became_active":"2023-12-04T10:45:34.128409+0000","last_became_peered":"2023-12-04T10:45:34.128409+0000","last_unstale":"2023-12-04T10:45:35.134788+0000","last_undegraded":"2023-12-04T10:45:35.134788+0000","last_fullsized":"2023-12-04T10:45:35.134788+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:50:48.159119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"40'4","reported_seq":16,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133654+0000","last_change":"2023-12-04T10:45:33.094065+0000","last_active":"2023-12-04T10:45:35.133654+0000","last_peered":"2023-12-04T10:45:35.133654+0000","last_clean":"2023-12-04T10:45:35.133654+0000","last_became_active":"2023-12-04T10:45:33.093782+0000","last_became_peered":"2023-12-04T10:45:33.093782+0000","last_unstale":"2023-12-04T10:45:35.133654+0000","last_undegraded":"2023-12-04T10:45:35.133654+0000","last_fullsized":"2023-12-04T10:45:35.133654+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:54:49.202109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.129910+0000","last_change":"2023-12-04T10:45:34.125273+0000","last_active":"2023-12-04T10:45:34.129910+0000","last_peered":"2023-12-04T10:45:34.129910+0000","last_clean":"2023-12-04T10:45:34.129910+0000","last_became_active":"2023-12-04T10:45:34.124843+0000","last_became_peered":"2023-12-04T10:45:34.124843+0000","last_unstale":"2023-12-04T10:45:34.129910+0000","last_undegraded":"2023-12-04T10:45:34.129910+0000","last_fullsized":"2023-12-04T10:45:34.129910+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:57:47.484649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130305+0000","last_change":"2023-12-04T10:45:33.084245+0000","last_active":"2023-12-04T10:45:35.130305+0000","last_peered":"2023-12-04T10:45:35.130305+0000","last_clean":"2023-12-04T10:45:35.130305+0000","last_became_active":"2023-12-04T10:45:33.083982+0000","last_became_peered":"2023-12-04T10:45:33.083982+0000","last_unstale":"2023-12-04T10:45:35.130305+0000","last_undegraded":"2023-12-04T10:45:35.130305+0000","last_fullsized":"2023-12-04T10:45:35.130305+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T10:47:17.379638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.108366+0000","last_change":"2023-12-04T10:45:34.095675+0000","last_active":"2023-12-04T10:45:34.108366+0000","last_peered":"2023-12-04T10:45:34.108366+0000","last_clean":"2023-12-04T10:45:34.108366+0000","last_became_active":"2023-12-04T10:45:34.094911+0000","last_became_peered":"2023-12-04T10:45:34.094911+0000","last_unstale":"2023-12-04T10:45:34.108366+0000","last_undegraded":"2023-12-04T10:45:34.108366+0000","last_fullsized":"2023-12-04T10:45:34.108366+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:22:42.797382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.130242+0000","last_change":"2023-12-04T10:45:33.090258+0000","last_active":"2023-12-04T10:45:34.130242+0000","last_peered":"2023-12-04T10:45:34.130242+0000","last_clean":"2023-12-04T10:45:34.130242+0000","last_became_active":"2023-12-04T10:45:33.089935+0000","last_became_peered":"2023-12-04T10:45:33.089935+0000","last_unstale":"2023-12-04T10:45:34.130242+0000","last_undegraded":"2023-12-04T10:45:34.130242+0000","last_fullsized":"2023-12-04T10:45:34.130242+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:31:08.521400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085438+0000","last_change":"2023-12-04T10:45:34.092556+0000","last_active":"2023-12-04T10:45:35.085438+0000","last_peered":"2023-12-04T10:45:35.085438+0000","last_clean":"2023-12-04T10:45:35.085438+0000","last_became_active":"2023-12-04T10:45:34.092134+0000","last_became_peered":"2023-12-04T10:45:34.092134+0000","last_unstale":"2023-12-04T10:45:35.085438+0000","last_undegraded":"2023-12-04T10:45:35.085438+0000","last_fullsized":"2023-12-04T10:45:35.085438+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:08:09.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.136266+0000","last_change":"2023-12-04T10:45:33.086534+0000","last_active":"2023-12-04T10:45:34.136266+0000","last_peered":"2023-12-04T10:45:34.136266+0000","last_clean":"2023-12-04T10:45:34.136266+0000","last_became_active":"2023-12-04T10:45:33.085351+0000","last_became_peered":"2023-12-04T10:45:33.085351+0000","last_unstale":"2023-12-04T10:45:34.136266+0000","last_undegraded":"2023-12-04T10:45:34.136266+0000","last_fullsized":"2023-12-04T10:45:34.136266+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:36:42.731893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.129733+0000","last_change":"2023-12-04T10:45:34.105081+0000","last_active":"2023-12-04T10:45:35.129733+0000","last_peered":"2023-12-04T10:45:35.129733+0000","last_clean":"2023-12-04T10:45:35.129733+0000","last_became_active":"2023-12-04T10:45:34.104811+0000","last_became_peered":"2023-12-04T10:45:34.104811+0000","last_unstale":"2023-12-04T10:45:35.129733+0000","last_undegraded":"2023-12-04T10:45:35.129733+0000","last_fullsized":"2023-12-04T10:45:35.129733+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:55:26.077684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090076+0000","last_change":"2023-12-04T10:45:33.077415+0000","last_active":"2023-12-04T10:45:35.090076+0000","last_peered":"2023-12-04T10:45:35.090076+0000","last_clean":"2023-12-04T10:45:35.090076+0000","last_became_active":"2023-12-04T10:45:33.076904+0000","last_became_peered":"2023-12-04T10:45:33.076904+0000","last_unstale":"2023-12-04T10:45:35.090076+0000","last_undegraded":"2023-12-04T10:45:35.090076+0000","last_fullsized":"2023-12-04T10:45:35.090076+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:57:58.752325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089484+0000","last_change":"2023-12-04T10:45:34.119025+0000","last_active":"2023-12-04T10:45:35.089484+0000","last_peered":"2023-12-04T10:45:35.089484+0000","last_clean":"2023-12-04T10:45:35.089484+0000","last_became_active":"2023-12-04T10:45:34.118559+0000","last_became_peered":"2023-12-04T10:45:34.118559+0000","last_unstale":"2023-12-04T10:45:35.089484+0000","last_undegraded":"2023-12-04T10:45:35.089484+0000","last_fullsized":"2023-12-04T10:45:35.089484+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:38:38.594954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134096+0000","last_change":"2023-12-04T10:45:33.090801+0000","last_active":"2023-12-04T10:45:35.134096+0000","last_peered":"2023-12-04T10:45:35.134096+0000","last_clean":"2023-12-04T10:45:35.134096+0000","last_became_active":"2023-12-04T10:45:33.090506+0000","last_became_peered":"2023-12-04T10:45:33.090506+0000","last_unstale":"2023-12-04T10:45:35.134096+0000","last_undegraded":"2023-12-04T10:45:35.134096+0000","last_fullsized":"2023-12-04T10:45:35.134096+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:54:49.202109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.126670+0000","last_change":"2023-12-04T10:45:34.120804+0000","last_active":"2023-12-04T10:45:34.126670+0000","last_peered":"2023-12-04T10:45:34.126670+0000","last_clean":"2023-12-04T10:45:34.126670+0000","last_became_active":"2023-12-04T10:45:34.120485+0000","last_became_peered":"2023-12-04T10:45:34.120485+0000","last_unstale":"2023-12-04T10:45:34.126670+0000","last_undegraded":"2023-12-04T10:45:34.126670+0000","last_fullsized":"2023-12-04T10:45:34.126670+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:02:36.623447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.093728+0000","last_change":"2023-12-04T10:45:33.084346+0000","last_active":"2023-12-04T10:45:34.093728+0000","last_peered":"2023-12-04T10:45:34.093728+0000","last_clean":"2023-12-04T10:45:34.093728+0000","last_became_active":"2023-12-04T10:45:33.084172+0000","last_became_peered":"2023-12-04T10:45:33.084172+0000","last_unstale":"2023-12-04T10:45:34.093728+0000","last_undegraded":"2023-12-04T10:45:34.093728+0000","last_fullsized":"2023-12-04T10:45:34.093728+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:51:30.763983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084640+0000","last_change":"2023-12-04T10:45:34.115666+0000","last_active":"2023-12-04T10:45:35.084640+0000","last_peered":"2023-12-04T10:45:35.084640+0000","last_clean":"2023-12-04T10:45:35.084640+0000","last_became_active":"2023-12-04T10:45:34.115384+0000","last_became_peered":"2023-12-04T10:45:34.115384+0000","last_unstale":"2023-12-04T10:45:35.084640+0000","last_undegraded":"2023-12-04T10:45:35.084640+0000","last_fullsized":"2023-12-04T10:45:35.084640+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:17.785361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.085629+0000","last_change":"2023-12-04T10:45:33.089922+0000","last_active":"2023-12-04T10:45:34.085629+0000","last_peered":"2023-12-04T10:45:34.085629+0000","last_clean":"2023-12-04T10:45:34.085629+0000","last_became_active":"2023-12-04T10:45:33.089579+0000","last_became_peered":"2023-12-04T10:45:33.089579+0000","last_unstale":"2023-12-04T10:45:34.085629+0000","last_undegraded":"2023-12-04T10:45:34.085629+0000","last_fullsized":"2023-12-04T10:45:34.085629+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:45:05.812639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.114980+0000","last_change":"2023-12-04T10:45:34.108809+0000","last_active":"2023-12-04T10:45:34.114980+0000","last_peered":"2023-12-04T10:45:34.114980+0000","last_clean":"2023-12-04T10:45:34.114980+0000","last_became_active":"2023-12-04T10:45:34.105828+0000","last_became_peered":"2023-12-04T10:45:34.105828+0000","last_unstale":"2023-12-04T10:45:34.114980+0000","last_undegraded":"2023-12-04T10:45:34.114980+0000","last_fullsized":"2023-12-04T10:45:34.114980+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:28:09.665581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085694+0000","last_change":"2023-12-04T10:45:33.081093+0000","last_active":"2023-12-04T10:45:35.085694+0000","last_peered":"2023-12-04T10:45:35.085694+0000","last_clean":"2023-12-04T10:45:35.085694+0000","last_became_active":"2023-12-04T10:45:33.080819+0000","last_became_peered":"2023-12-04T10:45:33.080819+0000","last_unstale":"2023-12-04T10:45:35.085694+0000","last_undegraded":"2023-12-04T10:45:35.085694+0000","last_fullsized":"2023-12-04T10:45:35.085694+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:12:24.442812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134708+0000","last_change":"2023-12-04T10:45:34.111801+0000","last_active":"2023-12-04T10:45:35.134708+0000","last_peered":"2023-12-04T10:45:35.134708+0000","last_clean":"2023-12-04T10:45:35.134708+0000","last_became_active":"2023-12-04T10:45:34.111351+0000","last_became_peered":"2023-12-04T10:45:34.111351+0000","last_unstale":"2023-12-04T10:45:35.134708+0000","last_undegraded":"2023-12-04T10:45:35.134708+0000","last_fullsized":"2023-12-04T10:45:35.134708+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:12:25.457628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091574+0000","last_change":"2023-12-04T10:45:33.083939+0000","last_active":"2023-12-04T10:45:35.091574+0000","last_peered":"2023-12-04T10:45:35.091574+0000","last_clean":"2023-12-04T10:45:35.091574+0000","last_became_active":"2023-12-04T10:45:33.083540+0000","last_became_peered":"2023-12-04T10:45:33.083540+0000","last_unstale":"2023-12-04T10:45:35.091574+0000","last_undegraded":"2023-12-04T10:45:35.091574+0000","last_fullsized":"2023-12-04T10:45:35.091574+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:54:24.832119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130496+0000","last_change":"2023-12-04T10:45:34.116144+0000","last_active":"2023-12-04T10:45:35.130496+0000","last_peered":"2023-12-04T10:45:35.130496+0000","last_clean":"2023-12-04T10:45:35.130496+0000","last_became_active":"2023-12-04T10:45:34.115821+0000","last_became_peered":"2023-12-04T10:45:34.115821+0000","last_unstale":"2023-12-04T10:45:35.130496+0000","last_undegraded":"2023-12-04T10:45:35.130496+0000","last_fullsized":"2023-12-04T10:45:35.130496+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:46:24.788437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"40'3","reported_seq":15,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090965+0000","last_change":"2023-12-04T10:45:33.088706+0000","last_active":"2023-12-04T10:45:35.090965+0000","last_peered":"2023-12-04T10:45:35.090965+0000","last_clean":"2023-12-04T10:45:35.090965+0000","last_became_active":"2023-12-04T10:45:33.087297+0000","last_became_peered":"2023-12-04T10:45:33.087297+0000","last_unstale":"2023-12-04T10:45:35.090965+0000","last_undegraded":"2023-12-04T10:45:35.090965+0000","last_fullsized":"2023-12-04T10:45:35.090965+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:25:38.355536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.114304+0000","last_change":"2023-12-04T10:45:34.108569+0000","last_active":"2023-12-04T10:45:34.114304+0000","last_peered":"2023-12-04T10:45:34.114304+0000","last_clean":"2023-12-04T10:45:34.114304+0000","last_became_active":"2023-12-04T10:45:34.108264+0000","last_became_peered":"2023-12-04T10:45:34.108264+0000","last_unstale":"2023-12-04T10:45:34.114304+0000","last_undegraded":"2023-12-04T10:45:34.114304+0000","last_fullsized":"2023-12-04T10:45:34.114304+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:57:44.026584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"40'6","reported_seq":18,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085180+0000","last_change":"2023-12-04T10:45:33.085611+0000","last_active":"2023-12-04T10:45:35.085180+0000","last_peered":"2023-12-04T10:45:35.085180+0000","last_clean":"2023-12-04T10:45:35.085180+0000","last_became_active":"2023-12-04T10:45:33.085146+0000","last_became_peered":"2023-12-04T10:45:33.085146+0000","last_unstale":"2023-12-04T10:45:35.085180+0000","last_undegraded":"2023-12-04T10:45:35.085180+0000","last_fullsized":"2023-12-04T10:45:35.085180+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:55:25.062868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.129450+0000","last_change":"2023-12-04T10:45:34.124698+0000","last_active":"2023-12-04T10:45:35.129450+0000","last_peered":"2023-12-04T10:45:35.129450+0000","last_clean":"2023-12-04T10:45:35.129450+0000","last_became_active":"2023-12-04T10:45:34.123842+0000","last_became_peered":"2023-12-04T10:45:34.123842+0000","last_unstale":"2023-12-04T10:45:35.129450+0000","last_undegraded":"2023-12-04T10:45:35.129450+0000","last_fullsized":"2023-12-04T10:45:35.129450+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:55.351864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084813+0000","last_change":"2023-12-04T10:45:33.077176+0000","last_active":"2023-12-04T10:45:35.084813+0000","last_peered":"2023-12-04T10:45:35.084813+0000","last_clean":"2023-12-04T10:45:35.084813+0000","last_became_active":"2023-12-04T10:45:33.076872+0000","last_became_peered":"2023-12-04T10:45:33.076872+0000","last_unstale":"2023-12-04T10:45:35.084813+0000","last_undegraded":"2023-12-04T10:45:35.084813+0000","last_fullsized":"2023-12-04T10:45:35.084813+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:40:05.587536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084583+0000","last_change":"2023-12-04T10:45:34.105764+0000","last_active":"2023-12-04T10:45:35.084583+0000","last_peered":"2023-12-04T10:45:35.084583+0000","last_clean":"2023-12-04T10:45:35.084583+0000","last_became_active":"2023-12-04T10:45:34.105394+0000","last_became_peered":"2023-12-04T10:45:34.105394+0000","last_unstale":"2023-12-04T10:45:35.084583+0000","last_undegraded":"2023-12-04T10:45:35.084583+0000","last_fullsized":"2023-12-04T10:45:35.084583+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:53:36.311196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.090123+0000","last_change":"2023-12-04T10:45:33.084345+0000","last_active":"2023-12-04T10:45:34.090123+0000","last_peered":"2023-12-04T10:45:34.090123+0000","last_clean":"2023-12-04T10:45:34.090123+0000","last_became_active":"2023-12-04T10:45:33.084036+0000","last_became_peered":"2023-12-04T10:45:33.084036+0000","last_unstale":"2023-12-04T10:45:34.090123+0000","last_undegraded":"2023-12-04T10:45:34.090123+0000","last_fullsized":"2023-12-04T10:45:34.090123+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:29:31.239301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134167+0000","last_change":"2023-12-04T10:45:34.114303+0000","last_active":"2023-12-04T10:45:35.134167+0000","last_peered":"2023-12-04T10:45:35.134167+0000","last_clean":"2023-12-04T10:45:35.134167+0000","last_became_active":"2023-12-04T10:45:34.112494+0000","last_became_peered":"2023-12-04T10:45:34.112494+0000","last_unstale":"2023-12-04T10:45:35.134167+0000","last_undegraded":"2023-12-04T10:45:35.134167+0000","last_fullsized":"2023-12-04T10:45:35.134167+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:03:30.057211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.131792+0000","last_change":"2023-12-04T10:45:33.090873+0000","last_active":"2023-12-04T10:45:35.131792+0000","last_peered":"2023-12-04T10:45:35.131792+0000","last_clean":"2023-12-04T10:45:35.131792+0000","last_became_active":"2023-12-04T10:45:33.090466+0000","last_became_peered":"2023-12-04T10:45:33.090466+0000","last_unstale":"2023-12-04T10:45:35.131792+0000","last_undegraded":"2023-12-04T10:45:35.131792+0000","last_fullsized":"2023-12-04T10:45:35.131792+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:27:59.946789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084718+0000","last_change":"2023-12-04T10:45:34.105204+0000","last_active":"2023-12-04T10:45:35.084718+0000","last_peered":"2023-12-04T10:45:35.084718+0000","last_clean":"2023-12-04T10:45:35.084718+0000","last_became_active":"2023-12-04T10:45:34.104960+0000","last_became_peered":"2023-12-04T10:45:34.104960+0000","last_unstale":"2023-12-04T10:45:35.084718+0000","last_undegraded":"2023-12-04T10:45:35.084718+0000","last_fullsized":"2023-12-04T10:45:35.084718+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:38:38.594954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"40'8","reported_seq":20,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133162+0000","last_change":"2023-12-04T10:45:33.090176+0000","last_active":"2023-12-04T10:45:35.133162+0000","last_peered":"2023-12-04T10:45:35.133162+0000","last_clean":"2023-12-04T10:45:35.133162+0000","last_became_active":"2023-12-04T10:45:33.089856+0000","last_became_peered":"2023-12-04T10:45:33.089856+0000","last_unstale":"2023-12-04T10:45:35.133162+0000","last_undegraded":"2023-12-04T10:45:35.133162+0000","last_fullsized":"2023-12-04T10:45:35.133162+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T11:46:23.773621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085098+0000","last_change":"2023-12-04T10:45:34.096331+0000","last_active":"2023-12-04T10:45:35.085098+0000","last_peered":"2023-12-04T10:45:35.085098+0000","last_clean":"2023-12-04T10:45:35.085098+0000","last_became_active":"2023-12-04T10:45:34.093449+0000","last_became_peered":"2023-12-04T10:45:34.093449+0000","last_unstale":"2023-12-04T10:45:35.085098+0000","last_undegraded":"2023-12-04T10:45:35.085098+0000","last_fullsized":"2023-12-04T10:45:35.085098+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:27:43.683219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"40'1","reported_seq":13,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091653+0000","last_change":"2023-12-04T10:45:33.092446+0000","last_active":"2023-12-04T10:45:35.091653+0000","last_peered":"2023-12-04T10:45:35.091653+0000","last_clean":"2023-12-04T10:45:35.091653+0000","last_became_active":"2023-12-04T10:45:33.091983+0000","last_became_peered":"2023-12-04T10:45:33.091983+0000","last_unstale":"2023-12-04T10:45:35.091653+0000","last_undegraded":"2023-12-04T10:45:35.091653+0000","last_fullsized":"2023-12-04T10:45:35.091653+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:03:29.042395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.090692+0000","last_change":"2023-12-04T10:45:34.122681+0000","last_active":"2023-12-04T10:45:35.090692+0000","last_peered":"2023-12-04T10:45:35.090692+0000","last_clean":"2023-12-04T10:45:35.090692+0000","last_became_active":"2023-12-04T10:45:34.122140+0000","last_became_peered":"2023-12-04T10:45:34.122140+0000","last_unstale":"2023-12-04T10:45:35.090692+0000","last_undegraded":"2023-12-04T10:45:35.090692+0000","last_fullsized":"2023-12-04T10:45:35.090692+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:08:09.856300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.133844+0000","last_change":"2023-12-04T10:45:33.086008+0000","last_active":"2023-12-04T10:45:34.133844+0000","last_peered":"2023-12-04T10:45:34.133844+0000","last_clean":"2023-12-04T10:45:34.133844+0000","last_became_active":"2023-12-04T10:45:33.085563+0000","last_became_peered":"2023-12-04T10:45:33.085563+0000","last_unstale":"2023-12-04T10:45:34.133844+0000","last_undegraded":"2023-12-04T10:45:34.133844+0000","last_fullsized":"2023-12-04T10:45:34.133844+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:57:46.469833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.108391+0000","last_change":"2023-12-04T10:45:34.100880+0000","last_active":"2023-12-04T10:45:34.108391+0000","last_peered":"2023-12-04T10:45:34.108391+0000","last_clean":"2023-12-04T10:45:34.108391+0000","last_became_active":"2023-12-04T10:45:34.100464+0000","last_became_peered":"2023-12-04T10:45:34.100464+0000","last_unstale":"2023-12-04T10:45:34.108391+0000","last_undegraded":"2023-12-04T10:45:34.108391+0000","last_fullsized":"2023-12-04T10:45:34.108391+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:26:59.418604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"40'1","reported_seq":12,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.132881+0000","last_change":"2023-12-04T10:45:33.083381+0000","last_active":"2023-12-04T10:45:34.132881+0000","last_peered":"2023-12-04T10:45:34.132881+0000","last_clean":"2023-12-04T10:45:34.132881+0000","last_became_active":"2023-12-04T10:45:33.083167+0000","last_became_peered":"2023-12-04T10:45:33.083167+0000","last_unstale":"2023-12-04T10:45:34.132881+0000","last_undegraded":"2023-12-04T10:45:34.132881+0000","last_fullsized":"2023-12-04T10:45:34.132881+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:51:17.352561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.109886+0000","last_change":"2023-12-04T10:45:34.107879+0000","last_active":"2023-12-04T10:45:34.109886+0000","last_peered":"2023-12-04T10:45:34.109886+0000","last_clean":"2023-12-04T10:45:34.109886+0000","last_became_active":"2023-12-04T10:45:34.105709+0000","last_became_peered":"2023-12-04T10:45:34.105709+0000","last_unstale":"2023-12-04T10:45:34.109886+0000","last_undegraded":"2023-12-04T10:45:34.109886+0000","last_fullsized":"2023-12-04T10:45:34.109886+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:35:48.756116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.097365+0000","last_change":"2023-12-04T10:45:33.090431+0000","last_active":"2023-12-04T10:45:34.097365+0000","last_peered":"2023-12-04T10:45:34.097365+0000","last_clean":"2023-12-04T10:45:34.097365+0000","last_became_active":"2023-12-04T10:45:33.090183+0000","last_became_peered":"2023-12-04T10:45:33.090183+0000","last_unstale":"2023-12-04T10:45:34.097365+0000","last_undegraded":"2023-12-04T10:45:34.097365+0000","last_fullsized":"2023-12-04T10:45:34.097365+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:45:34.034455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132906+0000","last_change":"2023-12-04T10:45:34.112887+0000","last_active":"2023-12-04T10:45:35.132906+0000","last_peered":"2023-12-04T10:45:35.132906+0000","last_clean":"2023-12-04T10:45:35.132906+0000","last_became_active":"2023-12-04T10:45:34.111949+0000","last_became_peered":"2023-12-04T10:45:34.111949+0000","last_unstale":"2023-12-04T10:45:35.132906+0000","last_undegraded":"2023-12-04T10:45:35.132906+0000","last_fullsized":"2023-12-04T10:45:35.132906+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:25:39.370353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"40'2","reported_seq":13,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.130565+0000","last_change":"2023-12-04T10:45:33.077118+0000","last_active":"2023-12-04T10:45:34.130565+0000","last_peered":"2023-12-04T10:45:34.130565+0000","last_clean":"2023-12-04T10:45:34.130565+0000","last_became_active":"2023-12-04T10:45:33.076750+0000","last_became_peered":"2023-12-04T10:45:33.076750+0000","last_unstale":"2023-12-04T10:45:34.130565+0000","last_undegraded":"2023-12-04T10:45:34.130565+0000","last_fullsized":"2023-12-04T10:45:34.130565+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:06:04.114725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.129712+0000","last_change":"2023-12-04T10:45:34.111752+0000","last_active":"2023-12-04T10:45:35.129712+0000","last_peered":"2023-12-04T10:45:35.129712+0000","last_clean":"2023-12-04T10:45:35.129712+0000","last_became_active":"2023-12-04T10:45:34.111360+0000","last_became_peered":"2023-12-04T10:45:34.111360+0000","last_unstale":"2023-12-04T10:45:35.129712+0000","last_undegraded":"2023-12-04T10:45:35.129712+0000","last_fullsized":"2023-12-04T10:45:35.129712+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:41:39.912748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.103859+0000","last_change":"2023-12-04T10:45:33.089787+0000","last_active":"2023-12-04T10:45:34.103859+0000","last_peered":"2023-12-04T10:45:34.103859+0000","last_clean":"2023-12-04T10:45:34.103859+0000","last_became_active":"2023-12-04T10:45:33.089494+0000","last_became_peered":"2023-12-04T10:45:33.089494+0000","last_unstale":"2023-12-04T10:45:34.103859+0000","last_undegraded":"2023-12-04T10:45:34.103859+0000","last_fullsized":"2023-12-04T10:45:34.103859+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:26:58.403788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.089726+0000","last_change":"2023-12-04T10:45:34.124528+0000","last_active":"2023-12-04T10:45:35.089726+0000","last_peered":"2023-12-04T10:45:35.089726+0000","last_clean":"2023-12-04T10:45:35.089726+0000","last_became_active":"2023-12-04T10:45:34.124206+0000","last_became_peered":"2023-12-04T10:45:34.124206+0000","last_unstale":"2023-12-04T10:45:35.089726+0000","last_undegraded":"2023-12-04T10:45:35.089726+0000","last_fullsized":"2023-12-04T10:45:35.089726+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:13:34.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.133631+0000","last_change":"2023-12-04T10:45:33.089384+0000","last_active":"2023-12-04T10:45:35.133631+0000","last_peered":"2023-12-04T10:45:35.133631+0000","last_clean":"2023-12-04T10:45:35.133631+0000","last_became_active":"2023-12-04T10:45:33.089091+0000","last_became_peered":"2023-12-04T10:45:33.089091+0000","last_unstale":"2023-12-04T10:45:35.133631+0000","last_undegraded":"2023-12-04T10:45:35.133631+0000","last_fullsized":"2023-12-04T10:45:35.133631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:55:25.062868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084829+0000","last_change":"2023-12-04T10:45:34.112430+0000","last_active":"2023-12-04T10:45:35.084829+0000","last_peered":"2023-12-04T10:45:35.084829+0000","last_clean":"2023-12-04T10:45:35.084829+0000","last_became_active":"2023-12-04T10:45:34.112157+0000","last_became_peered":"2023-12-04T10:45:34.112157+0000","last_unstale":"2023-12-04T10:45:35.084829+0000","last_undegraded":"2023-12-04T10:45:35.084829+0000","last_fullsized":"2023-12-04T10:45:35.084829+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T17:13:34.608990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.103430+0000","last_change":"2023-12-04T10:45:33.076361+0000","last_active":"2023-12-04T10:45:34.103430+0000","last_peered":"2023-12-04T10:45:34.103430+0000","last_clean":"2023-12-04T10:45:34.103430+0000","last_became_active":"2023-12-04T10:45:33.076174+0000","last_became_peered":"2023-12-04T10:45:33.076174+0000","last_unstale":"2023-12-04T10:45:34.103430+0000","last_undegraded":"2023-12-04T10:45:34.103430+0000","last_fullsized":"2023-12-04T10:45:34.103430+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:15:22.162045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.130026+0000","last_change":"2023-12-04T10:45:34.124710+0000","last_active":"2023-12-04T10:45:34.130026+0000","last_peered":"2023-12-04T10:45:34.130026+0000","last_clean":"2023-12-04T10:45:34.130026+0000","last_became_active":"2023-12-04T10:45:34.124400+0000","last_became_peered":"2023-12-04T10:45:34.124400+0000","last_unstale":"2023-12-04T10:45:34.130026+0000","last_undegraded":"2023-12-04T10:45:34.130026+0000","last_fullsized":"2023-12-04T10:45:34.130026+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T18:16:16.422323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"40'2","reported_seq":14,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091849+0000","last_change":"2023-12-04T10:45:33.087597+0000","last_active":"2023-12-04T10:45:35.091849+0000","last_peered":"2023-12-04T10:45:35.091849+0000","last_clean":"2023-12-04T10:45:35.091849+0000","last_became_active":"2023-12-04T10:45:33.085690+0000","last_became_peered":"2023-12-04T10:45:33.085690+0000","last_unstale":"2023-12-04T10:45:35.091849+0000","last_undegraded":"2023-12-04T10:45:35.091849+0000","last_fullsized":"2023-12-04T10:45:35.091849+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:40:05.587536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134831+0000","last_change":"2023-12-04T10:45:34.115423+0000","last_active":"2023-12-04T10:45:35.134831+0000","last_peered":"2023-12-04T10:45:35.134831+0000","last_clean":"2023-12-04T10:45:35.134831+0000","last_became_active":"2023-12-04T10:45:34.115132+0000","last_became_peered":"2023-12-04T10:45:34.115132+0000","last_unstale":"2023-12-04T10:45:35.134831+0000","last_undegraded":"2023-12-04T10:45:35.134831+0000","last_fullsized":"2023-12-04T10:45:35.134831+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:53:36.311196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.103842+0000","last_change":"2023-12-04T10:45:33.085032+0000","last_active":"2023-12-04T10:45:34.103842+0000","last_peered":"2023-12-04T10:45:34.103842+0000","last_clean":"2023-12-04T10:45:34.103842+0000","last_became_active":"2023-12-04T10:45:33.084813+0000","last_became_peered":"2023-12-04T10:45:33.084813+0000","last_unstale":"2023-12-04T10:45:34.103842+0000","last_undegraded":"2023-12-04T10:45:34.103842+0000","last_fullsized":"2023-12-04T10:45:34.103842+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:22:41.782565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.085041+0000","last_change":"2023-12-04T10:45:34.104741+0000","last_active":"2023-12-04T10:45:35.085041+0000","last_peered":"2023-12-04T10:45:35.085041+0000","last_clean":"2023-12-04T10:45:35.085041+0000","last_became_active":"2023-12-04T10:45:34.104178+0000","last_became_peered":"2023-12-04T10:45:34.104178+0000","last_unstale":"2023-12-04T10:45:35.085041+0000","last_undegraded":"2023-12-04T10:45:35.085041+0000","last_fullsized":"2023-12-04T10:45:35.085041+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:39:15.362938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130631+0000","last_change":"2023-12-04T10:45:33.081275+0000","last_active":"2023-12-04T10:45:35.130631+0000","last_peered":"2023-12-04T10:45:35.130631+0000","last_clean":"2023-12-04T10:45:35.130631+0000","last_became_active":"2023-12-04T10:45:33.081034+0000","last_became_peered":"2023-12-04T10:45:33.081034+0000","last_unstale":"2023-12-04T10:45:35.130631+0000","last_undegraded":"2023-12-04T10:45:35.130631+0000","last_fullsized":"2023-12-04T10:45:35.130631+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:11:10.396239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.129741+0000","last_change":"2023-12-04T10:45:34.107843+0000","last_active":"2023-12-04T10:45:35.129741+0000","last_peered":"2023-12-04T10:45:35.129741+0000","last_clean":"2023-12-04T10:45:35.129741+0000","last_became_active":"2023-12-04T10:45:34.107574+0000","last_became_peered":"2023-12-04T10:45:34.107574+0000","last_unstale":"2023-12-04T10:45:35.129741+0000","last_undegraded":"2023-12-04T10:45:35.129741+0000","last_fullsized":"2023-12-04T10:45:35.129741+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:24:30.631490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.130297+0000","last_change":"2023-12-04T10:45:33.086423+0000","last_active":"2023-12-04T10:45:35.130297+0000","last_peered":"2023-12-04T10:45:35.130297+0000","last_clean":"2023-12-04T10:45:35.130297+0000","last_became_active":"2023-12-04T10:45:33.085795+0000","last_became_peered":"2023-12-04T10:45:33.085795+0000","last_unstale":"2023-12-04T10:45:35.130297+0000","last_undegraded":"2023-12-04T10:45:35.130297+0000","last_fullsized":"2023-12-04T10:45:35.130297+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T19:37:09.629258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.113264+0000","last_change":"2023-12-04T10:45:34.101974+0000","last_active":"2023-12-04T10:45:34.113264+0000","last_peered":"2023-12-04T10:45:34.113264+0000","last_clean":"2023-12-04T10:45:34.113264+0000","last_became_active":"2023-12-04T10:45:34.101616+0000","last_became_peered":"2023-12-04T10:45:34.101616+0000","last_unstale":"2023-12-04T10:45:34.113264+0000","last_undegraded":"2023-12-04T10:45:34.113264+0000","last_fullsized":"2023-12-04T10:45:34.113264+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T16:36:50.302216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.132207+0000","last_change":"2023-12-04T10:45:33.086695+0000","last_active":"2023-12-04T10:45:35.132207+0000","last_peered":"2023-12-04T10:45:35.132207+0000","last_clean":"2023-12-04T10:45:35.132207+0000","last_became_active":"2023-12-04T10:45:33.086214+0000","last_became_peered":"2023-12-04T10:45:33.086214+0000","last_unstale":"2023-12-04T10:45:35.132207+0000","last_undegraded":"2023-12-04T10:45:35.132207+0000","last_fullsized":"2023-12-04T10:45:35.132207+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T15:34:37.117599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.112350+0000","last_change":"2023-12-04T10:45:34.106662+0000","last_active":"2023-12-04T10:45:34.112350+0000","last_peered":"2023-12-04T10:45:34.112350+0000","last_clean":"2023-12-04T10:45:34.112350+0000","last_became_active":"2023-12-04T10:45:34.105530+0000","last_became_peered":"2023-12-04T10:45:34.105530+0000","last_unstale":"2023-12-04T10:45:34.112350+0000","last_undegraded":"2023-12-04T10:45:34.112350+0000","last_fullsized":"2023-12-04T10:45:34.112350+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T14:50:24.778209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.087145+0000","last_change":"2023-12-04T10:45:33.087897+0000","last_active":"2023-12-04T10:45:34.087145+0000","last_peered":"2023-12-04T10:45:34.087145+0000","last_clean":"2023-12-04T10:45:34.087145+0000","last_became_active":"2023-12-04T10:45:33.086375+0000","last_became_peered":"2023-12-04T10:45:33.086375+0000","last_unstale":"2023-12-04T10:45:34.087145+0000","last_undegraded":"2023-12-04T10:45:34.087145+0000","last_fullsized":"2023-12-04T10:45:34.087145+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:36:06.657049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134678+0000","last_change":"2023-12-04T10:45:34.110609+0000","last_active":"2023-12-04T10:45:35.134678+0000","last_peered":"2023-12-04T10:45:35.134678+0000","last_clean":"2023-12-04T10:45:35.134678+0000","last_became_active":"2023-12-04T10:45:34.110237+0000","last_became_peered":"2023-12-04T10:45:34.110237+0000","last_unstale":"2023-12-04T10:45:35.134678+0000","last_undegraded":"2023-12-04T10:45:35.134678+0000","last_fullsized":"2023-12-04T10:45:35.134678+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:40:06.602352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.084317+0000","last_change":"2023-12-04T10:45:33.073924+0000","last_active":"2023-12-04T10:45:35.084317+0000","last_peered":"2023-12-04T10:45:35.084317+0000","last_clean":"2023-12-04T10:45:35.084317+0000","last_became_active":"2023-12-04T10:45:33.073654+0000","last_became_peered":"2023-12-04T10:45:33.073654+0000","last_unstale":"2023-12-04T10:45:35.084317+0000","last_undegraded":"2023-12-04T10:45:35.084317+0000","last_fullsized":"2023-12-04T10:45:35.084317+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T12:19:54.337047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.091545+0000","last_change":"2023-12-04T10:45:34.120582+0000","last_active":"2023-12-04T10:45:35.091545+0000","last_peered":"2023-12-04T10:45:35.091545+0000","last_clean":"2023-12-04T10:45:35.091545+0000","last_became_active":"2023-12-04T10:45:34.120273+0000","last_became_peered":"2023-12-04T10:45:34.120273+0000","last_unstale":"2023-12-04T10:45:35.091545+0000","last_undegraded":"2023-12-04T10:45:35.091545+0000","last_fullsized":"2023-12-04T10:45:35.091545+0000","mapping_epoch":39,"log_start":"0'0","ondisk_log_start":"0'0","created":39,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:33.044151+0000","last_clean_scrub_stamp":"2023-12-04T10:45:33.044151+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T13:47:40.126347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":41,"state":"active+clean","last_fresh":"2023-12-04T10:45:35.134805+0000","last_change":"2023-12-04T10:45:33.085306+0000","last_active":"2023-12-04T10:45:35.134805+0000","last_peered":"2023-12-04T10:45:35.134805+0000","last_clean":"2023-12-04T10:45:35.134805+0000","last_became_active":"2023-12-04T10:45:33.084901+0000","last_became_peered":"2023-12-04T10:45:33.084901+0000","last_unstale":"2023-12-04T10:45:35.134805+0000","last_undegraded":"2023-12-04T10:45:35.134805+0000","last_fullsized":"2023-12-04T10:45:35.134805+0000","mapping_epoch":38,"log_start":"0'0","ondisk_log_start":"0'0","created":38,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:45:32.029334+0000","last_clean_scrub_stamp":"2023-12-04T10:45:32.029334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T20:24:30.025521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'117","reported_seq":183,"reported_epoch":40,"state":"active+clean","last_fresh":"2023-12-04T10:45:34.104632+0000","last_change":"2023-12-04T10:43:48.111279+0000","last_active":"2023-12-04T10:45:34.104632+0000","last_peered":"2023-12-04T10:45:34.104632+0000","last_clean":"2023-12-04T10:45:34.104632+0000","last_became_active":"2023-12-04T10:43:48.108038+0000","last_became_peered":"2023-12-04T10:43:48.108038+0000","last_unstale":"2023-12-04T10:45:34.104632+0000","last_undegraded":"2023-12-04T10:45:34.104632+0000","last_fullsized":"2023-12-04T10:45:34.104632+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-04T10:43:46.528449+0000","last_clean_scrub_stamp":"2023-12-04T10:43:46.528449+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-05T22:31:15.475210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509465,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343768,"statfs":{"total":96636764160,"available":96608018432,"internally_reserved":0,"allocated":1077248,"data_stored":792705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.6759999999999999,"5min":1.6759999999999999,"15min":1.6759999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.1739999999999999}]},{"osd":1,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1479999999999999,"5min":1.1479999999999999,"15min":1.1479999999999999},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":2.1699999999999999,"5min":2.1699999999999999,"15min":2.1699999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":1.355,"5min":1.355,"15min":1.355},"min":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.3560000000000001}]},{"osd":2,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.254,"5min":1.254,"15min":1.254},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.234,"5min":2.234,"15min":2.234},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":3.0760000000000001,"5min":3.0760000000000001,"15min":3.0760000000000001},"last":1.081}]},{"osd":3,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.393,"5min":1.393,"15min":1.393},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":1.99,"5min":1.99,"15min":1.99},"last":0.84299999999999997},{"interface":"front","average":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"min":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"max":{"1min":2.8109999999999999,"5min":2.8109999999999999,"15min":2.8109999999999999},"last":1.2929999999999999}]},{"osd":4,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.518,"5min":1.518,"15min":1.518},"min":{"1min":0.87,"5min":0.87,"15min":0.87},"max":{"1min":3.1150000000000002,"5min":3.1150000000000002,"15min":3.1150000000000002},"last":1.448},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.5549999999999999,"15min":1.5549999999999999},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"max":{"1min":2.5529999999999999,"5min":2.5529999999999999,"15min":2.5529999999999999},"last":1.018}]},{"osd":5,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.601,"15min":1.601},"min":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"max":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"last":1.425},{"interface":"front","average":{"1min":1.649,"5min":1.649,"15min":1.649},"min":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":1.5129999999999999}]},{"osd":6,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.7749999999999999,"5min":1.7749999999999999,"15min":1.7749999999999999},"min":{"1min":1.161,"5min":1.161,"15min":1.161},"max":{"1min":3.0049999999999999,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.5669999999999999},{"interface":"front","average":{"1min":1.744,"5min":1.744,"15min":1.744},"min":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.2270000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509464,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27488,"kb_used_data":460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344352,"statfs":{"total":96636764160,"available":96608616448,"internally_reserved":0,"allocated":471040,"data_stored":201237,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.663,"5min":1.663,"15min":1.663},"last":1.2749999999999999},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.9179999999999999,"5min":1.9179999999999999,"15min":1.9179999999999999},"last":1}]},{"osd":1,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":2.0609999999999999,"5min":2.0609999999999999,"15min":2.0609999999999999},"last":1.1619999999999999},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"max":{"1min":2.0510000000000002,"5min":2.0510000000000002,"15min":2.0510000000000002},"last":1.4059999999999999}]},{"osd":2,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.745,"5min":0.745,"15min":0.745},"max":{"1min":1.7310000000000001,"5min":1.7310000000000001,"15min":1.7310000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":1.367,"5min":1.367,"15min":1.367},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.6200000000000001,"5min":2.6200000000000001,"15min":2.6200000000000001},"last":0.95899999999999996}]},{"osd":3,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.51,"5min":1.51,"15min":1.51},"min":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"max":{"1min":2.4649999999999999,"5min":2.4649999999999999,"15min":2.4649999999999999},"last":1.3240000000000001},{"interface":"front","average":{"1min":1.381,"5min":1.381,"15min":1.381},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.6160000000000001,"5min":2.6160000000000001,"15min":2.6160000000000001},"last":1.222}]},{"osd":4,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.6830000000000001,"5min":1.6830000000000001,"15min":1.6830000000000001},"min":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":4.0460000000000003,"5min":4.0460000000000003,"15min":4.0460000000000003},"last":0.77400000000000002},{"interface":"front","average":{"1min":1.728,"5min":1.728,"15min":1.728},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":4.1589999999999998,"5min":4.1589999999999998,"15min":4.1589999999999998},"last":1.1240000000000001}]},{"osd":5,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.6080000000000001,"5min":1.6080000000000001,"15min":1.6080000000000001},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":3.8500000000000001,"5min":3.8500000000000001,"15min":3.8500000000000001},"last":1.054},{"interface":"front","average":{"1min":1.778,"5min":1.778,"15min":1.778},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":4.21,"5min":4.21,"15min":4.21},"last":1.359}]},{"osd":7,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.694,"5min":2.694,"15min":2.694},"last":1.5880000000000001},{"interface":"front","average":{"1min":1.8009999999999999,"5min":1.8009999999999999,"15min":1.8009999999999999},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":3.5009999999999999,"5min":3.5009999999999999,"15min":3.5009999999999999},"last":1.7330000000000001}]}]},{"osd":5,"up_from":15,"seq":64424509464,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":464,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":475136,"data_stored":200767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"min":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.8640000000000001,"5min":1.8640000000000001,"15min":1.8640000000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.9399999999999999,"5min":1.9399999999999999,"15min":1.9399999999999999},"last":1.2110000000000001}]},{"osd":1,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.286,"5min":1.286,"15min":1.286},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":2.0310000000000001,"5min":2.0310000000000001,"15min":2.0310000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.4179999999999999,"5min":1.4179999999999999,"15min":1.4179999999999999},"min":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"max":{"1min":2.206,"5min":2.206,"15min":2.206},"last":0.98399999999999999}]},{"osd":2,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4339999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.1020000000000001},{"interface":"front","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.5529999999999999}]},{"osd":3,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.0600000000000001,"5min":3.0600000000000001,"15min":3.0600000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.155}]},{"osd":4,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.5429999999999999},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":2.8700000000000001,"5min":2.8700000000000001,"15min":2.8700000000000001},"last":1.504},{"interface":"front","average":{"1min":1.849,"5min":1.849,"15min":1.849},"min":{"1min":1.079,"5min":1.079,"15min":1.079},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":1.3360000000000001}]},{"osd":6,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.754,"5min":1.754,"15min":1.754},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":4.718,"5min":4.718,"15min":4.718},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.73,"5min":1.73,"15min":1.73},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":2.766,"5min":2.766,"15min":2.766},"last":1.649}]},{"osd":7,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.8580000000000001,"5min":1.8580000000000001,"15min":1.8580000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":3.6859999999999999,"5min":3.6859999999999999,"15min":3.6859999999999999},"last":1.611},{"interface":"front","average":{"1min":1.859,"5min":1.859,"15min":1.859},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":4.5419999999999998,"5min":4.5419999999999998,"15min":4.5419999999999998},"last":1.696}]}]},{"osd":3,"up_from":15,"seq":64424509465,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":483328,"data_stored":202301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":2.266,"5min":2.266,"15min":2.266},"last":0.375},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.456,"5min":2.456,"15min":2.456},"last":0.55500000000000005}]},{"osd":1,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":2.0619999999999998,"5min":2.0619999999999998,"15min":2.0619999999999998},"last":0.498},{"interface":"front","average":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":2.4740000000000002,"5min":2.4740000000000002,"15min":2.4740000000000002},"last":0.625}]},{"osd":2,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.7690000000000001,"5min":2.7690000000000001,"15min":2.7690000000000001},"last":0.86399999999999999},{"interface":"front","average":{"1min":1.173,"5min":1.173,"15min":1.173},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"min":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"max":{"1min":3.653,"5min":3.653,"15min":3.653},"last":1.647},{"interface":"front","average":{"1min":1.4550000000000001,"5min":1.4550000000000001,"15min":1.4550000000000001},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.7120000000000002,"5min":2.7120000000000002,"15min":2.7120000000000002},"last":1.109}]},{"osd":5,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.6850000000000001,"5min":2.6850000000000001,"15min":2.6850000000000001},"last":1.2010000000000001},{"interface":"front","average":{"1min":1.6100000000000001,"5min":1.6100000000000001,"15min":1.6100000000000001},"min":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"max":{"1min":3.2349999999999999,"5min":3.2349999999999999,"15min":3.2349999999999999},"last":1.0680000000000001}]},{"osd":6,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"max":{"1min":3.141,"5min":3.141,"15min":3.141},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.9399999999999999,"5min":2.9399999999999999,"15min":2.9399999999999999},"last":1.6020000000000001}]},{"osd":7,"last update":"Mon Dec 4 10:44:48 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.995,"5min":0.995,"15min":0.995},"max":{"1min":3.7679999999999998,"5min":3.7679999999999998,"15min":3.7679999999999998},"last":1.6879999999999999},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"max":{"1min":3.0790000000000002,"5min":3.0790000000000002,"15min":3.0790000000000002},"last":0.752}]}]},{"osd":0,"up_from":15,"seq":64424509465,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1064960,"data_stored":791057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.7410000000000001,"5min":1.7410000000000001,"15min":1.7410000000000001},"last":1.7649999999999999}]},{"osd":2,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.6899999999999999,"5min":1.6899999999999999,"15min":1.6899999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.8029999999999999,"5min":1.8029999999999999,"15min":1.8029999999999999},"last":1.135}]},{"osd":3,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.175,"5min":1.175,"15min":1.175},"min":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.2050000000000001}]},{"osd":4,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.3500000000000001,"5min":2.3500000000000001,"15min":2.3500000000000001},"last":1.7090000000000001},{"interface":"front","average":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"min":{"1min":1.026,"5min":1.026,"15min":1.026},"max":{"1min":2.282,"5min":2.282,"15min":2.282},"last":1.4890000000000001}]},{"osd":5,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.464,"5min":1.464,"15min":1.464},"min":{"1min":1.0940000000000001,"5min":1.0940000000000001,"15min":1.0940000000000001},"max":{"1min":2.492,"5min":2.492,"15min":2.492},"last":1.5289999999999999},{"interface":"front","average":{"1min":1.514,"5min":1.514,"15min":1.514},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":2.4689999999999999,"5min":2.4689999999999999,"15min":2.4689999999999999},"last":1.593}]},{"osd":6,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.542,"5min":1.542,"15min":1.542},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.4020000000000001,"5min":2.4020000000000001,"15min":2.4020000000000001},"last":1.264},{"interface":"front","average":{"1min":1.53,"5min":1.53,"15min":1.53},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.6360000000000001,"5min":2.6360000000000001,"15min":2.6360000000000001},"last":1.3149999999999999}]},{"osd":7,"last update":"Mon Dec 4 10:44:49 2023","interfaces":[{"interface":"back","average":{"1min":1.641,"5min":1.641,"15min":1.641},"min":{"1min":1.04,"5min":1.04,"15min":1.04},"max":{"1min":2.5539999999999998,"5min":2.5539999999999998,"15min":2.5539999999999998},"last":1.665},{"interface":"front","average":{"1min":1.645,"5min":1.645,"15min":1.645},"min":{"1min":0.874,"5min":0.874,"15min":0.874},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.806}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27480,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344360,"statfs":{"total":96636764160,"available":96608624640,"internally_reserved":0,"allocated":462848,"data_stored":194639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":2.5190000000000001,"5min":2.5190000000000001,"15min":2.5190000000000001},"last":0.89400000000000002},{"interface":"front","average":{"1min":1.294,"5min":1.294,"15min":1.294},"min":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"max":{"1min":2.46,"5min":2.46,"15min":2.46},"last":1.085}]},{"osd":1,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":2.3029999999999999,"5min":2.3029999999999999,"15min":2.3029999999999999},"last":1.2070000000000001},{"interface":"front","average":{"1min":1.276,"5min":1.276,"15min":1.276},"min":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":2.0939999999999999,"5min":2.0939999999999999,"15min":2.0939999999999999},"last":1.238}]},{"osd":2,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":1.282,"15min":1.282},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":2.9100000000000001,"5min":2.9100000000000001,"15min":2.9100000000000001},"last":0.99099999999999999},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3439999999999999,"5min":2.3439999999999999,"15min":2.3439999999999999},"last":1.4079999999999999}]},{"osd":3,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"max":{"1min":2.7509999999999999,"5min":2.7509999999999999,"15min":2.7509999999999999},"last":1.355},{"interface":"front","average":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.4729999999999999},"last":1.3009999999999999}]},{"osd":5,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.522,"5min":1.522,"15min":1.522},"min":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"max":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"last":1.609},{"interface":"front","average":{"1min":1.673,"5min":1.673,"15min":1.673},"min":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"max":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":1.4630000000000001}]},{"osd":6,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.488,"5min":1.488,"15min":1.488},"min":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":2.6640000000000001,"5min":2.6640000000000001,"15min":2.6640000000000001},"last":1.522},{"interface":"front","average":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"min":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.657,"5min":2.657,"15min":2.657},"last":1.7070000000000001}]},{"osd":7,"last update":"Mon Dec 4 10:44:45 2023","interfaces":[{"interface":"back","average":{"1min":1.845,"5min":1.845,"15min":1.845},"min":{"1min":1.123,"5min":1.123,"15min":1.123},"max":{"1min":3.3620000000000001,"5min":3.3620000000000001,"15min":3.3620000000000001},"last":1.5649999999999999},{"interface":"front","average":{"1min":1.724,"5min":1.724,"15min":1.724},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":3.2429999999999999,"5min":3.2429999999999999,"15min":3.2429999999999999},"last":1.653}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":458752,"data_stored":194105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":1.1000000000000001},{"interface":"front","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.768,"5min":1.768,"15min":1.768},"last":0.56299999999999994}]},{"osd":1,"last update":"Mon Dec 4 10:44:44 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":1.712,"5min":1.712,"15min":1.712},"last":1.1719999999999999},{"interface":"front","average":{"1min":1.232,"5min":1.232,"15min":1.232},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":1.9710000000000001,"5min":1.9710000000000001,"15min":1.9710000000000001},"last":0.81899999999999995}]},{"osd":3,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.353,"5min":1.353,"15min":1.353},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.66200000000000003},{"interface":"front","average":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.639,"5min":1.639,"15min":1.639},"last":0.71399999999999997}]},{"osd":4,"last update":"Mon Dec 4 10:44:44 2023","interfaces":[{"interface":"back","average":{"1min":1.3600000000000001,"5min":1.3600000000000001,"15min":1.3600000000000001},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":2.0019999999999998,"5min":2.0019999999999998,"15min":2.0019999999999998},"last":0.89800000000000002},{"interface":"front","average":{"1min":1.5600000000000001,"5min":1.5600000000000001,"15min":1.5600000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.633,"5min":2.633,"15min":2.633},"last":1.3149999999999999}]},{"osd":5,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.468,"5min":1.468,"15min":1.468},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"max":{"1min":2.2730000000000001,"5min":2.2730000000000001,"15min":2.2730000000000001},"last":0.95899999999999996},{"interface":"front","average":{"1min":1.476,"5min":1.476,"15min":1.476},"min":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"max":{"1min":2.5179999999999998,"5min":2.5179999999999998,"15min":2.5179999999999998},"last":1.448}]},{"osd":6,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.3560000000000001},{"interface":"front","average":{"1min":1.581,"5min":1.581,"15min":1.581},"min":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"max":{"1min":2.8220000000000001,"5min":2.8220000000000001,"15min":2.8220000000000001},"last":1.0840000000000001}]},{"osd":7,"last update":"Mon Dec 4 10:44:50 2023","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":3.48,"5min":3.48,"15min":3.48},"last":1.393},{"interface":"front","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":3.1240000000000001,"5min":3.1240000000000001,"15min":3.1240000000000001},"last":1.2789999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542170,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":448,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":458752,"data_stored":194125,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.004,"5min":1.004,"15min":1.004},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.6120000000000001,"5min":5.6120000000000001,"15min":5.6120000000000001},"last":0.95599999999999996}]},{"osd":2,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.927,"5min":1.927,"15min":1.927},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.288,"5min":1.288,"15min":1.288},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.649,"5min":5.649,"15min":5.649},"last":1.0449999999999999}]},{"osd":3,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":2.3660000000000001,"5min":2.3660000000000001,"15min":2.3660000000000001},"last":1.603},{"interface":"front","average":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.6820000000000004,"5min":5.6820000000000004,"15min":5.6820000000000004},"last":1.1910000000000001}]},{"osd":4,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":5.5140000000000002,"5min":5.5140000000000002,"15min":5.5140000000000002},"last":1.0720000000000001},{"interface":"front","average":{"1min":1.502,"5min":1.502,"15min":1.502},"min":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":3.2669999999999999,"5min":3.2669999999999999,"15min":3.2669999999999999},"last":1.1359999999999999}]},{"osd":5,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.629,"5min":1.629,"15min":1.629},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":5.4720000000000004,"5min":5.4720000000000004,"15min":5.4720000000000004},"last":1.2370000000000001},{"interface":"front","average":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"min":{"1min":1.052,"5min":1.052,"15min":1.052},"max":{"1min":2.7770000000000001,"5min":2.7770000000000001,"15min":2.7770000000000001},"last":1.4550000000000001}]},{"osd":6,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.619,"5min":1.619,"15min":1.619},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":5.3490000000000002,"5min":5.3490000000000002,"15min":5.3490000000000002},"last":1.657},{"interface":"front","average":{"1min":1.673,"5min":1.673,"15min":1.673},"min":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"max":{"1min":3.6629999999999998,"5min":3.6629999999999998,"15min":3.6629999999999998},"last":1.7110000000000001}]},{"osd":7,"last update":"Mon Dec 4 10:44:46 2023","interfaces":[{"interface":"back","average":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"min":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"max":{"1min":6.0170000000000003,"5min":6.0170000000000003,"15min":6.0170000000000003},"last":1.282},{"interface":"front","average":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":5.4359999999999999,"5min":5.4359999999999999,"15min":5.4359999999999999},"last":1.5149999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-04T10:45:39.113 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-04T10:45:39.113 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-04T10:45:39.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.389+0000 7fd5d6dc9640 1 Processor -- start 2023-12-04T10:45:39.390 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.389+0000 7fd5d6dc9640 1 -- start start 2023-12-04T10:45:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.391+0000 7fd5d6dc9640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5d0142c70 0x7fd5d0070090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.391+0000 7fd5d6dc9640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd5d00b2390 0x7fd5d00b2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.391+0000 7fd5d6dc9640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5d00b1f00 con 0x7fd5d0143280 2023-12-04T10:45:39.392 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.391+0000 7fd5d6dc9640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d00b1c00 con 0x7fd5d0142c70 2023-12-04T10:45:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.391+0000 7fd5d6dc9640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5d0143a70 con 0x7fd5d00b2390 2023-12-04T10:45:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.391+0000 7fd5d5dc7640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5d0142c70 0x7fd5d0070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d5dc7640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd5d0142c70 0x7fd5d0070090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56018/0 (socket says 172.21.15.63:56018) 2023-12-04T10:45:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d5dc7640 1 -- 172.21.15.63:0/937282826 learned_addr learned my addr 172.21.15.63:0/937282826 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d55c6640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd5d0143280 0x7fd5d00705d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:58290/0 (socket says 172.21.15.63:58290) 2023-12-04T10:45:39.393 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d65c8640 1 --2- 172.21.15.63:0/937282826 >> v2:172.21.15.66:3300/0 conn(0x7fd5d00b2390 0x7fd5d00b2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d5dc7640 1 -- 172.21.15.63:0/937282826 >> v2:172.21.15.66:3300/0 conn(0x7fd5d00b2390 msgr2=0x7fd5d00b2820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:39.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d5dc7640 1 --2- 172.21.15.63:0/937282826 >> v2:172.21.15.66:3300/0 conn(0x7fd5d00b2390 0x7fd5d00b2820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d5dc7640 1 -- 172.21.15.63:0/937282826 >> v1:172.21.15.63:6789/0 conn(0x7fd5d0143280 legacy=0x7fd5d00705d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d5dc7640 1 -- 172.21.15.63:0/937282826 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5d0143050 con 0x7fd5d0142c70 2023-12-04T10:45:39.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.392+0000 7fd5d4dc5640 1 -- 172.21.15.63:0/937282826 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396124759 0 0) 0x7fd5d00b1f00 con 0x7fd5d0143280 2023-12-04T10:45:39.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.393+0000 7fd5d5dc7640 1 --2- 172.21.15.63:0/937282826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d0142c70 0x7fd5d0070090 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0143710 tx=0x7fd5cc02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52646ddbb5406f0f server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:39.394 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d4dc5640 1 -- 172.21.15.63:0/937282826 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc02ee90 con 0x7fd5d0142c70 2023-12-04T10:45:39.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d4dc5640 1 -- 172.21.15.63:0/937282826 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc036440 con 0x7fd5d0142c70 2023-12-04T10:45:39.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d4dc5640 1 -- 172.21.15.63:0/937282826 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0367d0 con 0x7fd5d0142c70 2023-12-04T10:45:39.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/937282826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d0142c70 msgr2=0x7fd5d0070090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.395 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/937282826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d0142c70 0x7fd5d0070090 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fd5d0143710 tx=0x7fd5cc02e0e0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/937282826 shutdown_connections 2023-12-04T10:45:39.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/937282826 >> v2:172.21.15.66:3300/0 conn(0x7fd5d00b2390 0x7fd5d00b2820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/937282826 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d0142c70 0x7fd5d0070090 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/937282826 >> 172.21.15.63:0/937282826 conn(0x7fd5d00b0860 msgr2=0x7fd5d00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:39.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.394+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/937282826 shutdown_connections 2023-12-04T10:45:39.396 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.395+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/937282826 wait complete. 2023-12-04T10:45:39.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.396+0000 7fd5d6dc9640 1 Processor -- start 2023-12-04T10:45:39.397 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.396+0000 7fd5d6dc9640 1 -- start start 2023-12-04T10:45:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.397+0000 7fd5d6dc9640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d00b2390 0x7fd5d013be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.397+0000 7fd5d6dc9640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d0142c70 0x7fd5d0138c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.397+0000 7fd5d6dc9640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d0143280 0x7fd5d01597e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.397+0000 7fd5d6dc9640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d013a600 con 0x7fd5d00b2390 2023-12-04T10:45:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.397+0000 7fd5d6dc9640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0139560 con 0x7fd5d0142c70 2023-12-04T10:45:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.397+0000 7fd5d6dc9640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5d0139840 con 0x7fd5d0143280 2023-12-04T10:45:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d00b2390 0x7fd5d013be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.399 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d00b2390 0x7fd5d013be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56026/0 (socket says 172.21.15.63:56026) 2023-12-04T10:45:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 -- 172.21.15.63:0/4138530352 learned_addr learned my addr 172.21.15.63:0/4138530352 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 -- 172.21.15.63:0/4138530352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d0143280 msgr2=0x7fd5d01597e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d65c8640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d0143280 0x7fd5d01597e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d0143280 0x7fd5d01597e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 -- 172.21.15.63:0/4138530352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d0142c70 msgr2=0x7fd5d0138c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d0142c70 0x7fd5d0138c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 -- 172.21.15.63:0/4138530352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5cc00b770 con 0x7fd5d00b2390 2023-12-04T10:45:39.400 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.398+0000 7fd5d5dc7640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d00b2390 0x7fd5d013be40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc02e120 tx=0x7fd5cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.399+0000 7fd5c67fc640 1 -- 172.21.15.63:0/4138530352 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc0348d0 con 0x7fd5d00b2390 2023-12-04T10:45:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.399+0000 7fd5c67fc640 1 -- 172.21.15.63:0/4138530352 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5cc034a30 con 0x7fd5d00b2390 2023-12-04T10:45:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.399+0000 7fd5c67fc640 1 -- 172.21.15.63:0/4138530352 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc034de0 con 0x7fd5d00b2390 2023-12-04T10:45:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.399+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5d0139b20 con 0x7fd5d00b2390 2023-12-04T10:45:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.399+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5d013a0e0 con 0x7fd5d00b2390 2023-12-04T10:45:39.401 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.400+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5d004e840 con 0x7fd5d00b2390 2023-12-04T10:45:39.402 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.401+0000 7fd5c67fc640 1 -- 172.21.15.63:0/4138530352 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd5cc03d040 con 0x7fd5d00b2390 2023-12-04T10:45:39.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.402+0000 7fd5c67fc640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5b406ae40 0x7fd5b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.402+0000 7fd5c67fc640 1 -- 172.21.15.63:0/4138530352 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fd5cc0ae230 con 0x7fd5d00b2390 2023-12-04T10:45:39.403 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.402+0000 7fd5d55c6640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5b406ae40 0x7fd5b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.404 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.403+0000 7fd5d55c6640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5b406ae40 0x7fd5b406d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0007fd0 tx=0x7fd5c0007960 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:39.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.407+0000 7fd5c67fc640 1 -- 172.21.15.63:0/4138530352 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd5cc079190 con 0x7fd5d00b2390 2023-12-04T10:45:39.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.670+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd5d006c120 con 0x7fd5d00b2390 2023-12-04T10:45:39.676 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.675+0000 7fd5c67fc640 1 -- 172.21.15.63:0/4138530352 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7fd5cc07c7b0 con 0x7fd5d00b2390 2023-12-04T10:45:39.676 INFO:teuthology.orchestra.run.smithi063.stdout:[client.0] 2023-12-04T10:45:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAqrW1lNHPvCRAAl2gnyDEti4/W/gQul97nNg== 2023-12-04T10:45:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: caps mds = "allow" 2023-12-04T10:45:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: caps mon = "allow r" 2023-12-04T10:45:39.677 INFO:teuthology.orchestra.run.smithi063.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-04T10:45:39.677 INFO:teuthology.orchestra.run.smithi063.stderr:updated caps for client.0 2023-12-04T10:45:39.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5b406ae40 msgr2=0x7fd5b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5b406ae40 0x7fd5b406d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd5c0007fd0 tx=0x7fd5c0007960 comp rx=0 tx=0).stop 2023-12-04T10:45:39.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d00b2390 msgr2=0x7fd5d013be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d00b2390 0x7fd5d013be40 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc02e120 tx=0x7fd5cc0046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 shutdown_connections 2023-12-04T10:45:39.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd5b406ae40 0x7fd5b406d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd5d0143280 0x7fd5d01597e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd5d0142c70 0x7fd5d0138c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 --2- 172.21.15.63:0/4138530352 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd5d00b2390 0x7fd5d013be40 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 >> 172.21.15.63:0/4138530352 conn(0x7fd5d00b0860 msgr2=0x7fd5d00cd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:39.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 shutdown_connections 2023-12-04T10:45:39.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.678+0000 7fd5d6dc9640 1 -- 172.21.15.63:0/4138530352 wait complete. 2023-12-04T10:45:39.699 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-04T10:45:39.922 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.921+0000 7f5285316640 1 Processor -- start 2023-12-04T10:45:39.923 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.921+0000 7f5285316640 1 -- start start 2023-12-04T10:45:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f5285316640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5280159640 0x7f5280070ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f5285316640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cda00 0x7f52800c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f5285316640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f52800cde60 0x7f52800c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f5285316640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5280071000 con 0x7f5280159640 2023-12-04T10:45:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f5285316640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52800cd570 con 0x7f52800cde60 2023-12-04T10:45:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f5285316640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5280159a20 con 0x7f52800cda00 2023-12-04T10:45:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f527ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5280159640 0x7f5280070ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.925 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f527ffff640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f5280159640 0x7f5280070ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56034/0 (socket says 172.21.15.63:56034) 2023-12-04T10:45:39.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.923+0000 7f527ffff640 1 -- 172.21.15.63:0/1713862647 learned_addr learned my addr 172.21.15.63:0/1713862647 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:39.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.924+0000 7f527ffff640 1 -- 172.21.15.63:0/1713862647 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cda00 msgr2=0x7f52800c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:39.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.924+0000 7f527ffff640 1 --2- 172.21.15.63:0/1713862647 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cda00 0x7f52800c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.924+0000 7f527ffff640 1 -- 172.21.15.63:0/1713862647 >> v2:172.21.15.66:3300/0 conn(0x7f52800cde60 msgr2=0x7f52800c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:39.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.924+0000 7f5284b15640 1 --2- 172.21.15.63:0/1713862647 >> v2:172.21.15.66:3300/0 conn(0x7f52800cde60 0x7f52800c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.926 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.924+0000 7f527ffff640 1 --2- 172.21.15.63:0/1713862647 >> v2:172.21.15.66:3300/0 conn(0x7f52800cde60 0x7f52800c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.924+0000 7f527ffff640 1 -- 172.21.15.63:0/1713862647 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f528006d400 con 0x7f5280159640 2023-12-04T10:45:39.927 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.924+0000 7f5284b15640 1 --2- 172.21.15.63:0/1713862647 >> v2:172.21.15.66:3300/0 conn(0x7f52800cde60 0x7f52800c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:39.928 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.925+0000 7f527ffff640 1 --2- 172.21.15.63:0/1713862647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280070ac0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f527000aa10 tx=0x7f527002cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e179a8da6e96582 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.925+0000 7f527f7fe640 1 -- 172.21.15.63:0/1713862647 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527002db80 con 0x7f5280159640 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.925+0000 7f527f7fe640 1 -- 172.21.15.63:0/1713862647 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f527002dce0 con 0x7f5280159640 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.925+0000 7f527f7fe640 1 -- 172.21.15.63:0/1713862647 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5270035660 con 0x7f5280159640 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 -- 172.21.15.63:0/1713862647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 msgr2=0x7f5280070ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 --2- 172.21.15.63:0/1713862647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280070ac0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f527000aa10 tx=0x7f527002cdd0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 -- 172.21.15.63:0/1713862647 shutdown_connections 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 --2- 172.21.15.63:0/1713862647 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cda00 0x7f52800c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 --2- 172.21.15.63:0/1713862647 >> v2:172.21.15.66:3300/0 conn(0x7f52800cde60 0x7f52800c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 --2- 172.21.15.63:0/1713862647 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280070ac0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 -- 172.21.15.63:0/1713862647 >> 172.21.15.63:0/1713862647 conn(0x7f52800b07f0 msgr2=0x7f52800b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 -- 172.21.15.63:0/1713862647 shutdown_connections 2023-12-04T10:45:39.929 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.926+0000 7f5285316640 1 -- 172.21.15.63:0/1713862647 wait complete. 2023-12-04T10:45:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.928+0000 7f5285316640 1 Processor -- start 2023-12-04T10:45:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.928+0000 7f5285316640 1 -- start start 2023-12-04T10:45:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.929+0000 7f5285316640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800cda00 0x7f5280151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.929+0000 7f5285316640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cde60 0x7f5280165590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.932 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.929+0000 7f5285316640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280165ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.929+0000 7f5285316640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280157800 con 0x7f5280159640 2023-12-04T10:45:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.929+0000 7f5285316640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5280156c30 con 0x7f52800cda00 2023-12-04T10:45:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.929+0000 7f5285316640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52800ae7c0 con 0x7f52800cde60 2023-12-04T10:45:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f5284b15640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280165ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f5284b15640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280165ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56050/0 (socket says 172.21.15.63:56050) 2023-12-04T10:45:39.933 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f5284b15640 1 -- 172.21.15.63:0/2151804720 learned_addr learned my addr 172.21.15.63:0/2151804720 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f527ffff640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800cda00 0x7f5280151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f52777fe640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cde60 0x7f5280165590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f5284b15640 1 -- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cde60 msgr2=0x7f5280165590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f5284b15640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cde60 0x7f5280165590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f5284b15640 1 -- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800cda00 msgr2=0x7f5280151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f5284b15640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800cda00 0x7f5280151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f5284b15640 1 -- 172.21.15.63:0/2151804720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f527000a670 con 0x7f5280159640 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f527ffff640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800cda00 0x7f5280151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.930+0000 7f52777fe640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cde60 0x7f5280165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:39.934 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.931+0000 7f5284b15640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280165ad0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f527800c820 tx=0x7f527800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:39.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.931+0000 7f527d7fa640 1 -- 172.21.15.63:0/2151804720 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5278007a30 con 0x7f5280159640 2023-12-04T10:45:39.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.931+0000 7f527d7fa640 1 -- 172.21.15.63:0/2151804720 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5278007b90 con 0x7f5280159640 2023-12-04T10:45:39.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.931+0000 7f527d7fa640 1 -- 172.21.15.63:0/2151804720 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f527800ce10 con 0x7f5280159640 2023-12-04T10:45:39.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.931+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5280151a30 con 0x7f5280159640 2023-12-04T10:45:39.935 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.931+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5280157140 con 0x7f5280159640 2023-12-04T10:45:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.932+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5280157940 con 0x7f5280159640 2023-12-04T10:45:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.934+0000 7f527d7fa640 1 -- 172.21.15.63:0/2151804720 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52780113f0 con 0x7f5280159640 2023-12-04T10:45:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.934+0000 7f527d7fa640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f526006ae40 0x7f526006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.935+0000 7f527d7fa640 1 -- 172.21.15.63:0/2151804720 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f52780898e0 con 0x7f5280159640 2023-12-04T10:45:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.935+0000 7f527ffff640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f526006ae40 0x7f526006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:39.936 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.935+0000 7f527ffff640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f526006ae40 0x7f526006d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5270037000 tx=0x7f5270008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:39.940 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:39.939+0000 7f527d7fa640 1 -- 172.21.15.63:0/2151804720 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5280157940 con 0x7f5280159640 2023-12-04T10:45:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.175+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5280165400 con 0x7f5280159640 2023-12-04T10:45:40.176 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.176+0000 7f527d7fa640 1 -- 172.21.15.63:0/2151804720 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4904 (secure 0 0 0) 0x7f5278054830 con 0x7f5280159640 2023-12-04T10:45:40.177 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:40.177 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4670,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6834/879175015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":879175015},{"type":"v1","addr":"172.21.15.66:6834","nonce":879175015}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":4864,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6835/2396111024","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6833","nonce":2396111024},{"type":"v1","addr":"172.21.15.66:6835","nonce":2396111024}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13},{"gid":5271,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.63:6836/815330279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6834","nonce":815330279},{"type":"v1","addr":"172.21.15.63:6836","nonce":815330279}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-04T10:45:33.539949+0000","modified":"2023-12-04T10:45:36.617364+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5274},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5274":{"gid":5274,"name":"a","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.63:6837/954829121","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6835","nonce":954829121},{"type":"v1","addr":"172.21.15.63:6837","nonce":954829121}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-04T10:45:40.177 INFO:teuthology.orchestra.run.smithi063.stderr:dumped fsmap epoch 18 2023-12-04T10:45:40.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.178+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f526006ae40 msgr2=0x7f526006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.178+0000 7f5285316640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f526006ae40 0x7f526006d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5270037000 tx=0x7f5270008040 comp rx=0 tx=0).stop 2023-12-04T10:45:40.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.178+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 msgr2=0x7f5280165ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.179 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.178+0000 7f5285316640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280165ad0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f527800c820 tx=0x7f527800cce0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.179+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 shutdown_connections 2023-12-04T10:45:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.179+0000 7f5285316640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f526006ae40 0x7f526006d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.179+0000 7f5285316640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f52800cde60 0x7f5280165590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.179+0000 7f5285316640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5280159640 0x7f5280165ad0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.179+0000 7f5285316640 1 --2- 172.21.15.63:0/2151804720 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f52800cda00 0x7f5280151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.179+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 >> 172.21.15.63:0/2151804720 conn(0x7f52800b07f0 msgr2=0x7f528006c180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.179+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 shutdown_connections 2023-12-04T10:45:40.180 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.179+0000 7f5285316640 1 -- 172.21.15.63:0/2151804720 wait complete. 2023-12-04T10:45:40.602 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-04T10:45:33.539949+0000', 'modified': '2023-12-04T10:45:36.617364+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5274}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5274': {'gid': 5274, 'name': 'a', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.63:6837/954829121', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.63:6835', 'nonce': 954829121}, {'type': 'v1', 'addr': '172.21.15.63:6837', 'nonce': 954829121}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-04T10:45:40.602 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-04T10:45:40.602 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-04T10:45:40.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.838+0000 7f9a4b59e640 1 Processor -- start 2023-12-04T10:45:40.839 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.838+0000 7f9a4b59e640 1 -- start start 2023-12-04T10:45:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.840+0000 7f9a4b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cb630 0x7f9a4c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.840+0000 7f9a4b59e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9a4c0c9b10 0x7f9a4c0c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.840+0000 7f9a4b59e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a4c0ccfe0 con 0x7f9a4c0cba10 2023-12-04T10:45:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.840+0000 7f9a4b59e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a4c0cd2c0 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.841 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.840+0000 7f9a4b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0cd5a0 con 0x7f9a4c0cb630 2023-12-04T10:45:40.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.841+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cb630 0x7f9a4c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.841+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cb630 0x7f9a4c0cca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:51158/0 (socket says 172.21.15.63:51158) 2023-12-04T10:45:40.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.841+0000 7f9a4a59c640 1 -- 172.21.15.63:0/2186306206 learned_addr learned my addr 172.21.15.63:0/2186306206 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:40.842 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.841+0000 7f9a4ad9d640 1 --2- 172.21.15.63:0/2186306206 >> v2:172.21.15.66:3300/0 conn(0x7f9a4c0c9b10 0x7f9a4c0c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.842+0000 7f9a4a59c640 1 -- 172.21.15.63:0/2186306206 >> v2:172.21.15.66:3300/0 conn(0x7f9a4c0c9b10 msgr2=0x7f9a4c0c9fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.842+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/2186306206 >> v2:172.21.15.66:3300/0 conn(0x7f9a4c0c9b10 0x7f9a4c0c9fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.842+0000 7f9a4a59c640 1 -- 172.21.15.63:0/2186306206 >> v1:172.21.15.66:6789/0 conn(0x7f9a4c0cba10 legacy=0x7f9a4c070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.843 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.842+0000 7f9a4a59c640 1 -- 172.21.15.63:0/2186306206 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a4c0c9310 con 0x7f9a4c0cb630 2023-12-04T10:45:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.843+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/2186306206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cb630 0x7f9a4c0cca00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009870 tx=0x7f9a3c02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b2c863d63910646 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a49d9b640 1 -- 172.21.15.63:0/2186306206 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c030840 con 0x7f9a4c0cb630 2023-12-04T10:45:40.844 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a49d9b640 1 -- 172.21.15.63:0/2186306206 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0309a0 con 0x7f9a4c0cb630 2023-12-04T10:45:40.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a49d9b640 1 -- 172.21.15.63:0/2186306206 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c030d30 con 0x7f9a4c0cb630 2023-12-04T10:45:40.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a4b59e640 1 -- 172.21.15.63:0/2186306206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cb630 msgr2=0x7f9a4c0cca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/2186306206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cb630 0x7f9a4c0cca00 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c009870 tx=0x7f9a3c02b980 comp rx=0 tx=0).stop 2023-12-04T10:45:40.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a4b59e640 1 -- 172.21.15.63:0/2186306206 shutdown_connections 2023-12-04T10:45:40.845 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/2186306206 >> v2:172.21.15.66:3300/0 conn(0x7f9a4c0c9b10 0x7f9a4c0c9fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/2186306206 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cb630 0x7f9a4c0cca00 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a4b59e640 1 -- 172.21.15.63:0/2186306206 >> 172.21.15.63:0/2186306206 conn(0x7f9a4c0b07f0 msgr2=0x7f9a4c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:40.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a4b59e640 1 -- 172.21.15.63:0/2186306206 shutdown_connections 2023-12-04T10:45:40.846 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.844+0000 7f9a4b59e640 1 -- 172.21.15.63:0/2186306206 wait complete. 2023-12-04T10:45:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.846+0000 7f9a4b59e640 1 Processor -- start 2023-12-04T10:45:40.847 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.846+0000 7f9a4b59e640 1 -- start start 2023-12-04T10:45:40.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.847+0000 7f9a4b59e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c0c9b10 0x7f9a4c0c3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.850 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.847+0000 7f9a4b59e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a4c0cb630 0x7f9a4c0c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.847+0000 7f9a4b59e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cba10 0x7f9a4c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.847+0000 7f9a4b59e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c5590 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.847+0000 7f9a4b59e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c4090 con 0x7f9a4c0cb630 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.847+0000 7f9a4b59e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4c0c37f0 con 0x7f9a4c0cba10 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c0c9b10 0x7f9a4c0c3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c0c9b10 0x7f9a4c0c3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56064/0 (socket says 172.21.15.63:56064) 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4a59c640 1 -- 172.21.15.63:0/3533850699 learned_addr learned my addr 172.21.15.63:0/3533850699 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a43fff640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a4c0cb630 0x7f9a4c0c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4ad9d640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cba10 0x7f9a4c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4a59c640 1 -- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cba10 msgr2=0x7f9a4c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cba10 0x7f9a4c155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.851 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4a59c640 1 -- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a4c0cb630 msgr2=0x7f9a4c0c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a4c0cb630 0x7f9a4c0c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4a59c640 1 -- 172.21.15.63:0/3533850699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3c0094d0 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.848+0000 7f9a4ad9d640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cba10 0x7f9a4c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.849+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c0c9b10 0x7f9a4c0c3160 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c000c00 tx=0x7f9a3c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.849+0000 7f9a42ffd640 1 -- 172.21.15.63:0/3533850699 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c039c90 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.849+0000 7f9a42ffd640 1 -- 172.21.15.63:0/3533850699 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c039df0 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.849+0000 7f9a4b59e640 1 -- 172.21.15.63:0/3533850699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a4c0cbfd0 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.849+0000 7f9a42ffd640 1 -- 172.21.15.63:0/3533850699 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c043640 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.852 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.849+0000 7f9a4b59e640 1 -- 172.21.15.63:0/3533850699 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c0c3db0 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.851+0000 7f9a42ffd640 1 -- 172.21.15.63:0/3533850699 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a3c0437a0 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.852+0000 7f9a42ffd640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9a2c06ae70 0x7f9a2c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.852+0000 7f9a42ffd640 1 -- 172.21.15.63:0/3533850699 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a3c03e070 con 0x7f9a4c0c9b10 2023-12-04T10:45:40.853 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.852+0000 7f9a43fff640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9a2c06ae70 0x7f9a2c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.853+0000 7f9a43fff640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9a2c06ae70 0x7f9a2c06d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0ae9b0 tx=0x7f9a34009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:40.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.853+0000 7f9a5360d740 1 Processor -- start 2023-12-04T10:45:40.854 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.853+0000 7f9a5360d740 1 -- start start 2023-12-04T10:45:40.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.854+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf887070 0x5624cf887450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.854+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf881d70 0x5624cf886270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.854+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 0x5624cf8ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.854+0000 7f9a5360d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf7e5880 con 0x5624cf887070 2023-12-04T10:45:40.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.854+0000 7f9a5360d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf7f4ae0 con 0x5624cf8867b0 2023-12-04T10:45:40.855 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.854+0000 7f9a5360d740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624cf7f21d0 con 0x5624cf881d70 2023-12-04T10:45:40.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf887070 0x5624cf887450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.858 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf887070 0x5624cf887450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56074/0 (socket says 172.21.15.63:56074) 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 -- 172.21.15.63:0/3222391906 learned_addr learned my addr 172.21.15.63:0/3222391906 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 -- 172.21.15.63:0/3222391906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf881d70 msgr2=0x5624cf886270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/3222391906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf881d70 0x5624cf886270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4ad9d640 1 --2- 172.21.15.63:0/3222391906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 0x5624cf8ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 -- 172.21.15.63:0/3222391906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 msgr2=0x5624cf8ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/3222391906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 0x5624cf8ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 -- 172.21.15.63:0/3222391906 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624cf7b5860 con 0x5624cf887070 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.855+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/3222391906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf887070 0x5624cf887450 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0aab20 tx=0x7f9a3c077810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f4fd150a56b78c server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a2bfff640 1 -- 172.21.15.63:0/3222391906 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c07f4f0 con 0x5624cf887070 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a2bfff640 1 -- 172.21.15.63:0/3222391906 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0836a0 con 0x5624cf887070 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a2bfff640 1 -- 172.21.15.63:0/3222391906 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c077ab0 con 0x5624cf887070 2023-12-04T10:45:40.859 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a5360d740 1 -- 172.21.15.63:0/3222391906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf887070 msgr2=0x5624cf887450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a5360d740 1 --2- 172.21.15.63:0/3222391906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf887070 0x5624cf887450 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c0aab20 tx=0x7f9a3c077810 comp rx=0 tx=0).stop 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a5360d740 1 -- 172.21.15.63:0/3222391906 shutdown_connections 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a5360d740 1 --2- 172.21.15.63:0/3222391906 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf881d70 0x5624cf886270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a5360d740 1 --2- 172.21.15.63:0/3222391906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 0x5624cf8ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a5360d740 1 --2- 172.21.15.63:0/3222391906 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf887070 0x5624cf887450 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a5360d740 1 -- 172.21.15.63:0/3222391906 >> 172.21.15.63:0/3222391906 conn(0x5624cf848c70 msgr2=0x5624cf8ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.856+0000 7f9a5360d740 1 -- 172.21.15.63:0/3222391906 shutdown_connections 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.857+0000 7f9a5360d740 1 -- 172.21.15.63:0/3222391906 wait complete. 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.857+0000 7f9a5360d740 1 -- start start 2023-12-04T10:45:40.860 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.857+0000 7f9a5360d740 1 Processor -- start 2023-12-04T10:45:40.864 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.858+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8a8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.858+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 0x5624cf8d1c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.858+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf887070 0x5624cf8ad7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.858+0000 7f9a5360d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf7edac0 con 0x5624cf881d70 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.858+0000 7f9a5360d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf78a2f0 con 0x5624cf8867b0 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.858+0000 7f9a5360d740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624cf7a7c70 con 0x5624cf887070 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.858+0000 7f9a5360d740 10 client.0 _ll_register_callbacks cb 0x5624cf7ac3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8a8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8a8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56078/0 (socket says 172.21.15.63:56078) 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 -- 172.21.15.63:0/1848095618 learned_addr learned my addr 172.21.15.63:0/1848095618 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 -- 172.21.15.63:0/1848095618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf887070 msgr2=0x5624cf8ad7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.865 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf887070 0x5624cf8ad7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 -- 172.21.15.63:0/1848095618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 msgr2=0x5624cf8d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 0x5624cf8d1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 -- 172.21.15.63:0/1848095618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a4c0c3db0 con 0x5624cf881d70 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8a8280 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c083170 tx=0x7f9a3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d82c5de731518a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.859+0000 7f9a297fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a297fa640 1 -- 172.21.15.63:0/1848095618 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c07f4f0 con 0x5624cf881d70 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a297fa640 1 -- 172.21.15.63:0/1848095618 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a3c091020 con 0x5624cf881d70 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 1 -- 172.21.15.63:0/1848095618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624cf7e6aa0 con 0x5624cf881d70 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a297fa640 1 -- 172.21.15.63:0/1848095618 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a3c07f150 con 0x5624cf881d70 2023-12-04T10:45:40.866 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 10 client.5451 fetch_fsmap learned FSMap version 18 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 1 -- 172.21.15.63:0/1848095618 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5624cf7ec140 con 0x5624cf881d70 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a297fa640 1 -- 172.21.15.63:0/1848095618 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624cf7e6aa0 con 0x5624cf881d70 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a297fa640 1 -- 172.21.15.63:0/1848095618 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9a3c07a890 con 0x5624cf881d70 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 10 client.5451 fetch_fsmap finished waiting for FSMap version 18 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 10 client.5451 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 20 client.5451 populate_metadata read hostname 'smithi063' 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] conn(0x5624cf8d3df0 0x5624cf8d41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 4 client.5451 mds_command: new command op to 5274 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.860+0000 7f9a5360d740 1 -- 172.21.15.63:0/1848095618 --> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5624cf7e67c0 con 0x5624cf8d3df0 2023-12-04T10:45:40.867 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.861+0000 7f9a43fff640 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] conn(0x5624cf8d3df0 0x5624cf8d41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.861+0000 7f9a43fff640 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] conn(0x5624cf8d3df0 0x5624cf8d41d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d4b504f81de452e server_cookie=c486958dad71fd7a in_seq=0 out_seq=0 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.861+0000 7f9a297fa640 10 client.5451 ms_handle_connect on v2:172.21.15.63:6835/954829121 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a297fa640 1 -- 172.21.15.63:0/1848095618 <== mds.0 v2:172.21.15.63:6835/954829121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5624cf7e67c0 con 0x5624cf8d3df0 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a297fa640 10 client.5451 handle_command_reply: tid=0 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 client.5451 shutdown 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 -- 172.21.15.63:0/1848095618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 msgr2=0x5624cf8a8280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8a8280 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c083170 tx=0x7f9a3c0046c0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 -- 172.21.15.63:0/1848095618 shutdown_connections 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf887070 0x5624cf8ad7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.868 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] conn(0x5624cf8d3df0 0x5624cf8d41d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf8867b0 0x5624cf8d1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1848095618 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8a8280 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a297fa640 0 client.5451 ms_handle_reset on v2:172.21.15.63:6835/954829121 2023-12-04T10:45:40.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.862+0000 7f9a5360d740 1 -- 172.21.15.63:0/1848095618 >> 172.21.15.63:0/1848095618 conn(0x5624cf848c70 msgr2=0x5624cf8cbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:40.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.863+0000 7f9a5360d740 1 -- 172.21.15.63:0/1848095618 shutdown_connections 2023-12-04T10:45:40.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.863+0000 7f9a5360d740 1 -- 172.21.15.63:0/1848095618 wait complete. 2023-12-04T10:45:40.869 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.863+0000 7f9a5360d740 20 client.5451 trim_cache size 0 max 16384 2023-12-04T10:45:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.880+0000 7f9a5360d740 1 Processor -- start 2023-12-04T10:45:40.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.880+0000 7f9a5360d740 1 -- start start 2023-12-04T10:45:40.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8ae2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf8867b0 0x5624cf8ef160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf887070 0x5624cf887450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a5360d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf550f20 con 0x5624cf881d70 2023-12-04T10:45:40.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a5360d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf8b5c30 con 0x5624cf887070 2023-12-04T10:45:40.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a5360d740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624cf771480 con 0x5624cf8867b0 2023-12-04T10:45:40.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8ae2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a4a59c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8ae2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56086/0 (socket says 172.21.15.63:56086) 2023-12-04T10:45:40.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a4a59c640 1 -- 172.21.15.63:0/708810970 learned_addr learned my addr 172.21.15.63:0/708810970 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:40.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a4a59c640 1 -- 172.21.15.63:0/708810970 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf8867b0 msgr2=0x5624cf8ef160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/708810970 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf8867b0 0x5624cf8ef160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a4a59c640 1 -- 172.21.15.63:0/708810970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf887070 msgr2=0x5624cf887450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/708810970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf887070 0x5624cf887450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.886 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.881+0000 7f9a4a59c640 1 -- 172.21.15.63:0/708810970 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5624cf789b80 con 0x5624cf881d70 2023-12-04T10:45:40.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/708810970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8ae2e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c07b190 tx=0x7f9a3c07e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4b3c7e61b6f80a server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:40.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a40ff9640 1 -- 172.21.15.63:0/708810970 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c07f4f0 con 0x5624cf881d70 2023-12-04T10:45:40.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a40ff9640 1 -- 172.21.15.63:0/708810970 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c07a890 con 0x5624cf881d70 2023-12-04T10:45:40.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a40ff9640 1 -- 172.21.15.63:0/708810970 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c07aa00 con 0x5624cf881d70 2023-12-04T10:45:40.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a5360d740 1 -- 172.21.15.63:0/708810970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 msgr2=0x5624cf8ae2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.892 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a5360d740 1 --2- 172.21.15.63:0/708810970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8ae2e0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c07b190 tx=0x7f9a3c07e040 comp rx=0 tx=0).stop 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a5360d740 1 -- 172.21.15.63:0/708810970 shutdown_connections 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a5360d740 1 --2- 172.21.15.63:0/708810970 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf8867b0 0x5624cf8ef160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a5360d740 1 --2- 172.21.15.63:0/708810970 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf887070 0x5624cf887450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a5360d740 1 --2- 172.21.15.63:0/708810970 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf881d70 0x5624cf8ae2e0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a5360d740 1 -- 172.21.15.63:0/708810970 >> 172.21.15.63:0/708810970 conn(0x5624cf848c70 msgr2=0x5624cf880dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.882+0000 7f9a5360d740 1 -- 172.21.15.63:0/708810970 shutdown_connections 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.883+0000 7f9a5360d740 1 -- 172.21.15.63:0/708810970 wait complete. 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.883+0000 7f9a5360d740 1 -- start start 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.883+0000 7f9a5360d740 1 Processor -- start 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.884+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf881d70 0x5624cf8ae1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.884+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf8867b0 0x5624cf8a8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.884+0000 7f9a5360d740 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf887070 0x5624cf8d47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.884+0000 7f9a5360d740 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf8ac4f0 con 0x5624cf8867b0 2023-12-04T10:45:40.893 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.884+0000 7f9a5360d740 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624cf8ef580 con 0x5624cf881d70 2023-12-04T10:45:40.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.884+0000 7f9a5360d740 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624cf8ac2a0 con 0x5624cf887070 2023-12-04T10:45:40.894 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.884+0000 7f9a5360d740 10 client.0 _ll_register_callbacks cb 0x7f9a3c07afd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-04T10:45:40.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf8867b0 0x5624cf8a8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf8867b0 0x5624cf8a8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56096/0 (socket says 172.21.15.63:56096) 2023-12-04T10:45:40.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 -- 172.21.15.63:0/1254554412 learned_addr learned my addr 172.21.15.63:0/1254554412 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:40.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 -- 172.21.15.63:0/1254554412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf887070 msgr2=0x5624cf8d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.895 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf887070 0x5624cf8d47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 -- 172.21.15.63:0/1254554412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf881d70 msgr2=0x5624cf8ae1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf881d70 0x5624cf8ae1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 -- 172.21.15.63:0/1254554412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624cf7ec140 con 0x5624cf8867b0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a43fff640 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf8867b0 0x5624cf8a8490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9a34007fd0 tx=0x7f9a340039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad84e9a62bfe3b29 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.885+0000 7f9a297fa640 10 client.0 ms_handle_connect on v2:172.21.15.63:3300/0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a297fa640 1 -- 172.21.15.63:0/1254554412 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a340215d0 con 0x5624cf8867b0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a297fa640 1 -- 172.21.15.63:0/1254554412 <== mon.0 v2:172.21.15.63:3300/0 2 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9a34021730 con 0x5624cf8867b0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 1 -- 172.21.15.63:0/1254554412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5624cf8d33a0 con 0x5624cf8867b0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a297fa640 1 -- 172.21.15.63:0/1254554412 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9a340218f0 con 0x5624cf8867b0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 10 client.5457 fetch_fsmap learned FSMap version 18 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 1 -- 172.21.15.63:0/1254554412 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,fsmap=18,monmap=2+}) v3 -- 0x5624cf7af170 con 0x5624cf8867b0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a297fa640 1 -- 172.21.15.63:0/1254554412 <== mon.0 v2:172.21.15.63:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5624cf8d33a0 con 0x5624cf8867b0 2023-12-04T10:45:40.896 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a297fa640 1 -- 172.21.15.63:0/1254554412 <== mon.0 v2:172.21.15.63:3300/0 5 ==== fsmap(e 18) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f9a34020040 con 0x5624cf8867b0 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 10 client.5457 fetch_fsmap finished waiting for FSMap version 18 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 10 client.5457 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 20 client.5457 populate_metadata read hostname 'smithi063' 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] conn(0x5624cf8d4d30 0x5624cf8cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 4 client.5457 mds_command: new command op to 5274 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a5360d740 1 -- 172.21.15.63:0/1254554412 --> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f9a3c0836a0 con 0x5624cf8d4d30 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.886+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] conn(0x5624cf8d4d30 0x5624cf8cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.887+0000 7f9a4a59c640 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] conn(0x5624cf8d4d30 0x5624cf8cfca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=264c2e978ddda8e0 server_cookie=32cba927e66f14f7 in_seq=0 out_seq=0 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.887+0000 7f9a297fa640 10 client.5457 ms_handle_connect on v2:172.21.15.63:6835/954829121 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.887+0000 7f9a297fa640 1 -- 172.21.15.63:0/1254554412 <== mds.0 v2:172.21.15.63:6835/954829121 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x7f9a3c0836a0 con 0x5624cf8d4d30 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.887+0000 7f9a297fa640 10 client.5457 handle_command_reply: tid=0 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.887+0000 7f9a5360d740 1 client.5457 shutdown 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.887+0000 7f9a5360d740 1 -- 172.21.15.63:0/1254554412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf8867b0 msgr2=0x5624cf8a8490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.897 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.887+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf8867b0 0x5624cf8a8490 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f9a34007fd0 tx=0x7f9a340039c0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 1 -- 172.21.15.63:0/1254554412 shutdown_connections 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x5624cf887070 0x5624cf8d47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.63:6835/954829121,v1:172.21.15.63:6837/954829121] conn(0x5624cf8d4d30 0x5624cf8cfca0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x5624cf8867b0 0x5624cf8a8490 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 1 --2- 172.21.15.63:0/1254554412 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x5624cf881d70 0x5624cf8ae1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a297fa640 0 client.5457 ms_handle_reset on v2:172.21.15.63:6835/954829121 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 1 -- 172.21.15.63:0/1254554412 >> 172.21.15.63:0/1254554412 conn(0x5624cf848c70 msgr2=0x5624cf880dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 1 -- 172.21.15.63:0/1254554412 shutdown_connections 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 1 -- 172.21.15.63:0/1254554412 wait complete. 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a5360d740 20 client.5457 trim_cache size 0 max 16384 2023-12-04T10:45:40.898 INFO:teuthology.orchestra.run.smithi063.stdout:{ 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "cluster_fsid": "41e9b14e-2141-4ea1-b0af-8533c9689063", 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "whoami": 0, 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "id": 5274, 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "want_state": "up:active", 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "state": "up:active", 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "fs_name": "cephfs", 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "rank_uptime": 6.7798706839999996, 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "mdsmap_epoch": 18, 2023-12-04T10:45:40.899 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch": 43, 2023-12-04T10:45:40.900 INFO:teuthology.orchestra.run.smithi063.stdout: "osdmap_epoch_barrier": 41, 2023-12-04T10:45:40.900 INFO:teuthology.orchestra.run.smithi063.stdout: "uptime": 15.620430787 2023-12-04T10:45:40.900 INFO:teuthology.orchestra.run.smithi063.stdout:} 2023-12-04T10:45:40.900 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a4b59e640 1 -- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9a2c06ae70 msgr2=0x7f9a2c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9a2c06ae70 0x7f9a2c06d330 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c0ae9b0 tx=0x7f9a34009040 comp rx=0 tx=0).stop 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a4b59e640 1 -- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c0c9b10 msgr2=0x7f9a4c0c3160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.888+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c0c9b10 0x7f9a4c0c3160 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c000c00 tx=0x7f9a3c004730 comp rx=0 tx=0).stop 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.889+0000 7f9a4b59e640 1 -- 172.21.15.63:0/3533850699 shutdown_connections 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.889+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f9a2c06ae70 0x7f9a2c06d330 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.889+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f9a4c0cba10 0x7f9a4c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.889+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9a4c0cb630 0x7f9a4c0c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.889+0000 7f9a4b59e640 1 --2- 172.21.15.63:0/3533850699 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f9a4c0c9b10 0x7f9a4c0c3160 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.889+0000 7f9a4b59e640 1 -- 172.21.15.63:0/3533850699 >> 172.21.15.63:0/3533850699 conn(0x7f9a4c0b07f0 msgr2=0x7f9a4c0af720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.889+0000 7f9a4b59e640 1 -- 172.21.15.63:0/3533850699 shutdown_connections 2023-12-04T10:45:40.901 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:40.889+0000 7f9a4b59e640 1 -- 172.21.15.63:0/3533850699 wait complete. 2023-12-04T10:45:40.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-04T10:45:41.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.127+0000 7fd89d90f640 1 Processor -- start 2023-12-04T10:45:41.128 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.127+0000 7fd89d90f640 1 -- start start 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.129+0000 7fd89d90f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd8980cad70 0x7fd8980710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.129+0000 7fd89d90f640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd898071600 0x7fd89815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.129+0000 7fd89d90f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89815b5c0 con 0x7fd89815b1e0 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.129+0000 7fd89d90f640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89815aa30 con 0x7fd898071600 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.129+0000 7fd89d90f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd898071dd0 con 0x7fd8980cad70 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.129+0000 7fd8977fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd898071600 0x7fd89815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.129+0000 7fd8977fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fd898071600 0x7fd89815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56102/0 (socket says 172.21.15.63:56102) 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.129+0000 7fd8977fe640 1 -- 172.21.15.63:0/2537657641 learned_addr learned my addr 172.21.15.63:0/2537657641 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.130+0000 7fd88ffff640 1 --2- 172.21.15.63:0/2537657641 >> v2:172.21.15.66:3300/0 conn(0x7fd8980cad70 0x7fd8980710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.130+0000 7fd8977fe640 1 -- 172.21.15.63:0/2537657641 >> v2:172.21.15.66:3300/0 conn(0x7fd8980cad70 msgr2=0x7fd8980710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.130+0000 7fd8977fe640 1 --2- 172.21.15.63:0/2537657641 >> v2:172.21.15.66:3300/0 conn(0x7fd8980cad70 0x7fd8980710c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.131 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.130+0000 7fd8977fe640 1 -- 172.21.15.63:0/2537657641 >> v1:172.21.15.66:6789/0 conn(0x7fd89815b1e0 legacy=0x7fd8980ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:45:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.130+0000 7fd8977fe640 1 -- 172.21.15.63:0/2537657641 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8980720b0 con 0x7fd898071600 2023-12-04T10:45:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.131+0000 7fd8977fe640 1 --2- 172.21.15.63:0/2537657641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd898071600 0x7fd89815bd50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd8980746a0 tx=0x7fd89002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1814f58dafef287 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.131+0000 7fd8967fc640 1 -- 172.21.15.63:0/2537657641 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89002c9f0 con 0x7fd898071600 2023-12-04T10:45:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.131+0000 7fd8967fc640 1 -- 172.21.15.63:0/2537657641 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89002cb50 con 0x7fd898071600 2023-12-04T10:45:41.132 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.131+0000 7fd8967fc640 1 -- 172.21.15.63:0/2537657641 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8900343f0 con 0x7fd898071600 2023-12-04T10:45:41.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.132+0000 7fd89d90f640 1 -- 172.21.15.63:0/2537657641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd898071600 msgr2=0x7fd89815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:41.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.132+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2537657641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd898071600 0x7fd89815bd50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fd8980746a0 tx=0x7fd89002be50 comp rx=0 tx=0).stop 2023-12-04T10:45:41.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.132+0000 7fd89d90f640 1 -- 172.21.15.63:0/2537657641 shutdown_connections 2023-12-04T10:45:41.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.132+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2537657641 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd898071600 0x7fd89815bd50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.133 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.132+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2537657641 >> v2:172.21.15.66:3300/0 conn(0x7fd8980cad70 0x7fd8980710c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.132+0000 7fd89d90f640 1 -- 172.21.15.63:0/2537657641 >> 172.21.15.63:0/2537657641 conn(0x7fd8980cee80 msgr2=0x7fd8980cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:41.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.132+0000 7fd89d90f640 1 -- 172.21.15.63:0/2537657641 shutdown_connections 2023-12-04T10:45:41.134 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.132+0000 7fd89d90f640 1 -- 172.21.15.63:0/2537657641 wait complete. 2023-12-04T10:45:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.134+0000 7fd89d90f640 1 Processor -- start 2023-12-04T10:45:41.135 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.134+0000 7fd89d90f640 1 -- start start 2023-12-04T10:45:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.135+0000 7fd89d90f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd898071600 0x7fd8981f3050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:41.136 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.135+0000 7fd89d90f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8980cad70 0x7fd898152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.135+0000 7fd89d90f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89815b1e0 0x7fd8981598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.135+0000 7fd89d90f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8981e17d0 con 0x7fd89815b1e0 2023-12-04T10:45:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.135+0000 7fd89d90f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8981e0c00 con 0x7fd8980cad70 2023-12-04T10:45:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.135+0000 7fd89d90f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8981e0ea0 con 0x7fd898071600 2023-12-04T10:45:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89815b1e0 0x7fd8981598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89815b1e0 0x7fd8981598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:56108/0 (socket says 172.21.15.63:56108) 2023-12-04T10:45:41.137 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 -- 172.21.15.63:0/2218377839 learned_addr learned my addr 172.21.15.63:0/2218377839 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:45:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd896ffd640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd898071600 0x7fd8981f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd88ffff640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8980cad70 0x7fd898152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 -- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd898071600 msgr2=0x7fd8981f3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd898071600 0x7fd8981f3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.138 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 -- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8980cad70 msgr2=0x7fd898152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8980cad70 0x7fd898152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 -- 172.21.15.63:0/2218377839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890009b30 con 0x7fd89815b1e0 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd88ffff640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8980cad70 0x7fd898152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.136+0000 7fd8977fe640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89815b1e0 0x7fd8981598a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd890036040 tx=0x7fd890004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.137+0000 7fd894ff9640 1 -- 172.21.15.63:0/2218377839 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd890009510 con 0x7fd89815b1e0 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.137+0000 7fd894ff9640 1 -- 172.21.15.63:0/2218377839 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89003e450 con 0x7fd89815b1e0 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.137+0000 7fd894ff9640 1 -- 172.21.15.63:0/2218377839 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89003e7e0 con 0x7fd89815b1e0 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.137+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8981e1180 con 0x7fd89815b1e0 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.137+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8981f3590 con 0x7fd89815b1e0 2023-12-04T10:45:41.139 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.138+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8981e1980 con 0x7fd89815b1e0 2023-12-04T10:45:41.140 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.139+0000 7fd894ff9640 1 -- 172.21.15.63:0/2218377839 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd89003e940 con 0x7fd89815b1e0 2023-12-04T10:45:41.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.140+0000 7fd894ff9640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87806ae70 0x7fd87806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:45:41.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.140+0000 7fd894ff9640 1 -- 172.21.15.63:0/2218377839 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd8900ac360 con 0x7fd89815b1e0 2023-12-04T10:45:41.141 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.140+0000 7fd896ffd640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87806ae70 0x7fd87806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:45:41.142 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.141+0000 7fd896ffd640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87806ae70 0x7fd87806d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd88800a750 tx=0x7fd888008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:45:41.145 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.145+0000 7fd894ff9640 1 -- 172.21.15.63:0/2218377839 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd8981e1980 con 0x7fd89815b1e0 2023-12-04T10:45:41.383 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.382+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd898068710 con 0x7fd89815b1e0 2023-12-04T10:45:41.384 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.383+0000 7fd894ff9640 1 -- 172.21.15.63:0/2218377839 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v18) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd890077180 con 0x7fd89815b1e0 2023-12-04T10:45:41.384 INFO:teuthology.orchestra.run.smithi063.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-04T10:45:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87806ae70 msgr2=0x7fd87806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87806ae70 0x7fd87806d330 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd88800a750 tx=0x7fd888008040 comp rx=0 tx=0).stop 2023-12-04T10:45:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89815b1e0 msgr2=0x7fd8981598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:45:41.386 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89815b1e0 0x7fd8981598a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fd890036040 tx=0x7fd890004a40 comp rx=0 tx=0).stop 2023-12-04T10:45:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 shutdown_connections 2023-12-04T10:45:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd87806ae70 0x7fd87806d330 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd89815b1e0 0x7fd8981598a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd8980cad70 0x7fd898152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 --2- 172.21.15.63:0/2218377839 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd898071600 0x7fd8981f3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:45:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.385+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 >> 172.21.15.63:0/2218377839 conn(0x7fd8980cee80 msgr2=0x7fd8980cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:45:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.386+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 shutdown_connections 2023-12-04T10:45:41.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:45:41.386+0000 7fd89d90f640 1 -- 172.21.15.63:0/2218377839 wait complete. 2023-12-04T10:45:41.407 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-04T10:45:41.407 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-04T10:45:41.407 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi063.front.sepia.ceph.com 2023-12-04T10:45:41.407 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-04T10:45:41.407 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-04T10:45:41.407 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-04T10:45:41.407 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-04T10:45:41.407 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-04T10:45:41.408 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T10:45:41.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:41.408 DEBUG:teuthology.orchestra.run.smithi063:> ip addr 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout: inet 127.0.0.1/8 scope host lo 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 ::1/128 scope host 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:76 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f0 2023-12-04T10:45:41.466 INFO:teuthology.orchestra.run.smithi063.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:a8:b4:77 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: altname enp7s0f1 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d6 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 0c:c4:7a:b6:f8:d7 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: inet 172.21.15.63/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft 42214sec preferred_lft 42214sec 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::ec4:7aff:feb6:f8d7/64 scope link 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 16:f2:2d:81:20:26 brd ff:ff:ff:ff:ff:ff 2023-12-04T10:45:41.467 INFO:teuthology.orchestra.run.smithi063.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::45d:65ff:fefe:3e23/64 scope link 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 16:f2:2d:81:20:26 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::14f2:2dff:fe81:2026/64 scope link 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: link/ether 92:5e:df:85:8e:cd brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: inet6 fe80::905e:dfff:fe85:8ecd/64 scope link 2023-12-04T10:45:41.468 INFO:teuthology.orchestra.run.smithi063.stdout: valid_lft forever preferred_lft forever 2023-12-04T10:45:41.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:41.469 DEBUG:teuthology.orchestra.run.smithi063:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-04T10:45:41.570 INFO:teuthology.orchestra.run.smithi063.stdout:1 2023-12-04T10:45:41.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:41.575 DEBUG:teuthology.orchestra.run.smithi063:> route 2023-12-04T10:45:41.637 INFO:teuthology.orchestra.run.smithi063.stdout:Kernel IP routing table 2023-12-04T10:45:41.637 INFO:teuthology.orchestra.run.smithi063.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-04T10:45:41.637 INFO:teuthology.orchestra.run.smithi063.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-04T10:45:41.637 INFO:teuthology.orchestra.run.smithi063.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-04T10:45:41.637 INFO:teuthology.orchestra.run.smithi063.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-04T10:45:41.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:41.638 DEBUG:teuthology.orchestra.run.smithi063:> (cd / && exec bash -c ' 2023-12-04T10:45:41.638 DEBUG:teuthology.orchestra.run.smithi063:> set -e 2023-12-04T10:45:41.638 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-04T10:45:41.638 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-04T10:45:41.638 DEBUG:teuthology.orchestra.run.smithi063:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-04T10:45:41.638 DEBUG:teuthology.orchestra.run.smithi063:> ') 2023-12-04T10:45:41.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:41.838 DEBUG:teuthology.orchestra.run.smithi063:> ip netns list 2023-12-04T10:45:41.892 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-04T10:45:41.892 INFO:teuthology.orchestra.run.smithi063.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-04T10:45:41.893 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-04T10:45:41.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:41.893 DEBUG:teuthology.orchestra.run.smithi063:> sudo ip link set brx.0 up 2023-12-04T10:45:41.998 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:45:41.998 DEBUG:teuthology.orchestra.run.smithi063:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-04T10:45:42.054 INFO:teuthology.orchestra.run.smithi063.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-04T10:45:42.055 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-04T10:45:42.055 DEBUG:teuthology.orchestra.run.smithi063:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-04T10:45:42.108 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-12-04T10:45:42.108 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:42.108 DEBUG:teuthology.orchestra.run.smithi063:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:45:42.254 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:45:42.254 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:45:42.289 INFO:teuthology.orchestra.run.smithi063.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-12-04T10:45:42.289 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-12-04T10:45:42.289 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: resolved to: "172.21.15.63:3300,172.21.15.66:3300,172.21.15.66:3301" 2023-12-04T10:45:42.289 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: trying mount with new device syntax: 0@41e9b14e-2141-4ea1-b0af-8533c9689063.cephfs=/ 2023-12-04T10:45:42.289 INFO:teuthology.orchestra.run.smithi063.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.63:3300/172.21.15.66:3300/172.21.15.66:3301" will pass to kernel 2023-12-04T10:45:42.292 INFO:teuthology.orchestra.run.smithi063.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-04T10:45:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: You just mounted a file system that supports labels which does not 2023-12-04T10:45:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-04T10:45:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: applications will generate AVC messages and not be allowed access to 2023-12-04T10:45:42.292 INFO:teuthology.orchestra.run.smithi063.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-04T10:45:42.296 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-04T10:45:42.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:42.296 DEBUG:teuthology.orchestra.run.smithi063:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-04T10:45:42.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:42.388 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-04T10:45:42.462 INFO:teuthology.orchestra.run.smithi063.stdout:client5466 2023-12-04T10:45:42.463 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:45:42.463 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T10:45:42.520 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=xfstests-dev 2023-12-04T10:45:42.579 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.Qs710hMD8ixfstests-dev 2023-12-04T10:45:42.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:42.579 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.Qs710hMD8ixfstests-dev) 2023-12-04T10:45:42.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:42.679 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.Qs710hMD8ixfstests-dev) 2023-12-04T10:45:42.746 INFO:teuthology.orchestra.run.smithi063.stderr:Cloning into '/tmp/tmp.Qs710hMD8ixfstests-dev'... 2023-12-04T10:45:43.794 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:43.794 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-04T10:45:43.865 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=test 2023-12-04T10:45:43.925 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.kMUSrf2Uhytest 2023-12-04T10:45:43.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:45:43.925 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-04T10:45:43.989 DEBUG:teuthology.orchestra.run.smithi063:> mktemp -d --suffix=scratch 2023-12-04T10:45:44.043 INFO:teuthology.orchestra.run.smithi063.stdout:/tmp/tmp.dLsp01GiBascratch 2023-12-04T10:45:44.045 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-04T10:45:44.045 DEBUG:teuthology.orchestra.run.smithi063:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-12-04T10:45:44.934 INFO:teuthology.orchestra.run.smithi063.stdout:Last metadata expiration check: 0:04:27 ago on Mon 04 Dec 2023 10:41:17 AM UTC. 2023-12-04T10:45:45.042 INFO:teuthology.orchestra.run.smithi063.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-04T10:45:45.043 INFO:teuthology.orchestra.run.smithi063.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-04T10:45:45.044 INFO:teuthology.orchestra.run.smithi063.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-04T10:45:45.045 INFO:teuthology.orchestra.run.smithi063.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-04T10:45:45.047 INFO:teuthology.orchestra.run.smithi063.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-04T10:45:45.049 INFO:teuthology.orchestra.run.smithi063.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-04T10:45:45.050 INFO:teuthology.orchestra.run.smithi063.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-04T10:45:45.052 INFO:teuthology.orchestra.run.smithi063.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-04T10:45:45.054 INFO:teuthology.orchestra.run.smithi063.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2023-12-04T10:45:45.057 INFO:teuthology.orchestra.run.smithi063.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-04T10:45:45.058 INFO:teuthology.orchestra.run.smithi063.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-04T10:45:45.060 INFO:teuthology.orchestra.run.smithi063.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-04T10:45:45.061 INFO:teuthology.orchestra.run.smithi063.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-04T10:45:45.062 INFO:teuthology.orchestra.run.smithi063.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-04T10:45:45.063 INFO:teuthology.orchestra.run.smithi063.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-04T10:45:45.064 INFO:teuthology.orchestra.run.smithi063.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-04T10:45:45.065 INFO:teuthology.orchestra.run.smithi063.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-04T10:45:45.066 INFO:teuthology.orchestra.run.smithi063.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-04T10:45:45.067 INFO:teuthology.orchestra.run.smithi063.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-04T10:45:45.070 INFO:teuthology.orchestra.run.smithi063.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-04T10:45:45.127 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:45:45.138 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout:Dependencies resolved. 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: Package Arch Version Repository Size 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout:Installing: 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: kernel-devel x86_64 5.14.0-388.el9 appstream 21 M 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-12-04T10:45:45.139 INFO:teuthology.orchestra.run.smithi063.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrading: 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: python-unversioned-command noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-12-04T10:45:45.140 INFO:teuthology.orchestra.run.smithi063.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout:Installing dependencies: 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout:Installing weak dependencies: 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:45.141 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction Summary 2023-12-04T10:45:45.142 INFO:teuthology.orchestra.run.smithi063.stdout:================================================================================ 2023-12-04T10:45:45.142 INFO:teuthology.orchestra.run.smithi063.stdout:Install 17 Packages 2023-12-04T10:45:45.142 INFO:teuthology.orchestra.run.smithi063.stdout:Upgrade 16 Packages 2023-12-04T10:45:45.142 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:45:45.143 INFO:teuthology.orchestra.run.smithi063.stdout:Total download size: 97 M 2023-12-04T10:45:45.143 INFO:teuthology.orchestra.run.smithi063.stdout:Downloading Packages: 2023-12-04T10:45:45.808 INFO:teuthology.orchestra.run.smithi063.stdout:(1/33): fio-engine-http-3.35-1.el9.x86_64.rpm 74 kB/s | 17 kB 00:00 2023-12-04T10:45:45.843 INFO:teuthology.orchestra.run.smithi063.stdout:(2/33): fio-engine-libaio-3.35-1.el9.x86_64.rpm 55 kB/s | 14 kB 00:00 2023-12-04T10:45:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:(3/33): fio-engine-nbd-3.35-1.el9.x86_64.rpm 135 kB/s | 13 kB 00:00 2023-12-04T10:45:45.952 INFO:teuthology.orchestra.run.smithi063.stdout:(4/33): fio-engine-rados-3.35-1.el9.x86_64.rpm 139 kB/s | 15 kB 00:00 2023-12-04T10:45:46.086 INFO:teuthology.orchestra.run.smithi063.stdout:(5/33): fio-3.35-1.el9.x86_64.rpm 12 MB/s | 6.2 MB 00:00 2023-12-04T10:45:46.111 INFO:teuthology.orchestra.run.smithi063.stdout:(6/33): fio-engine-rbd-3.35-1.el9.x86_64.rpm 81 kB/s | 15 kB 00:00 2023-12-04T10:45:46.136 INFO:teuthology.orchestra.run.smithi063.stdout:(7/33): fio-engine-rdma-3.35-1.el9.x86_64.rpm 110 kB/s | 20 kB 00:00 2023-12-04T10:45:46.170 INFO:teuthology.orchestra.run.smithi063.stdout:(8/33): libcap-devel-2.48-9.el9.x86_64.rpm 577 kB/s | 33 kB 00:00 2023-12-04T10:45:46.204 INFO:teuthology.orchestra.run.smithi063.stdout:(9/33): sqlite-3.34.1-6.el9.x86_64.rpm 8.1 MB/s | 747 kB 00:00 2023-12-04T10:45:46.237 INFO:teuthology.orchestra.run.smithi063.stdout:(10/33): udftools-2.2-5.el9.x86_64.rpm 1.5 MB/s | 144 kB 00:00 2023-12-04T10:45:46.263 INFO:teuthology.orchestra.run.smithi063.stdout:(11/33): rmt-1.6-6.el9.x86_64.rpm 803 kB/s | 45 kB 00:00 2023-12-04T10:45:46.380 INFO:teuthology.orchestra.run.smithi063.stdout:(12/33): gdbm-1.19-4.el9.x86_64.rpm 1.1 MB/s | 132 kB 00:00 2023-12-04T10:45:46.488 INFO:teuthology.orchestra.run.smithi063.stdout:(13/33): gdbm-devel-1.19-4.el9.x86_64.rpm 547 kB/s | 59 kB 00:00 2023-12-04T10:45:46.522 INFO:teuthology.orchestra.run.smithi063.stdout:(14/33): libnbd-1.18.1-3.el9.x86_64.rpm 588 kB/s | 166 kB 00:00 2023-12-04T10:45:46.789 INFO:teuthology.orchestra.run.smithi063.stdout:(15/33): dump-0.4-0.51.b47.el9.x86_64.rpm 294 kB/s | 88 kB 00:00 2023-12-04T10:45:46.914 INFO:teuthology.orchestra.run.smithi063.stdout:(16/33): indent-2.2.13-4.el9.x86_64.rpm 568 kB/s | 179 kB 00:00 2023-12-04T10:45:47.165 INFO:teuthology.orchestra.run.smithi063.stdout:(17/33): cpp-11.4.1-2.3.el9.x86_64.rpm 28 MB/s | 11 MB 00:00 2023-12-04T10:45:48.181 INFO:teuthology.orchestra.run.smithi063.stdout:(18/33): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 13 MB 00:01 2023-12-04T10:45:48.540 INFO:teuthology.orchestra.run.smithi063.stdout:(19/33): gcc-11.4.1-2.3.el9.x86_64.rpm 20 MB/s | 32 MB 00:01 2023-12-04T10:45:48.565 INFO:teuthology.orchestra.run.smithi063.stdout:(20/33): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 126 kB/s | 47 kB 00:00 2023-12-04T10:45:48.607 INFO:teuthology.orchestra.run.smithi063.stdout:(21/33): python-unversioned-command-3.9.18-1.el 219 kB/s | 8.8 kB 00:00 2023-12-04T10:45:48.716 INFO:teuthology.orchestra.run.smithi063.stdout:(22/33): libstdc++-devel-11.4.1-2.3.el9.x86_64. 15 MB/s | 2.2 MB 00:00 2023-12-04T10:45:48.749 INFO:teuthology.orchestra.run.smithi063.stdout:(23/33): python3-devel-3.9.18-1.el9.x86_64.rpm 1.5 MB/s | 204 kB 00:00 2023-12-04T10:45:48.799 INFO:teuthology.orchestra.run.smithi063.stdout:(24/33): e2fsprogs-1.46.5-4.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2023-12-04T10:45:48.834 INFO:teuthology.orchestra.run.smithi063.stdout:(25/33): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 3.0 MB/s | 221 kB 00:00 2023-12-04T10:45:48.859 INFO:teuthology.orchestra.run.smithi063.stdout:(26/33): libcom_err-1.46.5-4.el9.x86_64.rpm 452 kB/s | 25 kB 00:00 2023-12-04T10:45:48.884 INFO:teuthology.orchestra.run.smithi063.stdout:(27/33): libgcc-11.4.1-2.3.el9.x86_64.rpm 1.8 MB/s | 92 kB 00:00 2023-12-04T10:45:48.917 INFO:teuthology.orchestra.run.smithi063.stdout:(28/33): libgomp-11.4.1-2.3.el9.x86_64.rpm 4.6 MB/s | 268 kB 00:00 2023-12-04T10:45:48.934 INFO:teuthology.orchestra.run.smithi063.stdout:(29/33): libss-1.46.5-4.el9.x86_64.rpm 656 kB/s | 31 kB 00:00 2023-12-04T10:45:48.976 INFO:teuthology.orchestra.run.smithi063.stdout:(30/33): libstdc++-11.4.1-2.3.el9.x86_64.rpm 13 MB/s | 735 kB 00:00 2023-12-04T10:45:49.002 INFO:teuthology.orchestra.run.smithi063.stdout:(31/33): python3-3.9.18-1.el9.x86_64.rpm 439 kB/s | 26 kB 00:00 2023-12-04T10:45:49.169 INFO:teuthology.orchestra.run.smithi063.stdout:(32/33): python3-libs-3.9.18-1.el9.x86_64.rpm 38 MB/s | 7.3 MB 00:00 2023-12-04T10:45:56.136 INFO:teuthology.orchestra.run.smithi063.stdout:(33/33): kernel-devel-5.14.0-388.el9.x86_64.rpm 2.1 MB/s | 21 MB 00:09 2023-12-04T10:45:56.146 INFO:teuthology.orchestra.run.smithi063.stdout:-------------------------------------------------------------------------------- 2023-12-04T10:45:56.146 INFO:teuthology.orchestra.run.smithi063.stdout:Total 8.8 MB/s | 97 MB 00:11 2023-12-04T10:45:56.509 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction check 2023-12-04T10:45:56.893 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction check succeeded. 2023-12-04T10:45:56.893 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction test 2023-12-04T10:45:58.286 INFO:teuthology.orchestra.run.smithi063.stdout:Transaction test succeeded. 2023-12-04T10:45:58.287 INFO:teuthology.orchestra.run.smithi063.stdout:Running transaction 2023-12-04T10:46:00.795 INFO:teuthology.orchestra.run.smithi063.stdout: Preparing : 1/1 2023-12-04T10:46:00.872 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/49 2023-12-04T10:46:00.911 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-12-04T10:46:01.070 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-12-04T10:46:01.153 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/49 2023-12-04T10:46:01.976 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/49 2023-12-04T10:46:02.288 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/49 2023-12-04T10:46:03.965 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/49 2023-12-04T10:46:04.194 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/49 2023-12-04T10:46:04.238 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/49 2023-12-04T10:46:04.290 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/49 2023-12-04T10:46:04.639 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/49 2023-12-04T10:46:05.920 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/49 2023-12-04T10:46:06.173 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/49 2023-12-04T10:46:06.272 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/49 2023-12-04T10:46:06.328 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 13/49 2023-12-04T10:46:06.365 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 14/49 2023-12-04T10:46:06.423 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 15/49 2023-12-04T10:46:06.449 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 16/49 2023-12-04T10:46:06.491 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 17/49 2023-12-04T10:46:06.525 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 18/49 2023-12-04T10:46:06.558 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 19/49 2023-12-04T10:46:06.827 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 20/49 2023-12-04T10:46:06.871 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : fio-3.35-1.el9.x86_64 21/49 2023-12-04T10:46:06.913 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : rmt-2:1.6-6.el9.x86_64 22/49 2023-12-04T10:46:06.951 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 23/49 2023-12-04T10:46:15.288 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:46:15.297 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:46:18.806 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 24/49 2023-12-04T10:46:19.070 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : kernel-devel-5.14.0-388.el9.x86_64 25/49 2023-12-04T10:46:45.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:46:45.444 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:47:14.353 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: kernel-devel-5.14.0-388.el9.x86_64 25/49 2023-12-04T10:47:14.431 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 26/49 2023-12-04T10:47:14.470 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-12-04T10:47:14.668 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-12-04T10:47:14.817 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 28/49 2023-12-04T10:47:15.046 INFO:teuthology.orchestra.run.smithi063.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 29/49 2023-12-04T10:47:15.108 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : indent-2.2.13-4.el9.x86_64 30/49 2023-12-04T10:47:15.164 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : udftools-2.2-5.el9.x86_64 31/49 2023-12-04T10:47:15.241 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 32/49 2023-12-04T10:47:15.304 INFO:teuthology.orchestra.run.smithi063.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 33/49 2023-12-04T10:47:15.344 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 34/49 2023-12-04T10:47:15.383 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 35/49 2023-12-04T10:47:15.425 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 36/49 2023-12-04T10:47:15.458 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 37/49 2023-12-04T10:47:15.484 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 38/49 2023-12-04T10:47:15.484 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-12-04T10:47:15.592 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:47:15.603 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:47:15.605 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-12-04T10:47:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 40/49 2023-12-04T10:47:15.684 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 41/49 2023-12-04T10:47:15.759 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 42/49 2023-12-04T10:47:15.805 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 43/49 2023-12-04T10:47:15.846 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 44/49 2023-12-04T10:47:15.846 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-12-04T10:47:15.981 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-12-04T10:47:16.025 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 46/49 2023-12-04T10:47:16.065 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 47/49 2023-12-04T10:47:16.209 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 48/49 2023-12-04T10:47:16.376 INFO:teuthology.orchestra.run.smithi063.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-04T10:47:17.949 INFO:teuthology.orchestra.run.smithi063.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-3.35-1.el9.x86_64 1/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 9/49 2023-12-04T10:47:17.950 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : kernel-devel-5.14.0-388.el9.x86_64 12/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : indent-2.2.13-4.el9.x86_64 17/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 18/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 20/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 22/49 2023-12-04T10:47:17.951 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 24/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 26/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 27/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 28/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 29/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 30/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 31/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 32/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 33/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 34/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 35/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 36/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 37/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 38/49 2023-12-04T10:47:17.952 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 39/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 40/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 41/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libss-1.46.5-4.el9.x86_64 42/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libss-1.46.5-3.el9.x86_64 43/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 44/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 45/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-3.9.18-1.el9.x86_64 46/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-3.9.17-2.el9.x86_64 47/49 2023-12-04T10:47:17.953 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 48/49 2023-12-04T10:47:18.799 INFO:teuthology.orchestra.run.smithi063.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-04T10:47:18.799 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:47:18.799 INFO:teuthology.orchestra.run.smithi063.stdout:Upgraded: 2023-12-04T10:47:18.799 INFO:teuthology.orchestra.run.smithi063.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-12-04T10:47:18.799 INFO:teuthology.orchestra.run.smithi063.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-12-04T10:47:18.799 INFO:teuthology.orchestra.run.smithi063.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-12-04T10:47:18.799 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: libss-1.46.5-4.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: python3-3.9.18-1.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout:Installed: 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-12-04T10:47:18.800 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout: indent-2.2.13-4.el9.x86_64 kernel-devel-5.14.0-388.el9.x86_64 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout: udftools-2.2-5.el9.x86_64 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:47:18.801 INFO:teuthology.orchestra.run.smithi063.stdout:Complete! 2023-12-04T10:47:19.414 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd -m fsgqa 2023-12-04T10:47:19.540 INFO:teuthology.orchestra.run.smithi063.stderr:useradd: user 'fsgqa' already exists 2023-12-04T10:47:19.544 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-04T10:47:19.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo groupadd fsgqa 2023-12-04T10:47:19.617 INFO:teuthology.orchestra.run.smithi063.stderr:groupadd: group 'fsgqa' already exists 2023-12-04T10:47:19.620 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-04T10:47:19.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd fsgqa2 2023-12-04T10:47:20.293 DEBUG:teuthology.orchestra.run.smithi063:> sudo useradd 123456-fsgqa 2023-12-04T10:47:20.952 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-04T10:47:21.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.157+0000 7ff7baa1d640 1 Processor -- start 2023-12-04T10:47:21.158 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.157+0000 7ff7baa1d640 1 -- start start 2023-12-04T10:47:21.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.159+0000 7ff7baa1d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b415b1e0 0x7ff7b40ca660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.159+0000 7ff7baa1d640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7b40caba0 0x7ff7b40710c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.159+0000 7ff7baa1d640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7b40cb000 con 0x7ff7b4071600 2023-12-04T10:47:21.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.159+0000 7ff7baa1d640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7b415aa30 con 0x7ff7b40caba0 2023-12-04T10:47:21.160 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.159+0000 7ff7baa1d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b415b5c0 con 0x7ff7b415b1e0 2023-12-04T10:47:21.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.159+0000 7ff7b37fe640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7ff7b40caba0 0x7ff7b40710c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.159+0000 7ff7b8fba640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7ff7b4071600 0x7ff7b40c94d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:36446/0 (socket says 172.21.15.63:36446) 2023-12-04T10:47:21.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.159+0000 7ff7b8fba640 1 -- 172.21.15.63:0/2588270308 learned_addr learned my addr 172.21.15.63:0/2588270308 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T10:47:21.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.160+0000 7ff7b3fff640 1 --2- 172.21.15.63:0/2588270308 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b415b1e0 0x7ff7b40ca660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.160+0000 7ff7b37fe640 1 -- 172.21.15.63:0/2588270308 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b415b1e0 msgr2=0x7ff7b40ca660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:47:21.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.160+0000 7ff7b37fe640 1 --2- 172.21.15.63:0/2588270308 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b415b1e0 0x7ff7b40ca660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.161 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.160+0000 7ff7b37fe640 1 -- 172.21.15.63:0/2588270308 >> v1:172.21.15.63:6789/0 conn(0x7ff7b4071600 legacy=0x7ff7b40c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.160+0000 7ff7b37fe640 1 -- 172.21.15.63:0/2588270308 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7b4071dd0 con 0x7ff7b40caba0 2023-12-04T10:47:21.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.161+0000 7ff7b37fe640 1 --2- 172.21.15.63:0/2588270308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b40caba0 0x7ff7b40710c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80097a0 tx=0x7ff7a802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd2c8c691acf247 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:47:21.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.161+0000 7ff7b2ffd640 1 -- 172.21.15.63:0/2588270308 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a802d040 con 0x7ff7b40caba0 2023-12-04T10:47:21.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.161+0000 7ff7b2ffd640 1 -- 172.21.15.63:0/2588270308 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a8031810 con 0x7ff7b40caba0 2023-12-04T10:47:21.162 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.161+0000 7ff7b2ffd640 1 -- 172.21.15.63:0/2588270308 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a8031ba0 con 0x7ff7b40caba0 2023-12-04T10:47:21.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.162+0000 7ff7baa1d640 1 -- 172.21.15.63:0/2588270308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b40caba0 msgr2=0x7ff7b40710c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.162+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/2588270308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b40caba0 0x7ff7b40710c0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff7a80097a0 tx=0x7ff7a802b8b0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.162+0000 7ff7baa1d640 1 -- 172.21.15.63:0/2588270308 shutdown_connections 2023-12-04T10:47:21.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.162+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/2588270308 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b40caba0 0x7ff7b40710c0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.162+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/2588270308 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b415b1e0 0x7ff7b40ca660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.163 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.162+0000 7ff7baa1d640 1 -- 172.21.15.63:0/2588270308 >> 172.21.15.63:0/2588270308 conn(0x7ff7b40cee80 msgr2=0x7ff7b40cf290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:47:21.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.162+0000 7ff7baa1d640 1 -- 172.21.15.63:0/2588270308 shutdown_connections 2023-12-04T10:47:21.164 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.162+0000 7ff7baa1d640 1 -- 172.21.15.63:0/2588270308 wait complete. 2023-12-04T10:47:21.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.164+0000 7ff7baa1d640 1 Processor -- start 2023-12-04T10:47:21.165 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.164+0000 7ff7baa1d640 1 -- start start 2023-12-04T10:47:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.165+0000 7ff7baa1d640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b4071600 0x7ff7b414d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.165+0000 7ff7baa1d640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7b40caba0 0x7ff7b41f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.165+0000 7ff7baa1d640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b415b1e0 0x7ff7b414ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.165+0000 7ff7baa1d640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b4140200 con 0x7ff7b415b1e0 2023-12-04T10:47:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.165+0000 7ff7baa1d640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b40cbd30 con 0x7ff7b40caba0 2023-12-04T10:47:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.165+0000 7ff7baa1d640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7b414ddf0 con 0x7ff7b4071600 2023-12-04T10:47:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b415b1e0 0x7ff7b414ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.167 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b415b1e0 0x7ff7b414ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55226/0 (socket says 172.21.15.63:55226) 2023-12-04T10:47:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 -- 172.21.15.63:0/1487173971 learned_addr learned my addr 172.21.15.63:0/1487173971 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:47:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b3fff640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b4071600 0x7ff7b414d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b37fe640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7b40caba0 0x7ff7b41f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 -- 172.21.15.63:0/1487173971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b4071600 msgr2=0x7ff7b414d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b4071600 0x7ff7b414d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 -- 172.21.15.63:0/1487173971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7b40caba0 msgr2=0x7ff7b41f6b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7b40caba0 0x7ff7b41f6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.168 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 -- 172.21.15.63:0/1487173971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8009400 con 0x7ff7b415b1e0 2023-12-04T10:47:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.166+0000 7ff7b8fba640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b415b1e0 0x7ff7b414ad70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00cbc0 tx=0x7ff7ac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:47:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.167+0000 7ff7b0ff9640 1 -- 172.21.15.63:0/1487173971 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00ad40 con 0x7ff7b415b1e0 2023-12-04T10:47:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.167+0000 7ff7b0ff9640 1 -- 172.21.15.63:0/1487173971 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ac012400 con 0x7ff7b415b1e0 2023-12-04T10:47:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.167+0000 7ff7b0ff9640 1 -- 172.21.15.63:0/1487173971 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ac00aea0 con 0x7ff7b415b1e0 2023-12-04T10:47:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.167+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7b41f7390 con 0x7ff7b415b1e0 2023-12-04T10:47:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.167+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7b41f7950 con 0x7ff7b415b1e0 2023-12-04T10:47:21.169 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.168+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7b4070460 con 0x7ff7b415b1e0 2023-12-04T10:47:21.170 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.169+0000 7ff7b0ff9640 1 -- 172.21.15.63:0/1487173971 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff7ac007070 con 0x7ff7b415b1e0 2023-12-04T10:47:21.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.170+0000 7ff7b0ff9640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff7a006ae40 0x7ff7a006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.171 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.170+0000 7ff7b0ff9640 1 -- 172.21.15.63:0/1487173971 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7ac0895e0 con 0x7ff7b415b1e0 2023-12-04T10:47:21.172 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.171+0000 7ff7b3fff640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff7a006ae40 0x7ff7a006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.173 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.172+0000 7ff7b3fff640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff7a006ae40 0x7ff7a006d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4006fd0 tx=0x7ff7a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:47:21.177 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.175+0000 7ff7b0ff9640 1 -- 172.21.15.63:0/1487173971 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff7ac0545d0 con 0x7ff7b415b1e0 2023-12-04T10:47:21.448 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.447+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff7b4068710 con 0x7ff7b415b1e0 2023-12-04T10:47:21.449 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.448+0000 7ff7b0ff9640 1 -- 172.21.15.63:0/1487173971 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1268 (secure 0 0 0) 0x7ff7ac017510 con 0x7ff7b415b1e0 2023-12-04T10:47:21.449 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:47:21.450 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":1,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","modified":"2023-12-04T10:42:47.157628Z","created":"2023-12-04T10:42:47.157628Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:3300","nonce":0},{"type":"v1","addr":"172.21.15.63:6789","nonce":0}]},"addr":"172.21.15.63:6789/0","public_addr":"172.21.15.63:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3300","nonce":0},{"type":"v1","addr":"172.21.15.66:6789","nonce":0}]},"addr":"172.21.15.66:6789/0","public_addr":"172.21.15.66:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:3301","nonce":0},{"type":"v1","addr":"172.21.15.66:6790","nonce":0}]},"addr":"172.21.15.66:6790/0","public_addr":"172.21.15.66:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-04T10:47:21.450 INFO:teuthology.orchestra.run.smithi063.stderr:dumped monmap epoch 1 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.450+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff7a006ae40 msgr2=0x7ff7a006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.450+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff7a006ae40 0x7ff7a006d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff7a4006fd0 tx=0x7ff7a4008040 comp rx=0 tx=0).stop 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b415b1e0 msgr2=0x7ff7b414ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b415b1e0 0x7ff7b414ad70 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac00cbc0 tx=0x7ff7ac00a430 comp rx=0 tx=0).stop 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 shutdown_connections 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7ff7a006ae40 0x7ff7a006d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7ff7b415b1e0 0x7ff7b414ad70 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff7b40caba0 0x7ff7b41f6b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.452 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 --2- 172.21.15.63:0/1487173971 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7ff7b4071600 0x7ff7b414d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 >> 172.21.15.63:0/1487173971 conn(0x7ff7b40cee80 msgr2=0x7ff7b40b2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:47:21.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 shutdown_connections 2023-12-04T10:47:21.453 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.451+0000 7ff7baa1d640 1 -- 172.21.15.63:0/1487173971 wait complete. 2023-12-04T10:47:21.470 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-04T10:47:21.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.666+0000 7f2e142fc640 1 Processor -- start 2023-12-04T10:47:21.667 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.666+0000 7f2e142fc640 1 -- start start 2023-12-04T10:47:21.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.668+0000 7f2e142fc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c0cfb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.668+0000 7f2e142fc640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f2e0c0d0070 0x7f2e0c15d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.668+0000 7f2e142fc640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0c0cf6a0 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.668+0000 7f2e142fc640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e0c06ca70 con 0x7f2e0c0d0070 2023-12-04T10:47:21.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.668+0000 7f2e142fc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0cf370 con 0x7f2e0c0b2170 2023-12-04T10:47:21.669 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.668+0000 7f2e11897640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c0cfb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.669+0000 7f2e11897640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c0cfb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3301/0 says I am v2:172.21.15.63:35950/0 (socket says 172.21.15.63:35950) 2023-12-04T10:47:21.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.669+0000 7f2e11897640 1 -- 172.21.15.63:0/2882186666 learned_addr learned my addr 172.21.15.63:0/2882186666 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:47:21.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.669+0000 7f2e12899640 1 --2- 172.21.15.63:0/2882186666 >> v2:172.21.15.66:3300/0 conn(0x7f2e0c0d0070 0x7f2e0c15d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.669+0000 7f2e11897640 1 -- 172.21.15.63:0/2882186666 >> v2:172.21.15.66:3300/0 conn(0x7f2e0c0d0070 msgr2=0x7f2e0c15d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T10:47:21.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.669+0000 7f2e11897640 1 --2- 172.21.15.63:0/2882186666 >> v2:172.21.15.66:3300/0 conn(0x7f2e0c0d0070 0x7f2e0c15d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.669+0000 7f2e11897640 1 -- 172.21.15.63:0/2882186666 >> v1:172.21.15.66:6789/0 conn(0x7f2e0c15d5d0 legacy=0x7f2e0c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.670 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.669+0000 7f2e11897640 1 -- 172.21.15.63:0/2882186666 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0c06c4b0 con 0x7f2e0c0b2170 2023-12-04T10:47:21.671 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.671+0000 7f2e11897640 1 --2- 172.21.15.63:0/2882186666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c0cfb30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009870 tx=0x7f2dfc02ba10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33a1bf98b1cd657d server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:47:21.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.671+0000 7f2e11096640 1 -- 172.21.15.63:0/2882186666 <== mon.2 v2:172.21.15.66:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc02f830 con 0x7f2e0c0b2170 2023-12-04T10:47:21.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.671+0000 7f2e11096640 1 -- 172.21.15.63:0/2882186666 <== mon.2 v2:172.21.15.66:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dfc02f990 con 0x7f2e0c0b2170 2023-12-04T10:47:21.672 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.671+0000 7f2e11096640 1 -- 172.21.15.63:0/2882186666 <== mon.2 v2:172.21.15.66:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc02fd20 con 0x7f2e0c0b2170 2023-12-04T10:47:21.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.672+0000 7f2e142fc640 1 -- 172.21.15.63:0/2882186666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 msgr2=0x7f2e0c0cfb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.672+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2882186666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c0cfb30 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009870 tx=0x7f2dfc02ba10 comp rx=0 tx=0).stop 2023-12-04T10:47:21.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.672+0000 7f2e142fc640 1 -- 172.21.15.63:0/2882186666 shutdown_connections 2023-12-04T10:47:21.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.672+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2882186666 >> v2:172.21.15.66:3300/0 conn(0x7f2e0c0d0070 0x7f2e0c15d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.672+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2882186666 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c0cfb30 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.672+0000 7f2e142fc640 1 -- 172.21.15.63:0/2882186666 >> 172.21.15.63:0/2882186666 conn(0x7f2e0c0d1000 msgr2=0x7f2e0c0d1410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:47:21.673 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.672+0000 7f2e142fc640 1 -- 172.21.15.63:0/2882186666 shutdown_connections 2023-12-04T10:47:21.674 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.673+0000 7f2e142fc640 1 -- 172.21.15.63:0/2882186666 wait complete. 2023-12-04T10:47:21.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.674+0000 7f2e142fc640 1 Processor -- start 2023-12-04T10:47:21.675 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.675+0000 7f2e142fc640 1 -- start start 2023-12-04T10:47:21.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.675+0000 7f2e142fc640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.675+0000 7f2e142fc640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0c0d0070 0x7f2e0c15f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.675+0000 7f2e142fc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0c15d5d0 0x7f2e0c0b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.678 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.675+0000 7f2e142fc640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c162000 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.675+0000 7f2e142fc640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c15a0b0 con 0x7f2e0c0d0070 2023-12-04T10:47:21.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.675+0000 7f2e142fc640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0c0c6040 con 0x7f2e0c0b2170 2023-12-04T10:47:21.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.676+0000 7f2e12899640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0c15d5d0 0x7f2e0c0b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.676+0000 7f2e12899640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0c15d5d0 0x7f2e0c0b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55236/0 (socket says 172.21.15.63:55236) 2023-12-04T10:47:21.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.676+0000 7f2e12899640 1 -- 172.21.15.63:0/2193954792 learned_addr learned my addr 172.21.15.63:0/2193954792 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T10:47:21.679 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.676+0000 7f2e12098640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.676+0000 7f2e11897640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0c0d0070 0x7f2e0c15f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e12899640 1 -- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 msgr2=0x7f2e0c159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e12899640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e12899640 1 -- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0c0d0070 msgr2=0x7f2e0c15f0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e12899640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0c0d0070 0x7f2e0c15f0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e12899640 1 -- 172.21.15.63:0/2193954792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dfc0094d0 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e12098640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e12899640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0c15d5d0 0x7f2e0c0b5d60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400efc0 tx=0x7f2e0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e02ffd640 1 -- 172.21.15.63:0/2193954792 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04014480 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e02ffd640 1 -- 172.21.15.63:0/2193954792 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e0400f040 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0c0c9980 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e02ffd640 1 -- 172.21.15.63:0/2193954792 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e04014820 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.680 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.677+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e0c0c65c0 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.679+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e0c0ccb60 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.681 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.680+0000 7f2e02ffd640 1 -- 172.21.15.63:0/2193954792 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2e04014980 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.681+0000 7f2e02ffd640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T10:47:21.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.681+0000 7f2e02ffd640 1 -- 172.21.15.63:0/2193954792 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e0408a610 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.682 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.681+0000 7f2e12098640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T10:47:21.683 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.682+0000 7f2e12098640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e08007fd0 tx=0x7f2e08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T10:47:21.686 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.685+0000 7f2e02ffd640 1 -- 172.21.15.63:0/2193954792 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2e04055560 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.973 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.972+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f2e0c068710 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.974 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.973+0000 7f2e02ffd640 1 -- 172.21.15.63:0/2193954792 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7f2e04018050 con 0x7f2e0c15d5d0 2023-12-04T10:47:21.974 INFO:teuthology.orchestra.run.smithi063.stdout:[client.admin] 2023-12-04T10:47:21.974 INFO:teuthology.orchestra.run.smithi063.stdout: key = AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== 2023-12-04T10:47:21.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 msgr2=0x7f2df006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2e08007fd0 tx=0x7f2e08009040 comp rx=0 tx=0).stop 2023-12-04T10:47:21.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0c15d5d0 msgr2=0x7f2e0c0b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T10:47:21.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0c15d5d0 0x7f2e0c0b5d60 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f2e0400efc0 tx=0x7f2e0400c490 comp rx=0 tx=0).stop 2023-12-04T10:47:21.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 shutdown_connections 2023-12-04T10:47:21.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f2df006ae40 0x7f2df006d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f2e0c15d5d0 0x7f2e0c0b5d60 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.977 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2e0c0d0070 0x7f2e0c15f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 --2- 172.21.15.63:0/2193954792 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f2e0c0b2170 0x7f2e0c159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T10:47:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 >> 172.21.15.63:0/2193954792 conn(0x7f2e0c0d1000 msgr2=0x7f2e0c06cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T10:47:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 shutdown_connections 2023-12-04T10:47:21.978 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T10:47:21.976+0000 7f2e142fc640 1 -- 172.21.15.63:0/2193954792 wait complete. 2023-12-04T10:47:21.997 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:47:21.997 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/tmp/tmp.Qs710hMD8ixfstests-dev/local.config 2023-12-04T10:47:22.074 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.63:6789:/test export TEST_DIR=/tmp/tmp.kMUSrf2Uhytest export SCRATCH_DEV=172.21.15.63:6789:/scratch export SCRATCH_MNT=/tmp/tmp.dLsp01GiBascratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA==" 2023-12-04T10:47:22.074 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T10:47:22.074 DEBUG:teuthology.orchestra.run.smithi063:> sudo dd of=/tmp/tmp.Qs710hMD8ixfstests-dev/ceph.exclude 2023-12-04T10:47:22.197 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo make) 2023-12-04T10:47:22.345 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize -cfi 2023-12-04T10:47:22.968 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-04T10:47:22.968 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './config.guess' 2023-12-04T10:47:22.981 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './config.sub' 2023-12-04T10:47:22.992 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './install-sh' 2023-12-04T10:47:23.006 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file './ltmain.sh' 2023-12-04T10:47:23.076 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-04T10:47:23.077 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-04T10:47:23.092 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-04T10:47:23.104 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-04T10:47:23.119 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-04T10:47:23.134 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-04T10:47:23.156 INFO:teuthology.orchestra.run.smithi063.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-04T10:47:23.160 INFO:teuthology.orchestra.run.smithi063.stdout:cp include/install-sh . 2023-12-04T10:47:23.163 INFO:teuthology.orchestra.run.smithi063.stdout:aclocal -I m4 2023-12-04T10:47:24.817 INFO:teuthology.orchestra.run.smithi063.stdout:autoheader 2023-12-04T10:47:25.245 INFO:teuthology.orchestra.run.smithi063.stdout:autoconf 2023-12-04T10:47:25.515 INFO:teuthology.orchestra.run.smithi063.stdout:./configure \ 2023-12-04T10:47:25.515 INFO:teuthology.orchestra.run.smithi063.stdout: --libexecdir=/usr/lib \ 2023-12-04T10:47:25.516 INFO:teuthology.orchestra.run.smithi063.stdout: --exec_prefix=/var/lib 2023-12-04T10:47:26.021 INFO:teuthology.orchestra.run.smithi063.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-04T10:47:26.021 INFO:teuthology.orchestra.run.smithi063.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-04T10:47:26.027 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to print strings... printf 2023-12-04T10:47:26.027 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc... gcc 2023-12-04T10:47:26.203 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether the C compiler works... yes 2023-12-04T10:47:26.203 INFO:teuthology.orchestra.run.smithi063.stdout:checking for C compiler default output file name... a.out 2023-12-04T10:47:26.279 INFO:teuthology.orchestra.run.smithi063.stdout:checking for suffix of executables... 2023-12-04T10:47:26.390 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are cross compiling... no 2023-12-04T10:47:26.445 INFO:teuthology.orchestra.run.smithi063.stdout:checking for suffix of object files... o 2023-12-04T10:47:26.493 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are using the GNU C compiler... yes 2023-12-04T10:47:26.547 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc accepts -g... yes 2023-12-04T10:47:26.615 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-04T10:47:26.628 INFO:teuthology.orchestra.run.smithi063.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-04T10:47:26.638 INFO:teuthology.orchestra.run.smithi063.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-04T10:47:26.644 INFO:teuthology.orchestra.run.smithi063.stdout:checking for egrep... /bin/grep -E 2023-12-04T10:47:26.651 INFO:teuthology.orchestra.run.smithi063.stdout:checking for fgrep... /bin/grep -F 2023-12-04T10:47:26.666 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ld used by gcc... /bin/ld 2023-12-04T10:47:26.673 INFO:teuthology.orchestra.run.smithi063.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-04T10:47:26.689 INFO:teuthology.orchestra.run.smithi063.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-04T10:47:27.682 INFO:teuthology.orchestra.run.smithi063.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-04T10:47:27.682 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether ln -s works... yes 2023-12-04T10:47:27.700 INFO:teuthology.orchestra.run.smithi063.stdout:checking the maximum length of command line arguments... 1572864 2023-12-04T10:47:27.710 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-04T10:47:27.711 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-04T10:47:27.711 INFO:teuthology.orchestra.run.smithi063.stdout:checking for /bin/ld option to reload object files... -r 2023-12-04T10:47:27.712 INFO:teuthology.orchestra.run.smithi063.stdout:checking for objdump... objdump 2023-12-04T10:47:27.713 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to recognize dependent libraries... pass_all 2023-12-04T10:47:27.715 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dlltool... no 2023-12-04T10:47:27.715 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-04T10:47:27.716 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ar... ar 2023-12-04T10:47:27.836 INFO:teuthology.orchestra.run.smithi063.stdout:checking for archiver @FILE support... @ 2023-12-04T10:47:27.837 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strip... strip 2023-12-04T10:47:27.837 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ranlib... ranlib 2023-12-04T10:47:27.838 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gawk... gawk 2023-12-04T10:47:28.031 INFO:teuthology.orchestra.run.smithi063.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-04T10:47:28.036 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sysroot... no 2023-12-04T10:47:28.047 INFO:teuthology.orchestra.run.smithi063.stdout:checking for a working dd... /bin/dd 2023-12-04T10:47:28.061 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-04T10:47:28.110 INFO:teuthology.orchestra.run.smithi063.stdout:checking for mt... no 2023-12-04T10:47:28.118 INFO:teuthology.orchestra.run.smithi063.stdout:checking if : is a manifest tool... no 2023-12-04T10:47:28.240 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to run the C preprocessor... gcc -E 2023-12-04T10:47:28.640 INFO:teuthology.orchestra.run.smithi063.stdout:checking for ANSI C header files... yes 2023-12-04T10:47:28.705 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/types.h... yes 2023-12-04T10:47:28.805 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/stat.h... yes 2023-12-04T10:47:28.878 INFO:teuthology.orchestra.run.smithi063.stdout:checking for stdlib.h... yes 2023-12-04T10:47:28.956 INFO:teuthology.orchestra.run.smithi063.stdout:checking for string.h... yes 2023-12-04T10:47:29.039 INFO:teuthology.orchestra.run.smithi063.stdout:checking for memory.h... yes 2023-12-04T10:47:29.116 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strings.h... yes 2023-12-04T10:47:29.206 INFO:teuthology.orchestra.run.smithi063.stdout:checking for inttypes.h... yes 2023-12-04T10:47:29.283 INFO:teuthology.orchestra.run.smithi063.stdout:checking for stdint.h... yes 2023-12-04T10:47:29.380 INFO:teuthology.orchestra.run.smithi063.stdout:checking for unistd.h... yes 2023-12-04T10:47:29.456 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dlfcn.h... yes 2023-12-04T10:47:29.468 INFO:teuthology.orchestra.run.smithi063.stdout:checking for objdir... .libs 2023-12-04T10:47:29.646 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-04T10:47:29.646 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-04T10:47:29.703 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-04T10:47:29.758 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc static flag -static works... no 2023-12-04T10:47:29.840 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -c -o file.o... yes 2023-12-04T10:47:29.840 INFO:teuthology.orchestra.run.smithi063.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-04T10:47:29.865 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-04T10:47:29.941 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether -lc should be explicitly linked in... no 2023-12-04T10:47:30.106 INFO:teuthology.orchestra.run.smithi063.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-04T10:47:30.106 INFO:teuthology.orchestra.run.smithi063.stdout:checking how to hardcode library paths into programs... immediate 2023-12-04T10:47:30.111 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether stripping libraries is possible... yes 2023-12-04T10:47:30.111 INFO:teuthology.orchestra.run.smithi063.stdout:checking if libtool supports shared libraries... yes 2023-12-04T10:47:30.112 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether to build shared libraries... yes 2023-12-04T10:47:30.112 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether to build static libraries... yes 2023-12-04T10:47:30.137 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc... (cached) gcc 2023-12-04T10:47:30.199 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-04T10:47:30.199 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-04T10:47:30.200 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-04T10:47:30.200 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gmake... /usr/bin/gmake 2023-12-04T10:47:30.200 INFO:teuthology.orchestra.run.smithi063.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2023-12-04T10:47:30.201 INFO:teuthology.orchestra.run.smithi063.stdout:checking for tar... /bin/tar 2023-12-04T10:47:30.201 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gzip... /bin/gzip 2023-12-04T10:47:30.231 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether gcc -MM is supported... yes 2023-12-04T10:47:30.232 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sort... /bin/sort 2023-12-04T10:47:30.232 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether ln -s works... yes 2023-12-04T10:47:30.232 INFO:teuthology.orchestra.run.smithi063.stdout:checking for rpm... /bin/rpm 2023-12-04T10:47:30.244 INFO:teuthology.orchestra.run.smithi063.stdout:checking for rpmbuild... no 2023-12-04T10:47:30.324 INFO:teuthology.orchestra.run.smithi063.stdout:checking assert.h usability... yes 2023-12-04T10:47:30.350 INFO:teuthology.orchestra.run.smithi063.stdout:checking assert.h presence... yes 2023-12-04T10:47:30.350 INFO:teuthology.orchestra.run.smithi063.stdout:checking for assert.h... yes 2023-12-04T10:47:30.435 INFO:teuthology.orchestra.run.smithi063.stdout:checking bstring.h usability... no 2023-12-04T10:47:30.477 INFO:teuthology.orchestra.run.smithi063.stdout:checking bstring.h presence... no 2023-12-04T10:47:30.478 INFO:teuthology.orchestra.run.smithi063.stdout:checking for bstring.h... no 2023-12-04T10:47:30.550 INFO:teuthology.orchestra.run.smithi063.stdout:checking libgen.h usability... yes 2023-12-04T10:47:30.578 INFO:teuthology.orchestra.run.smithi063.stdout:checking libgen.h presence... yes 2023-12-04T10:47:30.578 INFO:teuthology.orchestra.run.smithi063.stdout:checking for libgen.h... yes 2023-12-04T10:47:30.672 INFO:teuthology.orchestra.run.smithi063.stdout:checking dirent.h usability... yes 2023-12-04T10:47:30.702 INFO:teuthology.orchestra.run.smithi063.stdout:checking dirent.h presence... yes 2023-12-04T10:47:30.702 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dirent.h... yes 2023-12-04T10:47:30.814 INFO:teuthology.orchestra.run.smithi063.stdout:checking errno.h usability... yes 2023-12-04T10:47:30.842 INFO:teuthology.orchestra.run.smithi063.stdout:checking errno.h presence... yes 2023-12-04T10:47:30.842 INFO:teuthology.orchestra.run.smithi063.stdout:checking for errno.h... yes 2023-12-04T10:47:30.933 INFO:teuthology.orchestra.run.smithi063.stdout:checking malloc.h usability... yes 2023-12-04T10:47:30.961 INFO:teuthology.orchestra.run.smithi063.stdout:checking malloc.h presence... yes 2023-12-04T10:47:30.962 INFO:teuthology.orchestra.run.smithi063.stdout:checking for malloc.h... yes 2023-12-04T10:47:31.046 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid.h usability... no 2023-12-04T10:47:31.090 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid.h presence... no 2023-12-04T10:47:31.090 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid.h... no 2023-12-04T10:47:31.178 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid/uuid.h usability... yes 2023-12-04T10:47:31.211 INFO:teuthology.orchestra.run.smithi063.stdout:checking uuid/uuid.h presence... yes 2023-12-04T10:47:31.211 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid/uuid.h... yes 2023-12-04T10:47:31.296 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/uuid.h usability... no 2023-12-04T10:47:31.338 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/uuid.h presence... no 2023-12-04T10:47:31.338 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/uuid.h... no 2023-12-04T10:47:31.420 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/file.h usability... yes 2023-12-04T10:47:31.450 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/file.h presence... yes 2023-12-04T10:47:31.450 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/file.h... yes 2023-12-04T10:47:31.540 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fcntl.h usability... yes 2023-12-04T10:47:31.573 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fcntl.h presence... yes 2023-12-04T10:47:31.573 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fcntl.h... yes 2023-12-04T10:47:31.661 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/syssgi.h usability... no 2023-12-04T10:47:31.701 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/syssgi.h presence... no 2023-12-04T10:47:31.701 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/syssgi.h... no 2023-12-04T10:47:31.790 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/param.h usability... yes 2023-12-04T10:47:31.825 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/param.h presence... yes 2023-12-04T10:47:31.825 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/param.h... yes 2023-12-04T10:47:31.845 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/stat.h... (cached) yes 2023-12-04T10:47:31.945 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/statvfs.h usability... yes 2023-12-04T10:47:31.974 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/statvfs.h presence... yes 2023-12-04T10:47:31.974 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/statvfs.h... yes 2023-12-04T10:47:32.053 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/time.h usability... yes 2023-12-04T10:47:32.078 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/time.h presence... yes 2023-12-04T10:47:32.079 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/time.h... yes 2023-12-04T10:47:32.163 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/ioctl.h usability... yes 2023-12-04T10:47:32.195 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/ioctl.h presence... yes 2023-12-04T10:47:32.195 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/ioctl.h... yes 2023-12-04T10:47:32.278 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/wait.h usability... yes 2023-12-04T10:47:32.306 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/wait.h presence... yes 2023-12-04T10:47:32.307 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/wait.h... yes 2023-12-04T10:47:32.323 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/types.h... (cached) yes 2023-12-04T10:47:32.340 INFO:teuthology.orchestra.run.smithi063.stdout:checking for strings.h... (cached) yes 2023-12-04T10:47:32.409 INFO:teuthology.orchestra.run.smithi063.stdout:checking err.h usability... yes 2023-12-04T10:47:32.437 INFO:teuthology.orchestra.run.smithi063.stdout:checking err.h presence... yes 2023-12-04T10:47:32.437 INFO:teuthology.orchestra.run.smithi063.stdout:checking for err.h... yes 2023-12-04T10:47:32.526 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/falloc.h usability... yes 2023-12-04T10:47:32.548 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/falloc.h presence... yes 2023-12-04T10:47:32.548 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/falloc.h... yes 2023-12-04T10:47:32.637 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-04T10:47:32.683 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-04T10:47:32.683 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-04T10:47:32.764 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-04T10:47:32.807 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-04T10:47:32.807 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-04T10:47:32.887 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/platform_defs.h usability... no 2023-12-04T10:47:32.932 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/platform_defs.h presence... no 2023-12-04T10:47:32.932 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/platform_defs.h... no 2023-12-04T10:47:33.015 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfs/ioctl.h usability... no 2023-12-04T10:47:33.062 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfs/ioctl.h presence... no 2023-12-04T10:47:33.062 INFO:teuthology.orchestra.run.smithi063.stdout:checking for btrfs/ioctl.h... no 2023-12-04T10:47:33.143 INFO:teuthology.orchestra.run.smithi063.stdout:checking cifs/ioctl.h usability... no 2023-12-04T10:47:33.191 INFO:teuthology.orchestra.run.smithi063.stdout:checking cifs/ioctl.h presence... no 2023-12-04T10:47:33.191 INFO:teuthology.orchestra.run.smithi063.stdout:checking for cifs/ioctl.h... no 2023-12-04T10:47:33.270 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/mman.h usability... yes 2023-12-04T10:47:33.302 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/mman.h presence... yes 2023-12-04T10:47:33.302 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/mman.h... yes 2023-12-04T10:47:33.362 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xfs_log_format.h... no 2023-12-04T10:47:33.464 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid_compare... no 2023-12-04T10:47:33.548 INFO:teuthology.orchestra.run.smithi063.stdout:checking for uuid_compare in -luuid... yes 2023-12-04T10:47:33.687 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xfs.h... yes 2023-12-04T10:47:33.740 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/libxfs.h... no 2023-12-04T10:47:33.804 INFO:teuthology.orchestra.run.smithi063.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-04T10:47:33.885 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/xqm.h... yes 2023-12-04T10:47:34.003 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-04T10:47:34.069 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/handle.h usability... yes 2023-12-04T10:47:34.094 INFO:teuthology.orchestra.run.smithi063.stdout:checking xfs/handle.h presence... yes 2023-12-04T10:47:34.094 INFO:teuthology.orchestra.run.smithi063.stdout:checking for xfs/handle.h... yes 2023-12-04T10:47:34.192 INFO:teuthology.orchestra.run.smithi063.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-04T10:47:34.257 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/acl.h usability... yes 2023-12-04T10:47:34.290 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/acl.h presence... yes 2023-12-04T10:47:34.290 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/acl.h... yes 2023-12-04T10:47:34.358 INFO:teuthology.orchestra.run.smithi063.stdout:checking acl/libacl.h usability... yes 2023-12-04T10:47:34.391 INFO:teuthology.orchestra.run.smithi063.stdout:checking acl/libacl.h presence... yes 2023-12-04T10:47:34.391 INFO:teuthology.orchestra.run.smithi063.stdout:checking for acl/libacl.h... yes 2023-12-04T10:47:34.480 INFO:teuthology.orchestra.run.smithi063.stdout:checking for acl_init in -lacl... yes 2023-12-04T10:47:34.549 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm-ndbm.h usability... no 2023-12-04T10:47:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm-ndbm.h presence... no 2023-12-04T10:47:34.593 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gdbm-ndbm.h... no 2023-12-04T10:47:34.658 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm/ndbm.h usability... yes 2023-12-04T10:47:34.691 INFO:teuthology.orchestra.run.smithi063.stdout:checking gdbm/ndbm.h presence... yes 2023-12-04T10:47:34.691 INFO:teuthology.orchestra.run.smithi063.stdout:checking for gdbm/ndbm.h... yes 2023-12-04T10:47:34.794 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_open in -lgdbm... no 2023-12-04T10:47:34.895 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_fetch in -lgdbm... no 2023-12-04T10:47:34.995 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_store in -lgdbm... no 2023-12-04T10:47:35.099 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_close in -lgdbm... no 2023-12-04T10:47:35.203 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-12-04T10:47:35.290 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-12-04T10:47:35.381 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-12-04T10:47:35.473 INFO:teuthology.orchestra.run.smithi063.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-12-04T10:47:35.543 INFO:teuthology.orchestra.run.smithi063.stdout:checking libaio.h usability... yes 2023-12-04T10:47:35.577 INFO:teuthology.orchestra.run.smithi063.stdout:checking libaio.h presence... yes 2023-12-04T10:47:35.577 INFO:teuthology.orchestra.run.smithi063.stdout:checking for libaio.h... yes 2023-12-04T10:47:35.655 INFO:teuthology.orchestra.run.smithi063.stdout:checking liburing.h usability... no 2023-12-04T10:47:35.694 INFO:teuthology.orchestra.run.smithi063.stdout:checking liburing.h presence... no 2023-12-04T10:47:35.695 INFO:teuthology.orchestra.run.smithi063.stdout:checking for liburing.h... no 2023-12-04T10:47:35.767 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/capability.h usability... yes 2023-12-04T10:47:35.797 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/capability.h presence... yes 2023-12-04T10:47:35.797 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/capability.h... yes 2023-12-04T10:47:35.863 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fiemap.h usability... yes 2023-12-04T10:47:35.892 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fiemap.h presence... yes 2023-12-04T10:47:35.892 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/fiemap.h... yes 2023-12-04T10:47:35.982 INFO:teuthology.orchestra.run.smithi063.stdout:checking for fallocate... yes 2023-12-04T10:47:36.072 INFO:teuthology.orchestra.run.smithi063.stdout:checking for open_by_handle_at... yes 2023-12-04T10:47:36.141 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/prctl.h usability... yes 2023-12-04T10:47:36.168 INFO:teuthology.orchestra.run.smithi063.stdout:checking sys/prctl.h presence... yes 2023-12-04T10:47:36.169 INFO:teuthology.orchestra.run.smithi063.stdout:checking for sys/prctl.h... yes 2023-12-04T10:47:36.237 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fs.h usability... yes 2023-12-04T10:47:36.267 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/fs.h presence... yes 2023-12-04T10:47:36.267 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/fs.h... yes 2023-12-04T10:47:36.337 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfsutil.h usability... no 2023-12-04T10:47:36.381 INFO:teuthology.orchestra.run.smithi063.stdout:checking btrfsutil.h presence... no 2023-12-04T10:47:36.381 INFO:teuthology.orchestra.run.smithi063.stdout:checking for btrfsutil.h... no 2023-12-04T10:47:36.477 INFO:teuthology.orchestra.run.smithi063.stdout:checking for copy_file_range... yes 2023-12-04T10:47:36.573 INFO:teuthology.orchestra.run.smithi063.stdout:checking for SEEK_DATA... yes 2023-12-04T10:47:36.681 INFO:teuthology.orchestra.run.smithi063.stdout:checking for BMV_OF_SHARED... yes 2023-12-04T10:47:36.771 INFO:teuthology.orchestra.run.smithi063.stdout:checking for nftw... yes 2023-12-04T10:47:36.866 INFO:teuthology.orchestra.run.smithi063.stdout:checking for RLIMIT_NOFILE... yes 2023-12-04T10:47:36.929 INFO:teuthology.orchestra.run.smithi063.stdout:checking for FIEXCHANGE_RANGE... no 2023-12-04T10:47:37.027 INFO:teuthology.orchestra.run.smithi063.stdout:checking for renameat2... yes 2023-12-04T10:47:37.118 INFO:teuthology.orchestra.run.smithi063.stdout:checking for reallocarray... yes 2023-12-04T10:47:37.224 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct mount_attr... yes 2023-12-04T10:47:37.336 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-04T10:47:37.449 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-04T10:47:37.567 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-04T10:47:37.682 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-04T10:47:37.790 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-04T10:47:37.898 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-04T10:47:38.012 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-04T10:47:38.094 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs.h usability... yes 2023-12-04T10:47:38.121 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs.h presence... yes 2023-12-04T10:47:38.121 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/btrfs.h... yes 2023-12-04T10:47:38.229 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-04T10:47:38.255 INFO:teuthology.orchestra.run.smithi063.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-04T10:47:38.255 INFO:teuthology.orchestra.run.smithi063.stdout:checking for linux/btrfs_tree.h... yes 2023-12-04T10:47:38.325 INFO:teuthology.orchestra.run.smithi063.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-04T10:47:38.367 INFO:teuthology.orchestra.run.smithi063.stdout:configure: creating ./config.status 2023-12-04T10:47:39.805 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: creating include/builddefs 2023-12-04T10:47:39.855 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: creating include/config.h 2023-12-04T10:47:39.888 INFO:teuthology.orchestra.run.smithi063.stdout:config.status: executing libtool commands 2023-12-04T10:47:40.007 INFO:teuthology.orchestra.run.smithi063.stdout:Building include 2023-12-04T10:47:40.018 INFO:teuthology.orchestra.run.smithi063.stdout:Building lib 2023-12-04T10:47:40.028 INFO:teuthology.orchestra.run.smithi063.stdout: [LTDEP] 2023-12-04T10:47:40.372 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dataascii.lo 2023-12-04T10:47:40.672 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] databin.lo 2023-12-04T10:47:40.989 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] datapid.lo 2023-12-04T10:47:41.272 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] file_lock.lo 2023-12-04T10:47:41.601 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] forker.lo 2023-12-04T10:47:41.901 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] pattern.lo 2023-12-04T10:47:42.181 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] open_flags.lo 2023-12-04T10:47:42.480 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] random_range.lo 2023-12-04T10:47:42.875 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] string_to_tokens.lo 2023-12-04T10:47:43.122 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] str_to_bytes.lo 2023-12-04T10:47:43.428 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] tlibio.lo 2023-12-04T10:47:43.851 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] write_log.lo 2023-12-04T10:47:44.284 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] random.lo 2023-12-04T10:47:44.548 INFO:teuthology.orchestra.run.smithi063.stdout: [LD] 2023-12-04T10:47:44.807 INFO:teuthology.orchestra.run.smithi063.stdout:Building ltp 2023-12-04T10:47:44.818 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2023-12-04T10:47:45.114 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] doio 2023-12-04T10:47:45.773 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:47:45.784 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:47:46.095 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsstress 2023-12-04T10:47:47.822 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsx 2023-12-04T10:47:48.795 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] growfiles 2023-12-04T10:47:49.514 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] iogen 2023-12-04T10:47:50.142 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-stress 2023-12-04T10:47:50.805 INFO:teuthology.orchestra.run.smithi063.stdout:Building src 2023-12-04T10:47:50.819 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2023-12-04T10:47:54.880 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2023-12-04T10:47:54.957 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2023-12-04T10:47:54.977 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2023-12-04T10:47:55.510 INFO:teuthology.orchestra.run.smithi063.stdout: [DEP] 2023-12-04T10:47:55.565 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirstress 2023-12-04T10:47:56.028 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fill 2023-12-04T10:47:56.431 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fill2 2023-12-04T10:47:56.920 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] getpagesize 2023-12-04T10:47:57.252 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] holes 2023-12-04T10:47:57.638 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] lstat64 2023-12-04T10:47:58.016 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] nametest 2023-12-04T10:47:58.472 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] permname 2023-12-04T10:47:58.892 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] randholes 2023-12-04T10:47:59.370 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] runas 2023-12-04T10:47:59.783 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] truncfile 2023-12-04T10:48:00.223 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] usemem 2023-12-04T10:48:00.587 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmapcat 2023-12-04T10:48:00.987 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] append_reader 2023-12-04T10:48:01.351 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] append_writer 2023-12-04T10:48:01.704 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirperf 2023-12-04T10:48:02.152 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] metaperf 2023-12-04T10:48:02.668 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] devzero 2023-12-04T10:48:03.059 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] feature 2023-12-04T10:48:03.524 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] alloc 2023-12-04T10:48:03.966 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fault 2023-12-04T10:48:04.345 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fstest 2023-12-04T10:48:04.820 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_access_root 2023-12-04T10:48:05.208 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] godown 2023-12-04T10:48:05.618 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] resvtest 2023-12-04T10:48:06.027 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] writemod 2023-12-04T10:48:06.396 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] writev_on_pagefault 2023-12-04T10:48:06.772 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] makeextents 2023-12-04T10:48:07.182 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] itrash 2023-12-04T10:48:07.548 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] rename 2023-12-04T10:48:07.882 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] multi_open_unlink 2023-12-04T10:48:08.262 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] unwritten_sync 2023-12-04T10:48:08.684 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] genhashnames 2023-12-04T10:48:09.091 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_holes 2023-12-04T10:48:09.445 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_writev 2023-12-04T10:48:09.792 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_truncate_cmtime 2023-12-04T10:48:10.160 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dirhash_collide 2023-12-04T10:48:10.558 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_rename_overwrite 2023-12-04T10:48:10.921 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] holetest 2023-12-04T10:48:11.341 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_truncate_self 2023-12-04T10:48:11.656 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] af_unix 2023-12-04T10:48:12.017 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_stale_pmd 2023-12-04T10:48:12.411 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_cow_race 2023-12-04T10:48:12.795 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_fallocate 2023-12-04T10:48:13.139 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsync-err 2023-12-04T10:48:13.512 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_write_ro 2023-12-04T10:48:13.849 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-04T10:48:14.224 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-04T10:48:14.597 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_ofd_locks 2023-12-04T10:48:15.015 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_collision 2023-12-04T10:48:15.417 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmap-write-concurrent 2023-12-04T10:48:15.792 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_get_file_time 2023-12-04T10:48:15.947 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:48:15.954 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:48:16.120 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_create_short_dirs 2023-12-04T10:48:16.508 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_create_long_dirs 2023-12-04T10:48:16.915 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_enospc 2023-12-04T10:48:17.307 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_writev_overlap 2023-12-04T10:48:17.676 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] checkpoint_journal 2023-12-04T10:48:18.066 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mmap-rw-fault 2023-12-04T10:48:18.456 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] allocstale 2023-12-04T10:48:18.871 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_cow_memory_failure 2023-12-04T10:48:19.225 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fake-dump-rootino 2023-12-04T10:48:19.612 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-buf-fault 2023-12-04T10:48:19.982 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] rewinddir-test 2023-12-04T10:48:20.372 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] xfsctl 2023-12-04T10:48:20.814 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bstat 2023-12-04T10:48:21.269 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mtab 2023-12-04T10:48:21.689 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] getdevicesize 2023-12-04T10:48:22.047 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] preallo_rw_pattern_reader 2023-12-04T10:48:22.393 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] preallo_rw_pattern_writer 2023-12-04T10:48:22.775 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] ftrunc 2023-12-04T10:48:23.127 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] trunc 2023-12-04T10:48:23.502 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fs_perms 2023-12-04T10:48:23.915 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] testx 2023-12-04T10:48:24.257 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] looptest 2023-12-04T10:48:24.679 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] locktest 2023-12-04T10:48:25.227 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] unwritten_mmap 2023-12-04T10:48:25.605 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_unlink_test 2023-12-04T10:48:26.009 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] deduperace 2023-12-04T10:48:26.414 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_unlink_test_modified 2023-12-04T10:48:26.869 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_offset 2023-12-04T10:48:27.223 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_futimens 2023-12-04T10:48:27.562 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_immutable 2023-12-04T10:48:28.498 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] stale_handle 2023-12-04T10:48:28.863 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] pwrite_mmap_blocked 2023-12-04T10:48:29.227 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_offset2 2023-12-04T10:48:29.635 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] seek_sanity_test 2023-12-04T10:48:30.335 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] seek_copy_test 2023-12-04T10:48:30.692 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_1 2023-12-04T10:48:31.080 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_2 2023-12-04T10:48:31.472 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fsync-tester 2023-12-04T10:48:31.949 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] nsexec 2023-12-04T10:48:32.373 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] cloner 2023-12-04T10:48:32.780 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] renameat2 2023-12-04T10:48:33.191 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_getcwd 2023-12-04T10:48:33.562 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] e4compact 2023-12-04T10:48:34.028 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] test-nextquota 2023-12-04T10:48:34.415 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] punch-alternating 2023-12-04T10:48:34.779 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-04T10:48:35.159 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] listxattr 2023-12-04T10:48:35.526 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-interleaved 2023-12-04T10:48:35.926 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_dir_type 2023-12-04T10:48:36.301 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dio-invalidate-cache 2023-12-04T10:48:36.724 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] stat_test 2023-12-04T10:48:37.262 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_encrypted_d_revalidate 2023-12-04T10:48:37.637 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] attr_replace_test 2023-12-04T10:48:38.032 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] swapon 2023-12-04T10:48:38.401 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mkswap 2023-12-04T10:48:38.787 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_attr_corruption 2023-12-04T10:48:39.147 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_open_tmpfiles 2023-12-04T10:48:39.591 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fscrypt-crypt-util 2023-12-04T10:48:40.512 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] bulkstat_null_ocount 2023-12-04T10:48:40.868 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] splice-test 2023-12-04T10:48:41.254 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] chprojid_fail 2023-12-04T10:48:41.607 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] detached_mounts_propagation 2023-12-04T10:48:42.043 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] ext4_resize 2023-12-04T10:48:42.405 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_readdir_3 2023-12-04T10:48:42.828 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] splice2pipe 2023-12-04T10:48:43.208 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] uuid_ioctl 2023-12-04T10:48:43.605 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fiemap-tester 2023-12-04T10:48:44.091 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_stripealign 2023-12-04T10:48:44.426 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] open_by_handle 2023-12-04T10:48:44.878 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] dbtest 2023-12-04T10:48:45.355 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] t_mmap_dio 2023-12-04T10:48:45.728 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] xfsfind 2023-12-04T10:48:46.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:48:46.118 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:48:46.141 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] fssum 2023-12-04T10:48:46.832 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2023-12-04T10:48:46.848 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] replay-log 2023-12-04T10:48:47.381 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2023-12-04T10:48:47.392 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2023-12-04T10:48:47.408 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aiocp 2023-12-04T10:48:47.888 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-04T10:48:48.269 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-append-write-read-race 2023-12-04T10:48:48.692 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-cow-race 2023-12-04T10:48:49.058 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-cycle-write 2023-12-04T10:48:49.452 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-eof-race 2023-12-04T10:48:49.852 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-extend-stat 2023-12-04T10:48:50.249 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-fcntl-race 2023-12-04T10:48:50.648 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-hole-filling-race 2023-12-04T10:48:51.005 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-invalidate-failure 2023-12-04T10:48:51.358 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-invalidate-readahead 2023-12-04T10:48:51.734 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aiodio_sparse2 2023-12-04T10:48:52.168 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-subblock-eof-read 2023-12-04T10:48:52.515 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-dio-write-verify 2023-12-04T10:48:52.913 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-04T10:48:53.229 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-04T10:48:53.561 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] aio-last-ref-held-by-io 2023-12-04T10:48:53.955 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2023-12-04T10:48:53.972 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] vfstest 2023-12-04T10:48:58.099 INFO:teuthology.orchestra.run.smithi063.stdout: [CC] mount-idmapped 2023-12-04T10:48:58.732 INFO:teuthology.orchestra.run.smithi063.stdout:Building m4 2023-12-04T10:48:58.743 INFO:teuthology.orchestra.run.smithi063.stdout:Building common 2023-12-04T10:48:58.755 INFO:teuthology.orchestra.run.smithi063.stdout:Building tests 2023-12-04T10:48:58.770 INFO:teuthology.orchestra.run.smithi063.stdout:Building btrfs 2023-12-04T10:48:58.786 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/btrfs/group.list 2023-12-04T10:48:59.035 INFO:teuthology.orchestra.run.smithi063.stdout:Building ceph 2023-12-04T10:48:59.051 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ceph/group.list 2023-12-04T10:48:59.110 INFO:teuthology.orchestra.run.smithi063.stdout:Building cifs 2023-12-04T10:48:59.126 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/cifs/group.list 2023-12-04T10:48:59.173 INFO:teuthology.orchestra.run.smithi063.stdout:Building ext4 2023-12-04T10:48:59.187 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ext4/group.list 2023-12-04T10:48:59.343 INFO:teuthology.orchestra.run.smithi063.stdout:Building f2fs 2023-12-04T10:48:59.358 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/f2fs/group.list 2023-12-04T10:48:59.429 INFO:teuthology.orchestra.run.smithi063.stdout:Building generic 2023-12-04T10:48:59.448 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/generic/group.list 2023-12-04T10:48:59.869 INFO:teuthology.orchestra.run.smithi063.stdout:Building nfs 2023-12-04T10:48:59.885 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/nfs/group.list 2023-12-04T10:48:59.944 INFO:teuthology.orchestra.run.smithi063.stdout:Building ocfs2 2023-12-04T10:48:59.959 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ocfs2/group.list 2023-12-04T10:49:00.011 INFO:teuthology.orchestra.run.smithi063.stdout:Building overlay 2023-12-04T10:49:00.025 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/overlay/group.list 2023-12-04T10:49:00.200 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2023-12-04T10:49:00.215 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/perf/group.list 2023-12-04T10:49:00.258 INFO:teuthology.orchestra.run.smithi063.stdout:Building selftest 2023-12-04T10:49:00.272 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/selftest/group.list 2023-12-04T10:49:00.321 INFO:teuthology.orchestra.run.smithi063.stdout:Building shared 2023-12-04T10:49:00.336 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/shared/group.list 2023-12-04T10:49:00.407 INFO:teuthology.orchestra.run.smithi063.stdout:Building tmpfs 2023-12-04T10:49:00.423 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/tmpfs/group.list 2023-12-04T10:49:00.477 INFO:teuthology.orchestra.run.smithi063.stdout:Building udf 2023-12-04T10:49:00.492 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/udf/group.list 2023-12-04T10:49:00.539 INFO:teuthology.orchestra.run.smithi063.stdout:Building xfs 2023-12-04T10:49:00.558 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/xfs/group.list 2023-12-04T10:49:00.971 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo make install) 2023-12-04T10:49:01.105 INFO:teuthology.orchestra.run.smithi063.stdout:Building include 2023-12-04T10:49:01.115 INFO:teuthology.orchestra.run.smithi063.stdout:Building lib 2023-12-04T10:49:01.126 INFO:teuthology.orchestra.run.smithi063.stdout:Building ltp 2023-12-04T10:49:01.138 INFO:teuthology.orchestra.run.smithi063.stdout:Building src 2023-12-04T10:49:01.231 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2023-12-04T10:49:01.242 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2023-12-04T10:49:01.253 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2023-12-04T10:49:01.266 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2023-12-04T10:49:01.278 INFO:teuthology.orchestra.run.smithi063.stdout:Building m4 2023-12-04T10:49:01.289 INFO:teuthology.orchestra.run.smithi063.stdout:Building common 2023-12-04T10:49:01.301 INFO:teuthology.orchestra.run.smithi063.stdout:Building tests 2023-12-04T10:49:01.316 INFO:teuthology.orchestra.run.smithi063.stdout:Building btrfs 2023-12-04T10:49:01.333 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/btrfs/group.list 2023-12-04T10:49:01.572 INFO:teuthology.orchestra.run.smithi063.stdout:Building ceph 2023-12-04T10:49:01.588 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ceph/group.list 2023-12-04T10:49:01.649 INFO:teuthology.orchestra.run.smithi063.stdout:Building cifs 2023-12-04T10:49:01.664 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/cifs/group.list 2023-12-04T10:49:01.714 INFO:teuthology.orchestra.run.smithi063.stdout:Building ext4 2023-12-04T10:49:01.728 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ext4/group.list 2023-12-04T10:49:01.871 INFO:teuthology.orchestra.run.smithi063.stdout:Building f2fs 2023-12-04T10:49:01.886 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/f2fs/group.list 2023-12-04T10:49:01.958 INFO:teuthology.orchestra.run.smithi063.stdout:Building generic 2023-12-04T10:49:01.977 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/generic/group.list 2023-12-04T10:49:02.357 INFO:teuthology.orchestra.run.smithi063.stdout:Building nfs 2023-12-04T10:49:02.372 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/nfs/group.list 2023-12-04T10:49:02.430 INFO:teuthology.orchestra.run.smithi063.stdout:Building ocfs2 2023-12-04T10:49:02.444 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ocfs2/group.list 2023-12-04T10:49:02.498 INFO:teuthology.orchestra.run.smithi063.stdout:Building overlay 2023-12-04T10:49:02.513 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/overlay/group.list 2023-12-04T10:49:02.681 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2023-12-04T10:49:02.696 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/perf/group.list 2023-12-04T10:49:02.742 INFO:teuthology.orchestra.run.smithi063.stdout:Building selftest 2023-12-04T10:49:02.757 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/selftest/group.list 2023-12-04T10:49:02.810 INFO:teuthology.orchestra.run.smithi063.stdout:Building shared 2023-12-04T10:49:02.825 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/shared/group.list 2023-12-04T10:49:02.894 INFO:teuthology.orchestra.run.smithi063.stdout:Building tmpfs 2023-12-04T10:49:02.910 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/tmpfs/group.list 2023-12-04T10:49:02.962 INFO:teuthology.orchestra.run.smithi063.stdout:Building udf 2023-12-04T10:49:02.975 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/udf/group.list 2023-12-04T10:49:03.017 INFO:teuthology.orchestra.run.smithi063.stdout:Building xfs 2023-12-04T10:49:03.034 INFO:teuthology.orchestra.run.smithi063.stdout: [GROUP] /tmp/tmp.Qs710hMD8ixfstests-dev/tests/xfs/group.list 2023-12-04T10:49:03.434 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-04T10:49:03.438 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-04T10:49:03.439 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-04T10:49:03.444 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-04T10:49:03.444 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-04T10:49:03.450 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-04T10:49:03.487 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-04T10:49:03.753 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-04T10:49:03.791 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-04T10:49:03.839 INFO:teuthology.orchestra.run.smithi063.stdout:Building log-writes 2023-12-04T10:49:03.851 INFO:teuthology.orchestra.run.smithi063.stdout:Building perf 2023-12-04T10:49:03.863 INFO:teuthology.orchestra.run.smithi063.stdout:Building aio-dio-regress 2023-12-04T10:49:03.875 INFO:teuthology.orchestra.run.smithi063.stdout:Building vfs 2023-12-04T10:49:03.884 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C log-writes install 2023-12-04T10:49:03.888 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-04T10:49:03.923 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-04T10:49:03.956 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C perf install 2023-12-04T10:49:03.961 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-04T10:49:03.996 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-04T10:49:04.083 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-04T10:49:04.088 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-04T10:49:04.121 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-04T10:49:04.332 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake -C vfs install 2023-12-04T10:49:04.336 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-04T10:49:04.372 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-04T10:49:04.424 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-04T10:49:04.460 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-12-04T10:49:09.219 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-04T10:49:09.593 INFO:teuthology.orchestra.run.smithi063.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-04T10:49:09.667 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-04T10:49:09.672 INFO:teuthology.orchestra.run.smithi063.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-04T10:49:09.672 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-04T10:49:09.676 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-04T10:49:09.711 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-04T10:49:10.260 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-04T10:49:10.264 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/btrfs/ install 2023-12-04T10:49:10.270 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-04T10:49:10.306 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-12-04T10:49:14.047 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-04T10:49:14.083 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out /var/lib/xfstests/tests/btrfs 2023-12-04T10:49:16.267 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:49:16.274 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:49:17.510 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ceph/ install 2023-12-04T10:49:17.514 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-04T10:49:17.551 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-04T10:49:17.632 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-04T10:49:17.667 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-04T10:49:17.747 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/cifs/ install 2023-12-04T10:49:17.751 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-04T10:49:17.788 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-04T10:49:17.824 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-04T10:49:17.859 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-04T10:49:17.894 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ext4/ install 2023-12-04T10:49:17.898 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-04T10:49:17.934 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-04T10:49:18.810 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-04T10:49:18.847 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-04T10:49:19.668 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/f2fs/ install 2023-12-04T10:49:19.672 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-04T10:49:19.708 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-04T10:49:19.752 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-04T10:49:19.787 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-04T10:49:19.832 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/generic/ install 2023-12-04T10:49:19.842 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-04T10:49:19.879 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-12-04T10:49:29.006 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-04T10:49:29.044 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-12-04T10:49:38.138 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/nfs/ install 2023-12-04T10:49:38.142 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-04T10:49:38.177 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-04T10:49:38.212 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-04T10:49:38.248 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-04T10:49:38.285 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/ocfs2/ install 2023-12-04T10:49:38.290 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-04T10:49:38.324 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-04T10:49:38.360 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-04T10:49:38.396 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-04T10:49:38.433 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/overlay/ install 2023-12-04T10:49:38.438 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-04T10:49:38.475 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-04T10:49:39.716 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-04T10:49:39.753 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-04T10:49:40.948 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/perf/ install 2023-12-04T10:49:40.952 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-04T10:49:40.987 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-04T10:49:41.022 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-04T10:49:41.060 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-04T10:49:41.098 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/selftest/ install 2023-12-04T10:49:41.102 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-04T10:49:41.139 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-04T10:49:41.226 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-04T10:49:41.261 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-04T10:49:41.353 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/shared/ install 2023-12-04T10:49:41.357 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-04T10:49:41.394 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-04T10:49:41.452 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-04T10:49:41.488 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-04T10:49:41.545 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/tmpfs/ install 2023-12-04T10:49:41.548 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-04T10:49:41.583 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-04T10:49:41.619 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-04T10:49:41.653 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-04T10:49:41.690 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/udf/ install 2023-12-04T10:49:41.694 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-04T10:49:41.730 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-04T10:49:41.766 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-04T10:49:41.803 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-04T10:49:41.840 INFO:teuthology.orchestra.run.smithi063.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.Qs710hMD8ixfstests-dev/tests/xfs/ install 2023-12-04T10:49:41.850 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-04T10:49:41.887 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-04T10:49:46.423 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:49:46.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:49:50.259 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-04T10:49:50.292 INFO:teuthology.orchestra.run.smithi063.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-04T10:49:58.685 INFO:teuthology.orchestra.run.smithi063.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-04T10:49:58.723 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-04T10:49:58.758 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-04T10:49:58.795 INFO:teuthology.orchestra.run.smithi063.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-04T10:49:58.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T10:49:58.839 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec ls tests/generic) 2023-12-04T10:49:58.900 INFO:teuthology.orchestra.run.smithi063.stdout:001 2023-12-04T10:49:58.900 INFO:teuthology.orchestra.run.smithi063.stdout:001.out 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:002 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:002.out 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:003 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:003.out 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:004 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:004.out 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:005 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:005.out 2023-12-04T10:49:58.901 INFO:teuthology.orchestra.run.smithi063.stdout:006 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:006.out 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:007 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:007.out 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:008 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:008.out 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:009 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:009.out 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:010 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:010.out 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:011 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:011.out 2023-12-04T10:49:58.902 INFO:teuthology.orchestra.run.smithi063.stdout:012 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:012.out 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:013 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:013.out 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:014 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:014.out 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:015 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:015.out 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:016 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:016.out 2023-12-04T10:49:58.903 INFO:teuthology.orchestra.run.smithi063.stdout:017 2023-12-04T10:49:58.904 INFO:teuthology.orchestra.run.smithi063.stdout:017.out 2023-12-04T10:49:58.904 INFO:teuthology.orchestra.run.smithi063.stdout:018 2023-12-04T10:49:58.904 INFO:teuthology.orchestra.run.smithi063.stdout:018.out 2023-12-04T10:49:58.904 INFO:teuthology.orchestra.run.smithi063.stdout:019 2023-12-04T10:49:58.904 INFO:teuthology.orchestra.run.smithi063.stdout:019.out 2023-12-04T10:49:58.904 INFO:teuthology.orchestra.run.smithi063.stdout:020 2023-12-04T10:49:58.904 INFO:teuthology.orchestra.run.smithi063.stdout:020.out 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:021 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:021.out 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:022 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:022.out 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:023 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:023.out 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:024 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:024.out 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:025 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:025.out 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:026 2023-12-04T10:49:58.905 INFO:teuthology.orchestra.run.smithi063.stdout:026.out 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:027 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:027.out 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:028 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:028.out 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:029 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:029.out 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:030 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:030.out 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:031 2023-12-04T10:49:58.906 INFO:teuthology.orchestra.run.smithi063.stdout:031.out 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:032 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:032.out 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:033 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:033.out 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:034 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:034.out 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:035 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:035.cfg 2023-12-04T10:49:58.907 INFO:teuthology.orchestra.run.smithi063.stdout:035.out.default 2023-12-04T10:49:58.908 INFO:teuthology.orchestra.run.smithi063.stdout:035.out.nfs 2023-12-04T10:49:58.908 INFO:teuthology.orchestra.run.smithi063.stdout:036 2023-12-04T10:49:58.908 INFO:teuthology.orchestra.run.smithi063.stdout:036.out 2023-12-04T10:49:58.908 INFO:teuthology.orchestra.run.smithi063.stdout:037 2023-12-04T10:49:58.908 INFO:teuthology.orchestra.run.smithi063.stdout:037.out 2023-12-04T10:49:58.908 INFO:teuthology.orchestra.run.smithi063.stdout:038 2023-12-04T10:49:58.908 INFO:teuthology.orchestra.run.smithi063.stdout:038.out 2023-12-04T10:49:58.908 INFO:teuthology.orchestra.run.smithi063.stdout:039 2023-12-04T10:49:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:039.out 2023-12-04T10:49:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:040 2023-12-04T10:49:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:040.out 2023-12-04T10:49:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:041 2023-12-04T10:49:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:041.out 2023-12-04T10:49:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:042 2023-12-04T10:49:58.909 INFO:teuthology.orchestra.run.smithi063.stdout:042.out 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:043 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:043.out 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:044 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:044.out 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:045 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:045.out 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:046 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:046.out 2023-12-04T10:49:58.910 INFO:teuthology.orchestra.run.smithi063.stdout:047 2023-12-04T10:49:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:047.out 2023-12-04T10:49:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:048 2023-12-04T10:49:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:048.out 2023-12-04T10:49:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:049 2023-12-04T10:49:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:049.out 2023-12-04T10:49:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:050 2023-12-04T10:49:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:050.cfg 2023-12-04T10:49:58.911 INFO:teuthology.orchestra.run.smithi063.stdout:050.out.default 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:050.out.nojournal 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:050.out.xfsquota 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:051 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:051.out 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:052 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:052.out 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:053 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:053.out 2023-12-04T10:49:58.912 INFO:teuthology.orchestra.run.smithi063.stdout:054 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:054.out 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:055 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:055.out 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:056 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:056.out 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:057 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:057.out 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:058 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:058.out 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:059 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:059.out 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:060 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:060.out 2023-12-04T10:49:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:061 2023-12-04T10:49:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:061.out 2023-12-04T10:49:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:062 2023-12-04T10:49:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:062.out 2023-12-04T10:49:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:063 2023-12-04T10:49:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:063.out 2023-12-04T10:49:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:064 2023-12-04T10:49:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:064.out 2023-12-04T10:49:58.914 INFO:teuthology.orchestra.run.smithi063.stdout:065 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:065.out 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:066 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:066.out 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:067 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:067.out 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:068 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:068.out 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:069 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:069.out 2023-12-04T10:49:58.915 INFO:teuthology.orchestra.run.smithi063.stdout:070 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:070.out 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:071 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:071.out 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:072 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:072.out 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:073 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:073.out 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:074 2023-12-04T10:49:58.916 INFO:teuthology.orchestra.run.smithi063.stdout:074.out 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:075 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:075.out 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:076 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:076.out 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:077 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:077.out 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:078 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:078.out 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:079 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:079.out 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:080 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:080.out 2023-12-04T10:49:58.917 INFO:teuthology.orchestra.run.smithi063.stdout:081 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:081.out 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:082 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:082.out 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:083 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:083.out 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:084 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:084.out 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:085 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:085.out 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:086 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:086.out 2023-12-04T10:49:58.918 INFO:teuthology.orchestra.run.smithi063.stdout:087 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:087.out 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:088 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:088.out 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:089 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:089.out 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:090 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:090.out 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:091 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:091.out 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:092 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:092.out 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:093 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:093.out 2023-12-04T10:49:58.919 INFO:teuthology.orchestra.run.smithi063.stdout:094 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:094.out 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:095 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:095.out 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:096 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:096.out 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:097 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:097.out 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:098 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:098.out 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:099 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:099.out 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:100 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:100.out 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:101 2023-12-04T10:49:58.920 INFO:teuthology.orchestra.run.smithi063.stdout:101.out 2023-12-04T10:49:58.921 INFO:teuthology.orchestra.run.smithi063.stdout:102 2023-12-04T10:49:58.921 INFO:teuthology.orchestra.run.smithi063.stdout:102.out 2023-12-04T10:49:58.921 INFO:teuthology.orchestra.run.smithi063.stdout:103 2023-12-04T10:49:58.921 INFO:teuthology.orchestra.run.smithi063.stdout:103.out 2023-12-04T10:49:58.921 INFO:teuthology.orchestra.run.smithi063.stdout:104 2023-12-04T10:49:58.921 INFO:teuthology.orchestra.run.smithi063.stdout:104.out 2023-12-04T10:49:58.921 INFO:teuthology.orchestra.run.smithi063.stdout:105 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:105.out 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:106 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:106.out 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:107 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:107.out 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:108 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:108.out 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:109 2023-12-04T10:49:58.922 INFO:teuthology.orchestra.run.smithi063.stdout:109.out 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:110 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:110.out 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:111 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:111.out 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:112 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:112.out 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:113 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:113.out 2023-12-04T10:49:58.923 INFO:teuthology.orchestra.run.smithi063.stdout:114 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:114.out 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:115 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:115.out 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:116 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:116.out 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:117 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:117.out 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:118 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:118.out 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:119 2023-12-04T10:49:58.924 INFO:teuthology.orchestra.run.smithi063.stdout:119.out 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:120 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:120.out 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:121 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:121.out 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:122 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:122.out 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:123 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:123.out 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:124 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:124.out 2023-12-04T10:49:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:125 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:125.out 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:126 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:126.out 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:127 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:127.out 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:128 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:128.out 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:129 2023-12-04T10:49:58.926 INFO:teuthology.orchestra.run.smithi063.stdout:129.out 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:130 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:130.out 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:131 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:131.out 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:132 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:132.out 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:133 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:133.out 2023-12-04T10:49:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:134 2023-12-04T10:49:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:134.out 2023-12-04T10:49:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:135 2023-12-04T10:49:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:135.out 2023-12-04T10:49:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:136 2023-12-04T10:49:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:136.out 2023-12-04T10:49:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:137 2023-12-04T10:49:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:137.out 2023-12-04T10:49:58.928 INFO:teuthology.orchestra.run.smithi063.stdout:138 2023-12-04T10:49:58.929 INFO:teuthology.orchestra.run.smithi063.stdout:138.out 2023-12-04T10:49:58.929 INFO:teuthology.orchestra.run.smithi063.stdout:139 2023-12-04T10:49:58.929 INFO:teuthology.orchestra.run.smithi063.stdout:139.out 2023-12-04T10:49:58.929 INFO:teuthology.orchestra.run.smithi063.stdout:140 2023-12-04T10:49:58.929 INFO:teuthology.orchestra.run.smithi063.stdout:140.out 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:141 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:141.out 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:142 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:142.out 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:143 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:143.out 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:144 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:144.out 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:145 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:145.out 2023-12-04T10:49:58.930 INFO:teuthology.orchestra.run.smithi063.stdout:146 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:146.out 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:147 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:147.out 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:148 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:148.out 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:149 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:149.out 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:150 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:150.out 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:151 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:151.out 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:152 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:152.out 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:153 2023-12-04T10:49:58.931 INFO:teuthology.orchestra.run.smithi063.stdout:153.out 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:154 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:154.out 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:155 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:155.out 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:156 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:156.out 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:157 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:157.out 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:158 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:158.out 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:159 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:159.out 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:160 2023-12-04T10:49:58.932 INFO:teuthology.orchestra.run.smithi063.stdout:160.out 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:161 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:161.out 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:162 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:162.out 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:163 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:163.out 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:164 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:164.out 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:165 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:165.out 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:166 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:166.out 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:167 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:167.out 2023-12-04T10:49:58.933 INFO:teuthology.orchestra.run.smithi063.stdout:168 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:168.out 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:169 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:169.out 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:170 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:170.out 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:171 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:171.out 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:172 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:172.out 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:173 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:173.out 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:174 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:174.out 2023-12-04T10:49:58.934 INFO:teuthology.orchestra.run.smithi063.stdout:175 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:175.out 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:176 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:176.out 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:177 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:177.out 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:178 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:178.out 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:179 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:179.out 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:180 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:180.out 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:181 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:181.out 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:182 2023-12-04T10:49:58.935 INFO:teuthology.orchestra.run.smithi063.stdout:182.out 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:183 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:183.out 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:184 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:184.out 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:185 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:185.out 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:186 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:186.out 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:187 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:187.out 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:188 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:188.out 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:189 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:189.out 2023-12-04T10:49:58.936 INFO:teuthology.orchestra.run.smithi063.stdout:190 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:190.out 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:191 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:191.out 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:192 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:192.out 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:193 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:193.out 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:194 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:194.out 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:195 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:195.out 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:196 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:196.out 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:197 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:197.out 2023-12-04T10:49:58.937 INFO:teuthology.orchestra.run.smithi063.stdout:198 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:198.out 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:199 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:199.out 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:200 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:200.out 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:201 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:201.out 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:202 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:202.out 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:203 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:203.out 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:204 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:204.out 2023-12-04T10:49:58.938 INFO:teuthology.orchestra.run.smithi063.stdout:205 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:205.out 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:206 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:206.out 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:207 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:207.out 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:208 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:208.out 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:209 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:209.out 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:210 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:210.out 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:211 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:211.out 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:212 2023-12-04T10:49:58.939 INFO:teuthology.orchestra.run.smithi063.stdout:212.out 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:213 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:213.out 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:214 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:214.out 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:215 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:215.out 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:216 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:216.out 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:217 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:217.out 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:218 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:218.out 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:219 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:219.out 2023-12-04T10:49:58.940 INFO:teuthology.orchestra.run.smithi063.stdout:220 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:220.out 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:221 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:221.out 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:222 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:222.out 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:223 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:223.out 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:224 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:224.out 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:225 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:225.out 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:226 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:226.out 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:227 2023-12-04T10:49:58.941 INFO:teuthology.orchestra.run.smithi063.stdout:227.out 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:228 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:228.out 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:229 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:229.out 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:230 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:230.out 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:231 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:231.out 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:232 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:232.out 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:233 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:233.out 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:234 2023-12-04T10:49:58.942 INFO:teuthology.orchestra.run.smithi063.stdout:234.out 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:235 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:235.out 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:236 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:236.out 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:237 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:237.out 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:238 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:238.out 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:239 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:239.out 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:240 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:240.out 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:241 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:241.out 2023-12-04T10:49:58.943 INFO:teuthology.orchestra.run.smithi063.stdout:242 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:242.out 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:243 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:243.out 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:244 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:244.out 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:245 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:245.out 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:246 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:246.out 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:247 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:247.out 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:248 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:248.out 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:249 2023-12-04T10:49:58.944 INFO:teuthology.orchestra.run.smithi063.stdout:249.out 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:250 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:250.out 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:251 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:251.out 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:252 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:252.out 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:253 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:253.out 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:254 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:254.out 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:255 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:255.out 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:256 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:256.out 2023-12-04T10:49:58.945 INFO:teuthology.orchestra.run.smithi063.stdout:257 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:257.out 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:258 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:258.out 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:259 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:259.out 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:260 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:260.out 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:261 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:261.out 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:262 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:262.out 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:263 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:263.out 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:264 2023-12-04T10:49:58.946 INFO:teuthology.orchestra.run.smithi063.stdout:264.out 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:265 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:265.out 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:266 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:266.out 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:267 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:267.out 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:268 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:268.out 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:269 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:269.out 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:270 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:270.out 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:271 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:271.out 2023-12-04T10:49:58.947 INFO:teuthology.orchestra.run.smithi063.stdout:272 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:272.out 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:273 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:273.out 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:274 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:274.out 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:275 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:275.out 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:276 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:276.out 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:277 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:277.out 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:278 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:278.out 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:279 2023-12-04T10:49:58.948 INFO:teuthology.orchestra.run.smithi063.stdout:279.out 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:280 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:280.out 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:281 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:281.out 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:282 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:282.out 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:283 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:283.out 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:284 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:284.out 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:285 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:285.out 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:286 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:286.out 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:287 2023-12-04T10:49:58.949 INFO:teuthology.orchestra.run.smithi063.stdout:287.out 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:288 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:288.out 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:289 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:289.out 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:290 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:290.out 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:291 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:291.out 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:292 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:292.out 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:293 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:293.out 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:294 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:294.out 2023-12-04T10:49:58.950 INFO:teuthology.orchestra.run.smithi063.stdout:295 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:295.out 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:296 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:296.out 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:297 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:297.out 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:298 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:298.out 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:299 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:299.out 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:300 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:300.out 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:301 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:301.out 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:302 2023-12-04T10:49:58.951 INFO:teuthology.orchestra.run.smithi063.stdout:302.out 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:303 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:303.out 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:304 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:304.out 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:305 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:305.out 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:306 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:306.out 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:307 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:307.out 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:308 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:308.out 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:309 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:309.out 2023-12-04T10:49:58.952 INFO:teuthology.orchestra.run.smithi063.stdout:310 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:310.out 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:311 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:311.out 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:312 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:312.out 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:313 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:313.out 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:314 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:314.out 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:315 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:315.out 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:316 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:316.out 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:317 2023-12-04T10:49:58.953 INFO:teuthology.orchestra.run.smithi063.stdout:317.out 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:318 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:318.out 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:319 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:319.out 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:320 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:320.out 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:321 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:321.out 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:322 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:322.out 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:323 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:323.out 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:324 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:324.out 2023-12-04T10:49:58.954 INFO:teuthology.orchestra.run.smithi063.stdout:325 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:325.out 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:326 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:326.out 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:327 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:327.out 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:328 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:328.out 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:329 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:329.out 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:330 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:330.out 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:331 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:331.out 2023-12-04T10:49:58.955 INFO:teuthology.orchestra.run.smithi063.stdout:332 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:332.out 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:333 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:333.out 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:334 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:334.out 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:335 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:335.out 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:336 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:336.out 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:337 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:337.out 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:338 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:338.out 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:339 2023-12-04T10:49:58.956 INFO:teuthology.orchestra.run.smithi063.stdout:339.out 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:340 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:340.out 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:341 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:341.out 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:342 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:342.out 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:343 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:343.out 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:344 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:344.out 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:345 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:345.out 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:346 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:346.out 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:347 2023-12-04T10:49:58.957 INFO:teuthology.orchestra.run.smithi063.stdout:347.out 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:348 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:348.out 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:349 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:349.out 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:350 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:350.out 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:351 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:351.out 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:352 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:352.out 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:353 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:353.out 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:354 2023-12-04T10:49:58.958 INFO:teuthology.orchestra.run.smithi063.stdout:354.out 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:355 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:355.out 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:356 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:356.out 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:357 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:357.out 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:358 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:358.out 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:359 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:359.out 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:360 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:360.out 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:361 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:361.out 2023-12-04T10:49:58.959 INFO:teuthology.orchestra.run.smithi063.stdout:362 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:362.out 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:363 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:363.out 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:364 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:364.out 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:365 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:365.out 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:366 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:366.out 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:367 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:367.out 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:368 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:368.out 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:369 2023-12-04T10:49:58.960 INFO:teuthology.orchestra.run.smithi063.stdout:369.out 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:370 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:370.out 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:371 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:371.out 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:372 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:372.out 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:373 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:373.out 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:374 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:374.out 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:375 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:375.out 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:376 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:376.out 2023-12-04T10:49:58.961 INFO:teuthology.orchestra.run.smithi063.stdout:377 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:377.out 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:378 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:378.out 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:379 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:379.out 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:380 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:380.out 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:381 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:381.out 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:382 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:382.out 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:383 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:383.out 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:384 2023-12-04T10:49:58.962 INFO:teuthology.orchestra.run.smithi063.stdout:384.out 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:385 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:385.out 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:386 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:386.out 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:387 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:387.out 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:388 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:388.out 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:389 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:389.out 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:390 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:390.out 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:391 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:391.out 2023-12-04T10:49:58.963 INFO:teuthology.orchestra.run.smithi063.stdout:392 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:392.out 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:393 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:393.out 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:394 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:394.out 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:395 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:395.out 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:396 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:396.out 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:397 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:397.out 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:398 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:398.out 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:399 2023-12-04T10:49:58.964 INFO:teuthology.orchestra.run.smithi063.stdout:399.out 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:400 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:400.out 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:401 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:401.out 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:402 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:402.out 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:403 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:403.out 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:404 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:404.out 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:405 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:405.out 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:406 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:406.out 2023-12-04T10:49:58.965 INFO:teuthology.orchestra.run.smithi063.stdout:407 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:407.out 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:408 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:408.out 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:409 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:409.out 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:410 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:410.out 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:411 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:411.out 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:412 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:412.out 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:413 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:413.out 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:414 2023-12-04T10:49:58.966 INFO:teuthology.orchestra.run.smithi063.stdout:414.out 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:415 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:415.out 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:416 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:416.out 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:417 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:417.out 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:418 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:418.out 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:419 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:419.out 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:420 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:420.out 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:421 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:421.out 2023-12-04T10:49:58.967 INFO:teuthology.orchestra.run.smithi063.stdout:422 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:422.out 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:423 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:423.out 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:424 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:424.out 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:425 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:425.out 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:426 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:426.out 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:427 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:427.out 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:428 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:428.out 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:429 2023-12-04T10:49:58.968 INFO:teuthology.orchestra.run.smithi063.stdout:429.out 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:430 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:430.out 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:431 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:431.out 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:432 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:432.out 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:433 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:433.out 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:434 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:434.out 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:435 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:435.out 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:436 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:436.out 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:437 2023-12-04T10:49:58.969 INFO:teuthology.orchestra.run.smithi063.stdout:437.out 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:438 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:438.out 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:439 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:439.out 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:440 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:440.out 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:441 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:441.out 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:442 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:442.out 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:443 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:443.out 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:444 2023-12-04T10:49:58.970 INFO:teuthology.orchestra.run.smithi063.stdout:444.out 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:445 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:445.out 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:446 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:446.out 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:447 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:447.out 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:448 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:448.out 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:449 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:449.out 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:450 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:450.out 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:451 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:451.out 2023-12-04T10:49:58.971 INFO:teuthology.orchestra.run.smithi063.stdout:452 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:452.out 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:453 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:453.out 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:454 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:454.out 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:455 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:455.out 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:456 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:456.out 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:457 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:457.out 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:458 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:458.out 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:459 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:459.out 2023-12-04T10:49:58.972 INFO:teuthology.orchestra.run.smithi063.stdout:460 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:460.out 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:461 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:461.out 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:462 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:462.out 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:463 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:463.out 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:464 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:464.out 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:465 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:465.out 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:466 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:466.out 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:467 2023-12-04T10:49:58.973 INFO:teuthology.orchestra.run.smithi063.stdout:467.out 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:468 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:468.out 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:469 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:469.out 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:470 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:470.out 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:471 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:471.out 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:472 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:472.out 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:473 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:473.out 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:474 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:474.out 2023-12-04T10:49:58.974 INFO:teuthology.orchestra.run.smithi063.stdout:475 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:475.out 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:476 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:476.out 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:477 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:477.out 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:478 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:478.out 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:479 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:479.out 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:480 2023-12-04T10:49:58.975 INFO:teuthology.orchestra.run.smithi063.stdout:480.out 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:481 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:481.out 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:482 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:482.out 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:483 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:483.out 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:484 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:484.out 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:485 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:485.out 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:486 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:486.out 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:487 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:487.out 2023-12-04T10:49:58.976 INFO:teuthology.orchestra.run.smithi063.stdout:488 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:488.out 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:489 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:489.out 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:490 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:490.out 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:491 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:491.out 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:492 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:492.out 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:493 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:493.out 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:494 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:494.out 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:495 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:495.out 2023-12-04T10:49:58.977 INFO:teuthology.orchestra.run.smithi063.stdout:496 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:496.out 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:497 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:497.out 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:498 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:498.out 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:499 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:499.out 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:500 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:500.out 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:501 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:501.out 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:502 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:502.out 2023-12-04T10:49:58.978 INFO:teuthology.orchestra.run.smithi063.stdout:503 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:503.out 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:504 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:504.out 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:505 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:505.out 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:506 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:506.out 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:507 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:507.out 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:508 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:508.out 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:509 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:509.out 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:510 2023-12-04T10:49:58.979 INFO:teuthology.orchestra.run.smithi063.stdout:510.out 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:511 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:511.out 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:512 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:512.out 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:513 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:513.out 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:514 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:514.out 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:515 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:515.out 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:516 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:516.out 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:517 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:517.out 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:518 2023-12-04T10:49:58.980 INFO:teuthology.orchestra.run.smithi063.stdout:518.out 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:519 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:519.out 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:520 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:520.out 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:521 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:521.out 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:522 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:522.out 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:523 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:523.out 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:524 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:524.out 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:525 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:525.out 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:526 2023-12-04T10:49:58.981 INFO:teuthology.orchestra.run.smithi063.stdout:526.out 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:527 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:527.out 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:528 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:528.out 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:529 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:529.out 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:530 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:530.out 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:531 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:531.out 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:532 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:532.out 2023-12-04T10:49:58.982 INFO:teuthology.orchestra.run.smithi063.stdout:533 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:533.out 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:534 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:534.out 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:535 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:535.out 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:536 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:536.out 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:537 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:537.out 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:538 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:538.out 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:539 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:539.out 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:540 2023-12-04T10:49:58.983 INFO:teuthology.orchestra.run.smithi063.stdout:540.out 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:541 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:541.out 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:542 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:542.out 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:543 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:543.out 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:544 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:544.out 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:545 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:545.out 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:546 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:546.out 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:547 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:547.out 2023-12-04T10:49:58.984 INFO:teuthology.orchestra.run.smithi063.stdout:548 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:548.out 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:549 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:549.out 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:550 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:550.out 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:551 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:551.out 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:552 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:552.out 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:553 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:553.out 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:554 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:554.out 2023-12-04T10:49:58.985 INFO:teuthology.orchestra.run.smithi063.stdout:555 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:555.out 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:556 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:556.out 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:557 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:557.out 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:558 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:558.out 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:559 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:559.out 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:560 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:560.out 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:561 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:561.out 2023-12-04T10:49:58.986 INFO:teuthology.orchestra.run.smithi063.stdout:562 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:562.out 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:563 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:563.out 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:564 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:564.out 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:565 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:565.out 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:566 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:566.out 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:567 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:567.out 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:568 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:568.out 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:569 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:569.out 2023-12-04T10:49:58.987 INFO:teuthology.orchestra.run.smithi063.stdout:570 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:570.out 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:571 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:571.out 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:572 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:572.out 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:573 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:573.out 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:574 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:574.out 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:575 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:575.out 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:576 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:576.out 2023-12-04T10:49:58.988 INFO:teuthology.orchestra.run.smithi063.stdout:577 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:577.out 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:578 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:578.out 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:579 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:579.out 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:580 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:580.out 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:581 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:581.out 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:582 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:582.out 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:583 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:583.out 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:584 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:584.out 2023-12-04T10:49:58.989 INFO:teuthology.orchestra.run.smithi063.stdout:585 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:585.out 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:586 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:586.out 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:587 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:587.out 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:588 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:588.out 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:589 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:589.out 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:590 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:590.out 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:591 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:591.out 2023-12-04T10:49:58.990 INFO:teuthology.orchestra.run.smithi063.stdout:592 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:592.out 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:593 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:593.out 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:594 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:594.out 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:595 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:595.out 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:596 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:596.out 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:597 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:597.out 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:598 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:598.out 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:599 2023-12-04T10:49:58.991 INFO:teuthology.orchestra.run.smithi063.stdout:599.out 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:600 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:600.out 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:601 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:601.out 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:602 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:602.out 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:603 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:603.out 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:604 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:604.out 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:605 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:605.out 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:606 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:606.out 2023-12-04T10:49:58.992 INFO:teuthology.orchestra.run.smithi063.stdout:607 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:607.out 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:608 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:608.out 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:609 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:609.out 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:610 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:610.out 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:611 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:611.out 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:612 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:612.out 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:613 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:613.out 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:614 2023-12-04T10:49:58.993 INFO:teuthology.orchestra.run.smithi063.stdout:614.out 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:615 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:615.out 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:616 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:616.out 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:617 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:617.out 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:618 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:618.out 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:619 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:619.out 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:620 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:620.out 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:621 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:621.out 2023-12-04T10:49:58.994 INFO:teuthology.orchestra.run.smithi063.stdout:622 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:622.out 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:623 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:623.out 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:624 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:624.out 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:625 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:625.out 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:626 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:626.out 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:627 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:627.out 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:628 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:628.out 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:629 2023-12-04T10:49:58.995 INFO:teuthology.orchestra.run.smithi063.stdout:629.out 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:630 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:630.out 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:631 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:631.out 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:632 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:632.out 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:633 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:633.out 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:634 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:634.out 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:635 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:635.out 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:636 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:636.out 2023-12-04T10:49:58.996 INFO:teuthology.orchestra.run.smithi063.stdout:637 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:637.out 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:638 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:638.out 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:639 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:639.out 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:640 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:640.out 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:641 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:641.out 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:642 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:642.out 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:643 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:643.out 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:644 2023-12-04T10:49:58.997 INFO:teuthology.orchestra.run.smithi063.stdout:644.out 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:645 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:645.out 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:646 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:646.out 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:647 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:647.out 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:648 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:648.out 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:649 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:649.out 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:650 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:650.out 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:651 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:651.out 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:652 2023-12-04T10:49:58.998 INFO:teuthology.orchestra.run.smithi063.stdout:652.out 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:653 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:653.out 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:654 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:654.out 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:655 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:655.out 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:656 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:656.out 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:657 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:657.out 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:658 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:658.out 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:659 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:659.out 2023-12-04T10:49:58.999 INFO:teuthology.orchestra.run.smithi063.stdout:660 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:660.out 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:661 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:661.out 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:662 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:662.out 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:663 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:663.out 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:664 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:664.out 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:665 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:665.out 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:666 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:666.out 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:667 2023-12-04T10:49:59.000 INFO:teuthology.orchestra.run.smithi063.stdout:667.out 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:668 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:668.out 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:669 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:669.out 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:670 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:670.out 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:671 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:671.out 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:672 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:672.out 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:673 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:673.out 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:674 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:674.out 2023-12-04T10:49:59.001 INFO:teuthology.orchestra.run.smithi063.stdout:675 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:675.out 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:676 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:676.out 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:677 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:677.out 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:678 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:678.out 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:679 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:679.out 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:680 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:680.out 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:681 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:681.out 2023-12-04T10:49:59.002 INFO:teuthology.orchestra.run.smithi063.stdout:682 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:682.out 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:683 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:683.out 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:684 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:684.out 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:685 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:685.out 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:686 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:686.out 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:687 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:687.out 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:688 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:688.out 2023-12-04T10:49:59.003 INFO:teuthology.orchestra.run.smithi063.stdout:689 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:689.out 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:690 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:690.out 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:691 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:691.out 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:692 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:692.out 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:693 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:693.out 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:694 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:694.out 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:695 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:695.out 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:696 2023-12-04T10:49:59.004 INFO:teuthology.orchestra.run.smithi063.stdout:696.out 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:697 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:697.out 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:698 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:698.out 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:699 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:699.out 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:700 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:700.out 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:701 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:701.out 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:702 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:702.out 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:703 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:703.out 2023-12-04T10:49:59.005 INFO:teuthology.orchestra.run.smithi063.stdout:704 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:704.out 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:705 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:705.out 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:706 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:706.out 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:707 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:707.out 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:708 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:708.out 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:709 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:709.out 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:710 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:710.out 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:711 2023-12-04T10:49:59.006 INFO:teuthology.orchestra.run.smithi063.stdout:711.out 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:712 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:712.out 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:713 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:713.out 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:714 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:714.out 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:715 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:715.out 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:716 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:716.out 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:717 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:717.out 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:718 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:718.out 2023-12-04T10:49:59.007 INFO:teuthology.orchestra.run.smithi063.stdout:719 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:719.out 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:720 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:720.out 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:721 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:721.out 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:722 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:722.out 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:723 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:723.out 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:724 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:724.out 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:725 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:725.out 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:726 2023-12-04T10:49:59.008 INFO:teuthology.orchestra.run.smithi063.stdout:726.out 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:727 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:727.out 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:728 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:728.out 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:729 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:729.out 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:730 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:730.out 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:731 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:731.out 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:732 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:732.out 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:group.list 2023-12-04T10:49:59.009 INFO:teuthology.orchestra.run.smithi063.stdout:Makefile 2023-12-04T10:49:59.011 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-12-04T10:49:59.695 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:49:59.709 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:49:59.711 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:49:59.714 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:49:59.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:10.687 INFO:teuthology.orchestra.run.smithi063.stdout:generic/001 10s 2023-12-04T10:50:10.705 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/001 2023-12-04T10:50:10.705 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:50:10.714 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:11.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:50:11.082 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-12-04T10:50:11.687 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:50:11.707 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:50:11.708 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:50:11.712 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:50:11.712 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:12.818 INFO:teuthology.orchestra.run.smithi063.stdout:generic/002 1s 2023-12-04T10:50:12.840 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/002 2023-12-04T10:50:12.840 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:50:12.852 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:12.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:50:12.929 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-12-04T10:50:13.465 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:50:13.480 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:50:13.482 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:50:13.486 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:50:13.486 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:14.132 INFO:teuthology.orchestra.run.smithi063.stdout:generic/003 [not run] atime not maintained by ceph 2023-12-04T10:50:14.146 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/003 2023-12-04T10:50:14.146 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/003 2023-12-04T10:50:14.146 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:50:14.157 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:14.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:50:14.197 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-12-04T10:50:14.760 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:50:14.774 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:50:14.775 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:50:14.779 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:50:14.779 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:15.514 INFO:teuthology.orchestra.run.smithi063.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-04T10:50:15.532 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/004 2023-12-04T10:50:15.532 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/004 2023-12-04T10:50:15.533 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:50:15.545 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:15.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:50:15.592 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-12-04T10:50:16.241 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:50:16.256 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:50:16.258 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:50:16.262 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:50:16.262 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:16.580 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:50:16.586 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:50:17.251 INFO:teuthology.orchestra.run.smithi063.stdout:generic/005 1s 2023-12-04T10:50:17.267 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/005 2023-12-04T10:50:17.267 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:50:17.274 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:17.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:50:17.335 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-12-04T10:50:17.856 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:50:17.869 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:50:17.871 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:50:17.874 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:50:17.874 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:46.741 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:50:46.751 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:50:57.218 INFO:teuthology.orchestra.run.smithi063.stdout:generic/006 39s 2023-12-04T10:50:57.233 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/006 2023-12-04T10:50:57.234 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:50:57.242 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:50:57.580 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:50:57.580 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-12-04T10:50:58.085 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:50:58.099 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:50:58.102 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:50:58.106 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:50:58.106 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:51:17.613 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:51:17.623 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:51:47.774 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:51:47.787 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:52:17.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:52:17.918 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:52:25.229 INFO:teuthology.orchestra.run.smithi063.stdout:generic/007 87s 2023-12-04T10:52:25.246 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/007 2023-12-04T10:52:25.247 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:52:25.256 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:52:25.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:52:25.400 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-12-04T10:52:25.932 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:52:25.948 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:52:25.949 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:52:25.953 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:52:25.953 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:52:26.757 INFO:teuthology.orchestra.run.smithi063.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-04T10:52:26.772 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/008 2023-12-04T10:52:26.772 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/008 2023-12-04T10:52:26.772 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:52:26.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:52:26.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:52:26.839 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-12-04T10:52:27.467 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:52:27.483 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:52:27.484 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:52:27.488 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:52:27.488 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:52:28.310 INFO:teuthology.orchestra.run.smithi063.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-04T10:52:28.323 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/009 2023-12-04T10:52:28.323 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/009 2023-12-04T10:52:28.323 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:52:28.332 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:52:28.375 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:52:28.375 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-12-04T10:52:28.997 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:52:29.014 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:52:29.016 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:52:29.019 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:52:29.019 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:52:30.238 INFO:teuthology.orchestra.run.smithi063.stdout:generic/010 1s 2023-12-04T10:52:30.255 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/010 2023-12-04T10:52:30.255 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:52:30.263 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:52:30.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:52:30.341 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-12-04T10:52:30.861 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:52:30.876 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:52:30.878 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:52:30.881 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:52:30.881 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:52:48.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:52:48.069 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:53:17.992 INFO:teuthology.orchestra.run.smithi063.stdout:generic/011 46s 2023-12-04T10:53:18.008 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/011 2023-12-04T10:53:18.008 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:53:18.017 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:53:18.092 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:53:18.092 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-12-04T10:53:18.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:53:18.485 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:53:18.637 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:53:18.649 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:53:18.651 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:53:18.654 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:53:18.654 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:53:19.554 INFO:teuthology.orchestra.run.smithi063.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T10:53:19.567 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/012 2023-12-04T10:53:19.568 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/012 2023-12-04T10:53:19.568 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:53:19.577 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:53:19.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:53:19.662 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-12-04T10:53:20.208 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:53:20.223 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:53:20.225 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:53:20.229 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:53:20.229 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:53:48.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:53:48.637 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:54:20.091 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:54:20.100 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:54:36.776 INFO:teuthology.orchestra.run.smithi063.stdout:generic/013 76s 2023-12-04T10:54:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/013 2023-12-04T10:54:37.257 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:54:37.266 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:54:37.324 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:54:37.325 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-12-04T10:54:37.984 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:54:37.999 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:54:38.000 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:54:38.004 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:54:38.004 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:54:52.744 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:54:52.751 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:55:24.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:55:24.190 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:55:56.157 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:55:56.164 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:56:26.633 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:56:26.642 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:56:57.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:56:57.431 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:57:28.898 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:57:28.904 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:58:00.763 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:58:00.773 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:58:31.697 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:58:31.704 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:59:03.860 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:59:03.871 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:59:25.844 INFO:teuthology.orchestra.run.smithi063.stdout:generic/014 287s 2023-12-04T10:59:26.091 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/014 2023-12-04T10:59:26.091 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:26.101 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:26.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:26.164 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-12-04T10:59:26.788 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:26.802 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:26.803 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:26.806 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:26.806 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:27.485 INFO:teuthology.orchestra.run.smithi063.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T10:59:27.499 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/015 2023-12-04T10:59:27.499 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/015 2023-12-04T10:59:27.499 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:27.507 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:27.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:27.550 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-12-04T10:59:28.187 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:28.201 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:28.203 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:28.206 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:28.207 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:29.090 INFO:teuthology.orchestra.run.smithi063.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T10:59:29.106 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/016 2023-12-04T10:59:29.106 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/016 2023-12-04T10:59:29.106 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:29.116 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:29.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:29.210 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-12-04T10:59:29.949 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:29.963 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:29.964 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:29.967 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:29.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:30.662 INFO:teuthology.orchestra.run.smithi063.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T10:59:30.672 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/017 2023-12-04T10:59:30.673 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/017 2023-12-04T10:59:30.673 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:30.684 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:30.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:30.734 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-12-04T10:59:31.373 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:31.389 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:31.391 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:31.397 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:31.397 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:32.252 INFO:teuthology.orchestra.run.smithi063.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-12-04T10:59:32.274 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/018 2023-12-04T10:59:32.274 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/018 2023-12-04T10:59:32.274 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:32.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:32.318 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-12-04T10:59:33.152 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:33.167 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:33.169 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:33.173 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:33.173 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:33.833 INFO:teuthology.orchestra.run.smithi063.stdout:generic/019 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T10:59:33.847 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/019 2023-12-04T10:59:33.847 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/019 2023-12-04T10:59:33.847 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:33.858 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:33.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:33.893 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-12-04T10:59:34.523 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:34.540 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:34.545 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:34.545 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:35.158 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:59:35.165 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T10:59:43.747 INFO:teuthology.orchestra.run.smithi063.stdout:generic/020 9s 2023-12-04T10:59:43.772 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/020 2023-12-04T10:59:43.772 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:43.781 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:43.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:43.890 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-12-04T10:59:44.622 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:44.637 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:44.638 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:44.641 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:44.641 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:45.752 INFO:teuthology.orchestra.run.smithi063.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T10:59:45.765 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/021 2023-12-04T10:59:45.765 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/021 2023-12-04T10:59:45.765 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:45.775 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:45.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:45.858 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-12-04T10:59:46.614 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:46.630 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:46.630 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:46.634 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:46.634 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:47.549 INFO:teuthology.orchestra.run.smithi063.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T10:59:47.561 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/022 2023-12-04T10:59:47.561 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/022 2023-12-04T10:59:47.561 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:47.569 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:47.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:47.658 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-12-04T10:59:48.422 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:48.437 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:48.439 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:48.442 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:48.442 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:50.744 INFO:teuthology.orchestra.run.smithi063.stdout:generic/023 2s 2023-12-04T10:59:50.764 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/023 2023-12-04T10:59:50.764 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:50.772 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:50.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:50.917 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-12-04T10:59:51.661 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:51.676 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:51.680 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:51.682 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:51.682 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:52.330 INFO:teuthology.orchestra.run.smithi063.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-04T10:59:52.343 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/024 2023-12-04T10:59:52.344 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/024 2023-12-04T10:59:52.344 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:52.354 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:52.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:52.449 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-12-04T10:59:53.215 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:53.231 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:53.232 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:53.236 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:53.236 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:53.899 INFO:teuthology.orchestra.run.smithi063.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-04T10:59:53.912 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/025 2023-12-04T10:59:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/025 2023-12-04T10:59:53.913 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:53.923 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:54.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:54.008 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-12-04T10:59:54.762 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:54.778 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:54.780 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:54.784 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:54.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:55.512 INFO:teuthology.orchestra.run.smithi063.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-12-04T10:59:55.526 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/026 2023-12-04T10:59:55.526 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/026 2023-12-04T10:59:55.526 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:55.534 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:55.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:55.580 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-12-04T10:59:56.206 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:56.221 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:56.223 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:56.226 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:56.226 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:56.848 INFO:teuthology.orchestra.run.smithi063.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T10:59:56.861 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/027 2023-12-04T10:59:56.861 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/027 2023-12-04T10:59:56.861 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T10:59:56.871 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T10:59:56.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T10:59:56.907 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-12-04T10:59:57.532 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T10:59:57.546 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T10:59:57.547 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T10:59:57.550 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T10:59:57.550 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:03.276 INFO:teuthology.orchestra.run.smithi063.stdout:generic/028 6s 2023-12-04T11:00:03.297 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/028 2023-12-04T11:00:03.297 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:03.308 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:03.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:03.352 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-12-04T11:00:03.964 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:03.977 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:03.979 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:03.982 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:03.982 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:05.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:00:06.006 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:00:09.537 INFO:teuthology.orchestra.run.smithi063.stdout:generic/029 5s 2023-12-04T11:00:09.557 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/029 2023-12-04T11:00:09.558 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:09.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:09.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:09.597 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-12-04T11:00:10.215 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:10.230 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:10.232 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:10.235 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:10.235 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:12.738 INFO:teuthology.orchestra.run.smithi063.stdout:generic/030 2s 2023-12-04T11:00:12.757 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/030 2023-12-04T11:00:12.758 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:12.765 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:12.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:12.795 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-12-04T11:00:13.422 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:13.436 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:13.438 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:13.442 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:13.443 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:14.283 INFO:teuthology.orchestra.run.smithi063.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-04T11:00:14.297 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/031 2023-12-04T11:00:14.297 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/031 2023-12-04T11:00:14.297 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:14.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:14.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:14.357 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-12-04T11:00:14.966 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:14.981 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:14.984 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:14.987 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:14.987 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:15.642 INFO:teuthology.orchestra.run.smithi063.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:00:15.655 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/032 2023-12-04T11:00:15.655 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/032 2023-12-04T11:00:15.655 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:15.662 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:15.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:15.702 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-12-04T11:00:16.331 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:16.345 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:16.347 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:16.349 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:16.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:17.189 INFO:teuthology.orchestra.run.smithi063.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-04T11:00:17.204 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/033 2023-12-04T11:00:17.204 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/033 2023-12-04T11:00:17.204 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:17.212 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:17.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:17.263 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-12-04T11:00:17.891 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:17.907 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:17.908 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:17.912 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:17.912 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:18.583 INFO:teuthology.orchestra.run.smithi063.stdout:generic/034 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:00:18.594 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/034 2023-12-04T11:00:18.594 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/034 2023-12-04T11:00:18.594 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:18.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:18.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:18.644 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-12-04T11:00:19.270 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:19.286 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:19.288 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:19.292 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:19.292 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:20.059 INFO:teuthology.orchestra.run.smithi063.stdout:generic/035 1s 2023-12-04T11:00:20.079 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/035 2023-12-04T11:00:20.079 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:20.089 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:20.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:20.187 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-12-04T11:00:20.954 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:20.966 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:20.967 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:20.970 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:20.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:31.865 INFO:teuthology.orchestra.run.smithi063.stdout:generic/036 10s 2023-12-04T11:00:31.883 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/036 2023-12-04T11:00:31.883 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:31.891 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:31.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:31.978 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-12-04T11:00:32.745 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:32.760 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:32.762 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:32.765 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:32.765 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:37.225 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:00:37.233 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:00:45.696 INFO:teuthology.orchestra.run.smithi063.stdout:generic/037 12s 2023-12-04T11:00:45.716 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/037 2023-12-04T11:00:45.716 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:45.727 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:45.754 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:45.755 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-12-04T11:00:46.385 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:46.398 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:46.399 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:46.403 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:46.403 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:47.070 INFO:teuthology.orchestra.run.smithi063.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:00:47.085 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/038 2023-12-04T11:00:47.085 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/038 2023-12-04T11:00:47.085 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:47.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:47.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:47.146 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-12-04T11:00:47.728 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:47.742 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:47.744 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:47.747 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:47.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:48.448 INFO:teuthology.orchestra.run.smithi063.stdout:generic/039 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:00:48.461 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/039 2023-12-04T11:00:48.462 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/039 2023-12-04T11:00:48.462 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:48.473 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:48.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:48.518 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-12-04T11:00:49.119 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:49.135 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:49.136 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:49.139 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:49.139 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:49.823 INFO:teuthology.orchestra.run.smithi063.stdout:generic/040 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:00:49.838 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/040 2023-12-04T11:00:49.838 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/040 2023-12-04T11:00:49.838 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:49.847 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:49.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:49.889 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-12-04T11:00:50.517 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:50.531 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:50.532 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:50.535 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:50.535 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:51.230 INFO:teuthology.orchestra.run.smithi063.stdout:generic/041 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:00:51.246 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/041 2023-12-04T11:00:51.246 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/041 2023-12-04T11:00:51.246 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:51.255 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:51.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:51.307 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-12-04T11:00:51.914 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:51.930 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:51.932 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:51.939 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:51.939 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:52.764 INFO:teuthology.orchestra.run.smithi063.stdout:generic/042 [not run] ceph does not support shutdown 2023-12-04T11:00:52.790 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/042 2023-12-04T11:00:52.790 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/042 2023-12-04T11:00:52.790 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:52.802 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:52.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:52.836 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-12-04T11:00:53.469 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:53.482 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:53.484 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:53.488 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:53.488 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:54.312 INFO:teuthology.orchestra.run.smithi063.stdout:generic/043 [not run] ceph does not support shutdown 2023-12-04T11:00:54.335 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/043 2023-12-04T11:00:54.335 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/043 2023-12-04T11:00:54.335 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:54.344 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:54.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:54.384 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-12-04T11:00:55.008 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:55.025 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:55.025 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:55.030 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:55.030 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:55.863 INFO:teuthology.orchestra.run.smithi063.stdout:generic/044 [not run] ceph does not support shutdown 2023-12-04T11:00:55.886 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/044 2023-12-04T11:00:55.887 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/044 2023-12-04T11:00:55.887 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:55.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:55.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:55.938 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-12-04T11:00:56.561 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:56.576 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:56.578 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:56.582 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:56.583 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:57.532 INFO:teuthology.orchestra.run.smithi063.stdout:generic/045 [not run] ceph does not support shutdown 2023-12-04T11:00:57.557 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/045 2023-12-04T11:00:57.557 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/045 2023-12-04T11:00:57.557 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:57.566 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:57.604 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:57.604 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-12-04T11:00:58.240 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:58.256 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:58.258 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:58.262 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:58.262 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:59.095 INFO:teuthology.orchestra.run.smithi063.stdout:generic/046 [not run] ceph does not support shutdown 2023-12-04T11:00:59.114 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/046 2023-12-04T11:00:59.114 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/046 2023-12-04T11:00:59.114 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:00:59.123 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:00:59.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:00:59.164 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-12-04T11:00:59.796 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:00:59.812 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:00:59.813 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:00:59.816 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:00:59.817 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:00.965 INFO:teuthology.orchestra.run.smithi063.stdout:generic/047 [not run] ceph does not support shutdown 2023-12-04T11:01:00.984 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/047 2023-12-04T11:01:00.985 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/047 2023-12-04T11:01:00.985 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:00.996 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:01.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:01.032 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-12-04T11:01:01.702 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:01.725 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:01.725 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:01.729 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:01.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:03.287 INFO:teuthology.orchestra.run.smithi063.stdout:generic/048 [not run] ceph does not support shutdown 2023-12-04T11:01:03.317 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/048 2023-12-04T11:01:03.318 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/048 2023-12-04T11:01:03.318 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:03.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:03.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:03.371 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-12-04T11:01:04.909 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:04.939 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:04.941 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:04.944 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:04.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:05.934 INFO:teuthology.orchestra.run.smithi063.stdout:generic/049 [not run] ceph does not support shutdown 2023-12-04T11:01:05.962 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/049 2023-12-04T11:01:05.963 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/049 2023-12-04T11:01:05.963 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:05.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:06.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:06.021 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-12-04T11:01:06.751 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:06.766 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:06.767 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:06.771 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:06.771 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:07.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:01:07.409 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:01:07.659 INFO:teuthology.orchestra.run.smithi063.stdout:generic/050 [not run] ceph does not support shutdown 2023-12-04T11:01:07.676 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/050 2023-12-04T11:01:07.676 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/050 2023-12-04T11:01:07.676 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:07.686 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:07.722 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:07.722 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-12-04T11:01:08.439 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:08.455 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:08.457 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:08.462 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:08.462 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:09.410 INFO:teuthology.orchestra.run.smithi063.stdout:generic/051 [not run] ceph does not support shutdown 2023-12-04T11:01:09.424 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/051 2023-12-04T11:01:09.424 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/051 2023-12-04T11:01:09.424 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:09.433 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:09.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:09.479 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-12-04T11:01:10.309 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:10.323 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:10.327 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:10.331 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:10.332 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:11.239 INFO:teuthology.orchestra.run.smithi063.stdout:generic/052 [not run] ceph does not support shutdown 2023-12-04T11:01:11.263 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/052 2023-12-04T11:01:11.263 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/052 2023-12-04T11:01:11.263 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:11.273 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:11.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:11.311 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-12-04T11:01:11.939 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:11.955 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:11.956 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:11.959 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:11.959 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:13.430 INFO:teuthology.orchestra.run.smithi063.stdout:generic/053 1s 2023-12-04T11:01:13.475 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/053 2023-12-04T11:01:13.475 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:13.493 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:13.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:13.532 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-12-04T11:01:14.272 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:14.290 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:14.291 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:14.294 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:14.295 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:15.212 INFO:teuthology.orchestra.run.smithi063.stdout:generic/054 [not run] ceph does not support shutdown 2023-12-04T11:01:15.231 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/054 2023-12-04T11:01:15.231 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/054 2023-12-04T11:01:15.231 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:15.245 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:15.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:15.293 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-12-04T11:01:15.957 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:15.976 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:15.979 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:15.981 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:15.982 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:16.817 INFO:teuthology.orchestra.run.smithi063.stdout:generic/055 [not run] ceph does not support shutdown 2023-12-04T11:01:16.837 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/055 2023-12-04T11:01:16.837 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/055 2023-12-04T11:01:16.837 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:16.847 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:16.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:16.880 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-12-04T11:01:17.510 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:17.528 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:17.530 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:17.534 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:17.534 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:18.229 INFO:teuthology.orchestra.run.smithi063.stdout:generic/056 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:01:18.243 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/056 2023-12-04T11:01:18.244 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/056 2023-12-04T11:01:18.244 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:18.257 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:18.306 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:18.306 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-12-04T11:01:18.939 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:18.954 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:18.957 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:18.959 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:18.960 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:19.631 INFO:teuthology.orchestra.run.smithi063.stdout:generic/057 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:01:19.644 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/057 2023-12-04T11:01:19.644 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/057 2023-12-04T11:01:19.646 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:19.655 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:19.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:19.702 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-12-04T11:01:20.339 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:20.356 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:20.358 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:20.361 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:20.361 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:21.302 INFO:teuthology.orchestra.run.smithi063.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:01:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/058 2023-12-04T11:01:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/058 2023-12-04T11:01:21.314 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:21.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:21.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:21.423 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-12-04T11:01:22.204 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:22.218 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:22.220 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:22.223 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:22.223 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:22.925 INFO:teuthology.orchestra.run.smithi063.stdout:generic/059 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:01:22.940 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/059 2023-12-04T11:01:22.941 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/059 2023-12-04T11:01:22.941 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:22.949 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:22.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:22.989 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-12-04T11:01:23.601 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:23.615 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:23.616 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:23.619 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:23.619 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:24.795 INFO:teuthology.orchestra.run.smithi063.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:01:24.810 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/060 2023-12-04T11:01:24.810 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/060 2023-12-04T11:01:24.810 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:24.821 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:25.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:25.007 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-12-04T11:01:25.784 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:25.795 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:25.796 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:25.799 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:26.698 INFO:teuthology.orchestra.run.smithi063.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:01:26.715 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/061 2023-12-04T11:01:26.715 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/061 2023-12-04T11:01:26.715 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:26.728 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:26.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:26.827 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-12-04T11:01:27.492 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:27.506 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:27.507 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:27.510 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:27.511 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:30.793 INFO:teuthology.orchestra.run.smithi063.stdout:generic/062 3s 2023-12-04T11:01:30.834 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/062 2023-12-04T11:01:30.835 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:30.853 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:30.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:30.903 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-12-04T11:01:31.463 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:31.477 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:31.479 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:31.482 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:31.482 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:32.544 INFO:teuthology.orchestra.run.smithi063.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:01:32.557 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/063 2023-12-04T11:01:32.558 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/063 2023-12-04T11:01:32.558 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:32.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:32.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:32.668 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-12-04T11:01:33.362 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:33.375 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:33.376 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:33.380 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:33.380 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:34.124 INFO:teuthology.orchestra.run.smithi063.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T11:01:34.140 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/064 2023-12-04T11:01:34.140 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/064 2023-12-04T11:01:34.141 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:34.154 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:34.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:34.208 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-12-04T11:01:34.845 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:34.861 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:34.862 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:34.866 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:34.866 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:35.591 INFO:teuthology.orchestra.run.smithi063.stdout:generic/065 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:01:35.609 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/065 2023-12-04T11:01:35.609 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/065 2023-12-04T11:01:35.609 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:35.622 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:35.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:35.674 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-12-04T11:01:36.316 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:36.331 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:36.332 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:36.336 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:36.336 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:37.053 INFO:teuthology.orchestra.run.smithi063.stdout:generic/066 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:01:37.067 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/066 2023-12-04T11:01:37.068 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/066 2023-12-04T11:01:37.068 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:37.079 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:37.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:37.122 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-12-04T11:01:37.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:01:37.627 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:01:37.716 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:37.727 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:37.728 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:37.731 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:37.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:38.498 INFO:teuthology.orchestra.run.smithi063.stdout:generic/067 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:01:38.509 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/067 2023-12-04T11:01:38.509 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/067 2023-12-04T11:01:38.509 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:38.518 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:38.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:38.568 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-12-04T11:01:39.260 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:39.274 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:39.276 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:39.279 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:39.279 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:40.036 INFO:teuthology.orchestra.run.smithi063.stdout:generic/068 [not run] ceph does not support freezing 2023-12-04T11:01:40.052 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/068 2023-12-04T11:01:40.053 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/068 2023-12-04T11:01:40.053 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:01:40.066 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:01:40.108 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:01:40.109 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-12-04T11:01:40.752 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:01:40.769 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:01:40.771 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:01:40.776 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:01:40.776 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:01.272 INFO:teuthology.orchestra.run.smithi063.stdout:generic/069 20s 2023-12-04T11:02:01.312 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/069 2023-12-04T11:02:01.312 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:02:01.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:01.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:02:01.394 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-12-04T11:02:01.941 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:02:01.954 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:02:01.955 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:02:01.958 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:02:01.958 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:07.771 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:02:07.782 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:02:37.942 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:02:37.953 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:02:39.938 INFO:teuthology.orchestra.run.smithi063.stdout:generic/070 37s 2023-12-04T11:02:39.960 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/070 2023-12-04T11:02:39.960 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:02:39.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:40.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:02:40.100 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-12-04T11:02:40.869 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:02:40.891 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:02:40.892 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:02:40.897 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:02:40.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:41.547 INFO:teuthology.orchestra.run.smithi063.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-04T11:02:41.559 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/071 2023-12-04T11:02:41.560 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/071 2023-12-04T11:02:41.560 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:02:41.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:41.606 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:02:41.607 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-12-04T11:02:42.217 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:02:42.233 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:02:42.238 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:02:42.243 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:02:42.243 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:43.025 INFO:teuthology.orchestra.run.smithi063.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-04T11:02:43.041 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/072 2023-12-04T11:02:43.041 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/072 2023-12-04T11:02:43.041 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:02:43.052 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:43.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:02:43.103 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-12-04T11:02:43.730 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:02:43.745 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:02:43.748 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:02:43.750 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:02:43.750 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:44.432 INFO:teuthology.orchestra.run.smithi063.stdout:generic/073 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:02:44.440 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/073 2023-12-04T11:02:44.441 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/073 2023-12-04T11:02:44.441 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:02:44.450 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:02:44.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:02:44.493 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-12-04T11:02:45.120 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:02:45.130 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:02:45.132 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:02:45.137 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:02:45.137 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:03:08.140 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:03:08.151 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:03:33.696 INFO:teuthology.orchestra.run.smithi063.stdout:generic/074 48s 2023-12-04T11:03:33.714 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/074 2023-12-04T11:03:33.715 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:03:33.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:03:34.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:03:34.066 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-12-04T11:03:34.838 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:03:34.852 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:03:34.853 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:03:34.857 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:03:34.857 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:03:38.314 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:03:38.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:03:38.456 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T11:03:38.452+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 209115) UID: 0 2023-12-04T11:03:38.456 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T11:03:38.453+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 209115) UID: 0 2023-12-04T11:04:08.166 INFO:teuthology.orchestra.run.smithi063.stdout:generic/075 33s 2023-12-04T11:04:08.190 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/075 2023-12-04T11:04:08.190 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:08.199 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:08.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:08.318 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-12-04T11:04:09.178 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:09.195 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:09.197 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:09.200 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:09.201 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:09.864 INFO:teuthology.orchestra.run.smithi063.stdout:generic/076 [not run] require 172.21.15.63:6789:/scratch to be local device 2023-12-04T11:04:09.877 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/076 2023-12-04T11:04:09.877 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/076 2023-12-04T11:04:09.877 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:09.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:09.928 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:09.928 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-12-04T11:04:10.570 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:10.586 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:10.588 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:10.590 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:10.590 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:15.532 INFO:teuthology.orchestra.run.smithi063.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T11:04:15.546 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/077 2023-12-04T11:04:15.547 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/077 2023-12-04T11:04:15.547 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:15.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:15.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:15.664 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-12-04T11:04:16.523 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:16.542 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:16.543 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:16.546 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:16.546 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:17.308 INFO:teuthology.orchestra.run.smithi063.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-04T11:04:17.324 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/078 2023-12-04T11:04:17.324 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/078 2023-12-04T11:04:17.324 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:17.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:17.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:17.445 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-12-04T11:04:18.279 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:18.297 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:18.299 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:18.303 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:18.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:19.066 INFO:teuthology.orchestra.run.smithi063.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-04T11:04:19.079 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/079 2023-12-04T11:04:19.079 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/079 2023-12-04T11:04:19.079 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:19.089 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:19.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:19.155 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-12-04T11:04:19.837 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:19.849 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:19.850 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:19.854 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:19.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:22.698 INFO:teuthology.orchestra.run.smithi063.stdout:generic/080 2s 2023-12-04T11:04:22.720 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/080 2023-12-04T11:04:22.720 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:22.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:22.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:22.782 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-12-04T11:04:23.464 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:23.482 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:23.485 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:23.487 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:23.487 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:24.443 INFO:teuthology.orchestra.run.smithi063.stdout:generic/081 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:04:24.470 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/081 2023-12-04T11:04:24.470 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/081 2023-12-04T11:04:24.470 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:24.473 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:24.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:24.529 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-12-04T11:04:25.195 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:25.209 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:25.210 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:25.214 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:25.214 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:25.994 INFO:teuthology.orchestra.run.smithi063.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T11:04:26.010 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/082 2023-12-04T11:04:26.011 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/082 2023-12-04T11:04:26.011 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:26.019 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:26.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:26.056 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-12-04T11:04:26.726 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:26.744 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:26.745 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:26.749 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:26.749 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:27.473 INFO:teuthology.orchestra.run.smithi063.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T11:04:27.488 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/083 2023-12-04T11:04:27.488 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/083 2023-12-04T11:04:27.488 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:27.498 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:27.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:27.533 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-12-04T11:04:28.141 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:28.156 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:28.158 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:28.161 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:28.161 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:34.481 INFO:teuthology.orchestra.run.smithi063.stdout:generic/084 6s 2023-12-04T11:04:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/084 2023-12-04T11:04:34.541 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:34.554 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:34.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:34.612 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-12-04T11:04:35.770 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:35.784 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:35.787 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:35.790 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:35.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:36.562 INFO:teuthology.orchestra.run.smithi063.stdout:generic/085 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:04:36.575 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/085 2023-12-04T11:04:36.575 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/085 2023-12-04T11:04:36.576 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:36.588 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:36.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:36.634 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-12-04T11:04:37.318 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:37.332 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:37.334 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:37.338 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:37.338 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:38.031 INFO:teuthology.orchestra.run.smithi063.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:04:38.045 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/086 2023-12-04T11:04:38.046 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/086 2023-12-04T11:04:38.046 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:38.058 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:38.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:38.103 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-12-04T11:04:38.743 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:38.756 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:38.757 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:38.761 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:38.761 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:39.717 INFO:teuthology.orchestra.run.smithi063.stdout:generic/087 0s 2023-12-04T11:04:39.742 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/087 2023-12-04T11:04:39.742 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:39.750 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:39.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:39.884 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-12-04T11:04:40.682 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:40.697 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:40.699 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:40.702 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:40.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:41.519 INFO:teuthology.orchestra.run.smithi063.stdout:generic/088 1s 2023-12-04T11:04:41.543 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/088 2023-12-04T11:04:41.543 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:04:41.552 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:04:41.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:04:41.658 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-12-04T11:04:42.532 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:04:42.550 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:04:42.552 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:04:42.555 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:04:42.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:07:31.256 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:07:31.268 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:08:01.485 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:08:01.495 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:08:31.652 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:08:31.662 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:09:01.808 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:09:01.817 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:09:31.964 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:09:31.975 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:10:02.146 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:10:02.157 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:10:32.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:10:32.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:11:02.501 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:11:02.507 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:11:33.407 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:11:33.421 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:12:03.579 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:12:03.591 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:12:03.694 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T11:12:03.693+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 218242) UID: 0 2023-12-04T11:12:03.694 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T11:12:03.693+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 218242) UID: 0 2023-12-04T11:15:04.525 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:15:04.538 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:15:34.712 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:15:34.727 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:16:04.925 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:16:04.936 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:16:35.074 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:16:35.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:17:05.214 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:17:05.225 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:17:35.369 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:17:35.381 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:18:05.519 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:18:05.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:18:36.496 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:18:36.507 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:19:06.658 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:19:06.664 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:19:36.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:19:36.834 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:20:07.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:20:07.132 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:20:07.250 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T11:20:07.248+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 220467) UID: 0 2023-12-04T11:20:07.250 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T11:20:07.248+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 220467) UID: 0 2023-12-04T11:21:08.994 INFO:teuthology.orchestra.run.smithi063.stdout:generic/089 986s 2023-12-04T11:21:09.010 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/089 2023-12-04T11:21:09.011 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:21:09.018 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:21:09.295 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:21:09.295 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-12-04T11:21:09.911 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:21:09.923 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:21:09.924 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:21:09.927 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:21:09.927 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:21:10.676 INFO:teuthology.orchestra.run.smithi063.stdout:generic/090 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:21:10.688 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/090 2023-12-04T11:21:10.688 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/090 2023-12-04T11:21:10.688 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:21:10.697 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:21:10.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:21:10.741 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-12-04T11:21:11.281 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:21:11.292 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:21:11.294 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:21:11.297 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:21:11.297 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:23:03.920 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:23:03.931 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:23:34.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:23:34.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:24:04.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:24:04.604 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:24:34.743 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:24:34.757 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:25:05.010 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:25:05.021 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:25:22.462 INFO:teuthology.orchestra.run.smithi063.stdout:generic/091 251s 2023-12-04T11:25:22.479 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/091 2023-12-04T11:25:22.479 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:25:22.488 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:22.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:25:22.612 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-12-04T11:25:23.308 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:25:23.322 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:25:23.324 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:25:23.328 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:25:23.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:24.082 INFO:teuthology.orchestra.run.smithi063.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:25:24.096 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/092 2023-12-04T11:25:24.097 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/092 2023-12-04T11:25:24.097 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:25:24.106 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:24.168 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:25:24.168 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-12-04T11:25:24.847 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:25:24.865 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:25:24.867 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:25:24.871 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:25:24.872 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:26.562 INFO:teuthology.orchestra.run.smithi063.stdout:generic/093 1s 2023-12-04T11:25:26.585 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/093 2023-12-04T11:25:26.585 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:25:26.598 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:26.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:25:26.748 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-12-04T11:25:27.422 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:25:27.437 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:25:27.439 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:25:27.442 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:25:27.442 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:28.276 INFO:teuthology.orchestra.run.smithi063.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T11:25:28.291 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/094 2023-12-04T11:25:28.291 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/094 2023-12-04T11:25:28.291 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:25:28.301 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:28.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:25:28.402 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-12-04T11:25:29.090 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:25:29.106 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:25:29.108 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:25:29.113 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:25:29.113 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:35.215 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:25:35.223 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:25:49.888 INFO:teuthology.orchestra.run.smithi063.stdout:generic/095 20s 2023-12-04T11:25:49.914 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/095 2023-12-04T11:25:49.915 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:25:49.924 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:49.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:25:49.954 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-12-04T11:25:50.515 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:25:50.531 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:25:50.532 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:25:50.536 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:25:50.536 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:51.479 INFO:teuthology.orchestra.run.smithi063.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-04T11:25:51.489 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/096 2023-12-04T11:25:51.490 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/096 2023-12-04T11:25:51.490 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:25:51.498 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:51.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:25:51.549 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-12-04T11:25:52.114 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:25:52.128 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:25:52.130 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:25:52.133 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:25:52.133 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:53.524 INFO:teuthology.orchestra.run.smithi063.stdout:generic/097 1s 2023-12-04T11:25:53.537 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/097 2023-12-04T11:25:53.537 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:25:53.543 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:53.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:25:53.571 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-12-04T11:25:54.157 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:25:54.173 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:25:54.176 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:25:54.181 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:25:54.181 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:57.032 INFO:teuthology.orchestra.run.smithi063.stdout:generic/098 3s 2023-12-04T11:25:57.049 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/098 2023-12-04T11:25:57.049 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:25:57.057 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:25:57.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:25:57.085 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-12-04T11:25:57.728 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:25:57.743 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:25:57.745 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:25:57.748 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:25:57.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:00.178 INFO:teuthology.orchestra.run.smithi063.stdout:generic/099 2s 2023-12-04T11:26:00.198 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/099 2023-12-04T11:26:00.198 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:00.206 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:00.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:00.337 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-12-04T11:26:01.045 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:01.059 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:01.061 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:01.066 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:01.066 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:05.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:26:05.363 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:26:35.523 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:26:35.533 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:26:38.223 INFO:teuthology.orchestra.run.smithi063.stdout:generic/100 37s 2023-12-04T11:26:38.242 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/100 2023-12-04T11:26:38.245 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:38.252 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:40.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:40.418 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-12-04T11:26:40.966 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:40.977 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:40.978 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:40.981 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:40.981 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:41.764 INFO:teuthology.orchestra.run.smithi063.stdout:generic/101 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:26:41.780 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/101 2023-12-04T11:26:41.780 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/101 2023-12-04T11:26:41.781 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:41.793 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:41.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:41.843 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-12-04T11:26:42.488 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:42.505 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:42.506 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:42.510 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:42.510 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:43.209 INFO:teuthology.orchestra.run.smithi063.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T11:26:43.223 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/102 2023-12-04T11:26:43.223 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/102 2023-12-04T11:26:43.223 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:43.232 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:43.281 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:43.281 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-12-04T11:26:43.947 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:43.962 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:43.964 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:43.967 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:43.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:44.697 INFO:teuthology.orchestra.run.smithi063.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T11:26:44.708 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/103 2023-12-04T11:26:44.709 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/103 2023-12-04T11:26:44.709 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:44.717 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:44.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:44.836 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-12-04T11:26:45.523 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:45.537 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:45.539 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:45.542 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:45.542 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:46.328 INFO:teuthology.orchestra.run.smithi063.stdout:generic/104 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:26:46.343 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/104 2023-12-04T11:26:46.343 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/104 2023-12-04T11:26:46.343 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:46.354 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:46.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:46.415 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-12-04T11:26:47.066 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:47.081 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:47.083 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:47.086 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:47.086 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:48.365 INFO:teuthology.orchestra.run.smithi063.stdout:generic/105 1s 2023-12-04T11:26:48.401 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/105 2023-12-04T11:26:48.401 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:48.415 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:48.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:48.473 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-12-04T11:26:49.070 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:49.085 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:49.088 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:49.092 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:49.092 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:49.856 INFO:teuthology.orchestra.run.smithi063.stdout:generic/106 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:26:49.872 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/106 2023-12-04T11:26:49.872 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/106 2023-12-04T11:26:49.873 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:49.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:49.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:49.947 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-12-04T11:26:50.594 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:50.610 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:50.611 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:50.614 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:50.615 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:51.315 INFO:teuthology.orchestra.run.smithi063.stdout:generic/107 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:26:51.331 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/107 2023-12-04T11:26:51.332 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/107 2023-12-04T11:26:51.332 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:51.345 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:51.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:51.404 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-12-04T11:26:52.028 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:52.043 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:52.045 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:52.048 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:52.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:53.036 INFO:teuthology.orchestra.run.smithi063.stdout:generic/108 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T11:26:53.053 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/108 2023-12-04T11:26:53.053 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/108 2023-12-04T11:26:53.053 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:26:53.065 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:26:53.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:26:53.114 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-12-04T11:26:53.777 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:26:53.792 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:26:53.794 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:26:53.797 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:26:53.797 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:27:05.585 INFO:teuthology.orchestra.run.smithi063.stdout:generic/109 11s 2023-12-04T11:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/109 2023-12-04T11:27:05.601 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:27:05.609 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:27:05.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:27:05.634 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-12-04T11:27:05.680 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:27:05.687 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:27:06.420 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:27:06.436 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:27:06.440 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:27:06.443 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:27:35.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:27:35.848 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:27:38.887 INFO:teuthology.orchestra.run.smithi063.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T11:27:38.902 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/110 2023-12-04T11:27:38.903 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/110 2023-12-04T11:27:38.903 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:27:38.919 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:27:39.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:27:39.044 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-12-04T11:27:39.724 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:27:39.739 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:27:39.742 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:27:39.746 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:27:39.746 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:27:40.463 INFO:teuthology.orchestra.run.smithi063.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T11:27:40.480 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/111 2023-12-04T11:27:40.481 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/111 2023-12-04T11:27:40.481 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:27:40.497 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:27:40.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:27:40.636 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-12-04T11:27:41.521 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:27:41.532 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:27:41.534 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:27:41.537 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:27:41.537 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:06.725 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:28:06.737 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:28:25.061 INFO:teuthology.orchestra.run.smithi063.stdout:generic/112 44s 2023-12-04T11:28:25.080 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/112 2023-12-04T11:28:25.080 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:28:25.090 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:25.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:28:25.187 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-12-04T11:28:25.878 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:28:25.891 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:28:25.892 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:28:25.895 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:28:25.895 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:36.883 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:28:36.889 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:28:46.053 INFO:teuthology.orchestra.run.smithi063.stdout:generic/113 20s 2023-12-04T11:28:46.073 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/113 2023-12-04T11:28:46.073 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:28:46.085 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:46.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:28:46.178 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-12-04T11:28:46.910 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:28:46.922 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:28:46.923 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:28:46.926 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:28:46.926 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:47.708 INFO:teuthology.orchestra.run.smithi063.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-04T11:28:47.724 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/114 2023-12-04T11:28:47.724 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/114 2023-12-04T11:28:47.724 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:28:47.737 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:47.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:28:47.786 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-12-04T11:28:48.403 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:28:48.417 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:28:48.418 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:28:48.422 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:28:48.422 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:49.166 INFO:teuthology.orchestra.run.smithi063.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T11:28:49.181 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/115 2023-12-04T11:28:49.181 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/115 2023-12-04T11:28:49.182 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:28:49.194 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:49.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:28:49.312 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-12-04T11:28:49.984 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:28:49.997 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:28:49.999 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:28:50.002 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:28:50.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:50.751 INFO:teuthology.orchestra.run.smithi063.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T11:28:50.767 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/116 2023-12-04T11:28:50.767 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/116 2023-12-04T11:28:50.767 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:28:50.780 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:28:50.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:28:50.879 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-12-04T11:28:51.590 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:28:51.604 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:28:51.606 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:28:51.610 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:28:51.610 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:07.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:29:07.102 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:29:20.214 INFO:teuthology.orchestra.run.smithi063.stdout:generic/117 29s 2023-12-04T11:29:20.228 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/117 2023-12-04T11:29:20.229 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:29:20.235 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:20.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:29:20.258 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-12-04T11:29:20.834 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:29:20.852 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:29:20.853 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:29:20.856 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:29:20.857 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:22.521 INFO:teuthology.orchestra.run.smithi063.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T11:29:22.530 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/118 2023-12-04T11:29:22.530 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/118 2023-12-04T11:29:22.531 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:29:22.537 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:22.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:29:22.627 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-12-04T11:29:23.295 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:29:23.310 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:29:23.312 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:29:23.315 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:29:23.315 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:24.063 INFO:teuthology.orchestra.run.smithi063.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T11:29:24.079 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/119 2023-12-04T11:29:24.079 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/119 2023-12-04T11:29:24.079 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:29:24.091 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:24.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:29:24.200 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-12-04T11:29:24.866 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:29:24.880 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:29:24.881 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:29:24.885 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:29:24.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:25.567 INFO:teuthology.orchestra.run.smithi063.stdout:generic/120 [not run] atime not maintained by ceph 2023-12-04T11:29:25.581 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/120 2023-12-04T11:29:25.582 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/120 2023-12-04T11:29:25.582 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:29:25.592 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:25.632 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:29:25.632 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-12-04T11:29:26.270 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:29:26.285 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:29:26.286 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:29:26.290 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:29:26.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:27.025 INFO:teuthology.orchestra.run.smithi063.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-04T11:29:27.041 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/121 2023-12-04T11:29:27.042 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/121 2023-12-04T11:29:27.042 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:29:27.051 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:27.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:29:27.177 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-12-04T11:29:27.844 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:29:27.859 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:29:27.861 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:29:27.863 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:29:27.863 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:28.591 INFO:teuthology.orchestra.run.smithi063.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-04T11:29:28.606 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/122 2023-12-04T11:29:28.606 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/122 2023-12-04T11:29:28.607 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:29:28.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:28.751 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:29:28.751 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-12-04T11:29:29.403 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:29:29.415 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:29:29.416 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:29:29.419 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:29:29.419 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:30.755 INFO:teuthology.orchestra.run.smithi063.stdout:generic/123 1s 2023-12-04T11:29:30.770 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/123 2023-12-04T11:29:30.770 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:29:30.779 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:30.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:29:30.896 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-12-04T11:29:31.571 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:29:31.588 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:29:31.590 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:29:31.594 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:29:31.595 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:37.019 INFO:teuthology.orchestra.run.smithi063.stdout:generic/124 5s 2023-12-04T11:29:37.050 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/124 2023-12-04T11:29:37.052 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:29:37.065 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:29:37.265 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:29:37.278 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:29:37.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:29:37.657 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-12-04T11:29:38.335 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:29:38.345 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:29:38.346 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:29:38.349 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:29:38.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:30:07.469 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:30:07.480 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:30:37.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:30:37.718 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:30:40.318 INFO:teuthology.orchestra.run.smithi063.stdout:generic/125 62s 2023-12-04T11:30:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/125 2023-12-04T11:30:40.336 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:30:40.346 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:30:40.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:30:40.453 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-12-04T11:30:41.111 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:30:41.123 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:30:41.125 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:30:41.128 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:30:41.128 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:30:42.044 INFO:teuthology.orchestra.run.smithi063.stdout:generic/126 1s 2023-12-04T11:30:42.058 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/126 2023-12-04T11:30:42.058 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:30:42.066 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:30:42.195 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:30:42.195 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-12-04T11:30:42.892 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:30:42.905 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:30:42.906 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:30:42.909 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:30:42.909 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:31:07.955 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:31:07.966 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:31:38.112 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:31:38.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:32:08.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:32:08.290 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:32:38.424 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:32:38.436 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:33:08.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:33:08.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:33:38.754 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:33:38.764 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:34:08.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:34:08.922 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:34:39.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:34:39.076 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:35:09.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:35:09.234 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:35:39.370 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:35:39.382 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:36:09.527 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:36:09.539 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:36:39.717 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:36:39.728 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:37:09.873 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:37:09.886 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:37:40.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:37:40.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:38:10.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:38:10.196 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:38:40.350 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:38:40.360 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:39:10.624 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:39:10.636 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:39:40.888 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:39:40.900 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:40:11.042 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:40:11.056 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:40:41.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:40:41.233 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:41:11.366 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:41:11.376 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:41:41.533 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:41:41.544 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:42:11.688 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:42:11.699 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:42:41.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:42:41.854 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:43:11.999 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:43:12.010 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:43:42.147 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:43:42.158 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:44:12.292 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:44:12.304 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:44:42.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:44:42.451 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:45:12.598 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:45:12.609 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:45:42.745 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:45:42.755 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:46:12.895 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:46:12.905 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:46:43.041 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:46:43.052 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:47:13.294 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:47:13.306 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:47:43.436 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:47:43.446 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:48:13.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:48:13.606 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:48:43.759 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:48:43.775 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:49:13.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:49:13.942 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:49:44.090 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:49:44.100 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:50:14.246 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:50:14.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:50:44.417 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:50:44.428 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:51:14.716 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:51:14.727 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:51:45.241 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:51:45.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:52:15.701 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:52:15.714 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:52:45.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:52:45.866 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:53:16.015 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:53:16.026 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:53:46.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:53:46.315 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:54:16.461 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:54:16.471 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:54:46.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:54:46.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:55:16.780 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:55:16.790 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:55:46.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:55:46.948 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:56:17.083 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:56:17.093 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:56:47.276 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:56:47.286 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:57:14.949 INFO:teuthology.orchestra.run.smithi063.stdout:generic/127 1591s 2023-12-04T11:57:14.969 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/127 2023-12-04T11:57:14.969 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:57:14.980 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:57:15.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:57:15.112 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-12-04T11:57:15.825 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:57:15.841 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:57:15.842 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:57:15.846 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:57:15.846 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:57:17.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:57:17.438 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:57:18.167 INFO:teuthology.orchestra.run.smithi063.stdout:generic/128 2s 2023-12-04T11:57:18.182 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/128 2023-12-04T11:57:18.182 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T11:57:18.186 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:57:18.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T11:57:18.208 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-12-04T11:57:18.715 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T11:57:18.728 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T11:57:18.729 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T11:57:18.732 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T11:57:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T11:57:47.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:57:47.594 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:58:17.746 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:58:17.752 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:58:47.892 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:58:47.898 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:59:18.053 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:59:18.063 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T11:59:18.206 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T11:59:18.202+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256557) UID: 0 2023-12-04T11:59:18.207 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T11:59:18.202+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256557) UID: 0 2023-12-04T11:59:18.210 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T11:59:18.202+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256557) UID: 0 2023-12-04T11:59:18.217 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T11:59:18.203+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256557) UID: 0 2023-12-04T11:59:18.225 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T11:59:18.223+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98076) UID: 0 2023-12-04T11:59:18.226 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T11:59:18.223+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98076) UID: 0 2023-12-04T11:59:18.226 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T11:59:18.224+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98076) UID: 0 2023-12-04T11:59:18.226 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T11:59:18.224+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98076) UID: 0 2023-12-04T12:03:31.166 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:03:31.171 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:03:31.322 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T12:03:31.320+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98122) UID: 0 2023-12-04T12:03:31.323 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T12:03:31.320+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98122) UID: 0 2023-12-04T12:03:31.323 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T12:03:31.320+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98122) UID: 0 2023-12-04T12:03:31.323 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T12:03:31.320+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98122) UID: 0 2023-12-04T12:08:13.614 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:08:13.626 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:08:13.824 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T12:08:13.821+0000 7fdcb8c4a640 -1 Fail to open '/proc/98146/cmdline' error = (2) No such file or directory 2023-12-04T12:08:13.824 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T12:08:13.821+0000 7fdcb8c4a640 -1 received signal: Hangup from (PID: 98146) UID: 0 2023-12-04T12:08:13.825 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T12:08:13.821+0000 7f113ab9e640 -1 Fail to open '/proc/98146/cmdline' error = (2) No such file or directory 2023-12-04T12:08:13.826 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T12:08:13.821+0000 7f113ab9e640 -1 received signal: Hangup from (PID: 98146) UID: 0 2023-12-04T12:08:13.832 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T12:08:13.820+0000 7fdfcdee3640 -1 received signal: Hangup from (PID: 98146) UID: 0 2023-12-04T12:08:13.842 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T12:08:13.828+0000 7feca2544640 -1 Fail to open '/proc/98146/cmdline' error = (2) No such file or directory 2023-12-04T12:08:13.842 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T12:08:13.828+0000 7feca2544640 -1 received signal: Hangup from (PID: 98146) UID: 0 2023-12-04T12:12:44.632 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:12:44.641 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:12:44.791 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T12:12:44.788+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256640) UID: 0 2023-12-04T12:12:44.792 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T12:12:44.789+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256640) UID: 0 2023-12-04T12:12:44.792 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T12:12:44.789+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256640) UID: 0 2023-12-04T12:12:44.792 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T12:12:44.789+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 256640) UID: 0 2023-12-04T12:12:44.822 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T12:12:44.819+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98169) UID: 0 2023-12-04T12:12:44.822 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T12:12:44.820+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98169) UID: 0 2023-12-04T12:12:44.822 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T12:12:44.820+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98169) UID: 0 2023-12-04T12:12:44.823 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T12:12:44.820+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 98169) UID: 0 2023-12-04T12:20:21.023 INFO:teuthology.orchestra.run.smithi063.stdout:generic/129 1381s 2023-12-04T12:20:21.860 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/129 2023-12-04T12:20:21.860 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:20:21.874 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:20:21.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:20:21.912 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-12-04T12:20:22.810 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:20:22.823 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:20:22.825 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:20:22.829 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:20:22.829 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:20:50.563 INFO:teuthology.orchestra.run.smithi063.stdout:generic/130 27s 2023-12-04T12:20:50.605 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/130 2023-12-04T12:20:50.605 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:20:50.625 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:20:50.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:20:50.676 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-12-04T12:20:51.253 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:20:51.266 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:20:51.268 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:20:51.270 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:20:51.271 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:20:53.264 INFO:teuthology.orchestra.run.smithi063.stdout:generic/131 2s 2023-12-04T12:20:53.284 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/131 2023-12-04T12:20:53.284 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:20:53.297 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:20:53.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:20:53.438 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-12-04T12:20:54.254 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:20:54.272 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:20:54.274 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:20:54.277 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:20:54.277 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:21:08.428 INFO:teuthology.orchestra.run.smithi063.stdout:generic/132 14s 2023-12-04T12:21:08.510 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/132 2023-12-04T12:21:08.510 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:21:08.522 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:21:08.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:21:08.559 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-12-04T12:21:09.244 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:21:09.260 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:21:09.262 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:21:09.267 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:21:09.267 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:21:28.865 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:21:28.875 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:21:28.989 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T12:21:28.987+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 259001) UID: 0 2023-12-04T12:21:28.989 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T12:21:28.987+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 259001) UID: 0 2023-12-04T12:24:06.794 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T12:24:06.791+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259160) UID: 0 2023-12-04T12:24:06.794 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T12:24:06.791+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259160) UID: 0 2023-12-04T12:24:06.795 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T12:24:06.791+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259160) UID: 0 2023-12-04T12:24:06.795 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T12:24:06.791+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 259160) UID: 0 2023-12-04T12:27:27.275 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:27:27.286 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:27:57.441 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:27:57.454 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:28:27.588 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:28:27.598 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:28:57.745 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:28:57.759 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:29:27.909 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:29:27.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:29:58.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:29:58.077 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:30:28.223 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:30:28.233 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:30:58.370 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:30:58.380 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:31:28.594 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:31:28.604 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:31:45.922 INFO:teuthology.orchestra.run.smithi063.stdout:generic/133 636s 2023-12-04T12:31:45.938 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/133 2023-12-04T12:31:45.938 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:31:45.947 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:46.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:31:46.063 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-12-04T12:31:46.861 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:31:46.871 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:31:46.872 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:31:46.875 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:31:46.875 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:47.719 INFO:teuthology.orchestra.run.smithi063.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:31:47.737 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/134 2023-12-04T12:31:47.737 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/134 2023-12-04T12:31:47.737 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:31:47.749 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:47.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:31:47.921 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-12-04T12:31:48.573 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:31:48.584 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:31:48.586 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:31:48.589 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:31:48.589 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:50.339 INFO:teuthology.orchestra.run.smithi063.stdout:generic/135 2s 2023-12-04T12:31:50.353 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/135 2023-12-04T12:31:50.353 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:31:50.360 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:50.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:31:50.382 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-12-04T12:31:50.976 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:31:50.990 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:31:50.992 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:31:50.996 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:31:50.996 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:51.871 INFO:teuthology.orchestra.run.smithi063.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-04T12:31:51.886 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/136 2023-12-04T12:31:51.886 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/136 2023-12-04T12:31:51.887 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:31:51.899 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:52.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:31:52.068 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-12-04T12:31:52.758 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:31:52.772 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:31:52.774 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:31:52.778 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:31:52.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:53.612 INFO:teuthology.orchestra.run.smithi063.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:31:53.626 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/137 2023-12-04T12:31:53.626 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/137 2023-12-04T12:31:53.626 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:31:53.635 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:53.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:31:53.797 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-12-04T12:31:54.473 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:31:54.484 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:31:54.485 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:31:54.488 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:55.291 INFO:teuthology.orchestra.run.smithi063.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:31:55.308 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/138 2023-12-04T12:31:55.308 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/138 2023-12-04T12:31:55.308 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:31:55.320 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:55.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:31:55.453 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-12-04T12:31:56.155 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:31:56.171 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:31:56.173 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:31:56.176 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:31:56.176 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:56.995 INFO:teuthology.orchestra.run.smithi063.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:31:57.009 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/139 2023-12-04T12:31:57.009 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/139 2023-12-04T12:31:57.009 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:31:57.019 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:57.163 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:31:57.163 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-12-04T12:31:57.848 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:31:57.861 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:31:57.863 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:31:57.866 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:31:57.866 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:58.673 INFO:teuthology.orchestra.run.smithi063.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:31:58.687 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/140 2023-12-04T12:31:58.687 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/140 2023-12-04T12:31:58.687 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:31:58.697 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:31:58.739 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:31:58.761 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:31:58.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:31:58.830 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-12-04T12:31:59.532 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:31:59.544 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:31:59.545 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:31:59.548 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:31:59.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:00.626 INFO:teuthology.orchestra.run.smithi063.stdout:generic/141 1s 2023-12-04T12:32:00.649 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/141 2023-12-04T12:32:00.649 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:00.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:00.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:00.697 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-12-04T12:32:01.365 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:01.381 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:01.383 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:01.387 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:01.387 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:02.202 INFO:teuthology.orchestra.run.smithi063.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:02.215 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/142 2023-12-04T12:32:02.215 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/142 2023-12-04T12:32:02.215 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:02.227 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:02.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:02.389 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-12-04T12:32:03.055 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:03.068 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:03.069 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:03.072 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:03.072 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:03.891 INFO:teuthology.orchestra.run.smithi063.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:03.908 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/143 2023-12-04T12:32:03.908 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/143 2023-12-04T12:32:03.909 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:03.921 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:04.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:04.070 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-12-04T12:32:04.761 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:04.773 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:04.775 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:04.778 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:04.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:05.576 INFO:teuthology.orchestra.run.smithi063.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:05.590 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/144 2023-12-04T12:32:05.590 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/144 2023-12-04T12:32:05.590 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:05.600 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:05.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:05.724 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-12-04T12:32:06.442 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:06.455 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:06.457 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:06.460 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:07.239 INFO:teuthology.orchestra.run.smithi063.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:07.257 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/145 2023-12-04T12:32:07.258 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/145 2023-12-04T12:32:07.258 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:07.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:07.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:07.385 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-12-04T12:32:08.123 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:08.140 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:08.143 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:08.148 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:08.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:08.945 INFO:teuthology.orchestra.run.smithi063.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:08.959 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/146 2023-12-04T12:32:08.959 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/146 2023-12-04T12:32:08.959 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:08.968 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:09.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:09.093 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-12-04T12:32:09.828 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:09.843 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:09.845 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:09.848 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:09.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:10.665 INFO:teuthology.orchestra.run.smithi063.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:10.679 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/147 2023-12-04T12:32:10.680 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/147 2023-12-04T12:32:10.680 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:10.691 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:10.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:10.799 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-12-04T12:32:11.528 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:11.543 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:11.544 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:11.548 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:11.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:12.358 INFO:teuthology.orchestra.run.smithi063.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:12.374 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/148 2023-12-04T12:32:12.375 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/148 2023-12-04T12:32:12.375 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:12.388 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:12.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:12.530 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-12-04T12:32:13.251 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:13.266 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:13.268 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:13.271 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:13.271 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:14.094 INFO:teuthology.orchestra.run.smithi063.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:14.111 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/149 2023-12-04T12:32:14.111 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/149 2023-12-04T12:32:14.112 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:14.124 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:14.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:14.271 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-12-04T12:32:14.983 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:14.998 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:15.000 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:15.004 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:15.004 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:15.925 INFO:teuthology.orchestra.run.smithi063.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:15.941 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/150 2023-12-04T12:32:15.941 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/150 2023-12-04T12:32:15.941 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:15.953 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:16.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:16.110 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-12-04T12:32:16.794 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:16.807 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:16.808 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:16.812 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:16.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:17.601 INFO:teuthology.orchestra.run.smithi063.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:17.614 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/151 2023-12-04T12:32:17.614 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/151 2023-12-04T12:32:17.614 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:17.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:17.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:17.744 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-12-04T12:32:18.439 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:18.451 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:18.453 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:18.456 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:18.456 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:19.227 INFO:teuthology.orchestra.run.smithi063.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:19.241 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/152 2023-12-04T12:32:19.241 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/152 2023-12-04T12:32:19.241 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:19.253 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:19.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:19.390 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-12-04T12:32:20.083 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:20.096 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:20.098 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:20.102 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:20.102 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:20.873 INFO:teuthology.orchestra.run.smithi063.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:20.889 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/153 2023-12-04T12:32:20.889 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/153 2023-12-04T12:32:20.890 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:20.902 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:21.028 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:21.028 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-12-04T12:32:21.727 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:21.741 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:21.743 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:21.747 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:21.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:22.552 INFO:teuthology.orchestra.run.smithi063.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:22.568 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/154 2023-12-04T12:32:22.569 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/154 2023-12-04T12:32:22.569 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:22.581 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:22.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:22.703 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-12-04T12:32:23.411 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:23.427 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:23.428 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:23.432 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:23.432 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:24.225 INFO:teuthology.orchestra.run.smithi063.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:24.239 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/155 2023-12-04T12:32:24.239 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/155 2023-12-04T12:32:24.239 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:24.252 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:24.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:24.387 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-12-04T12:32:25.099 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:25.114 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:25.116 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:25.119 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:25.119 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:25.971 INFO:teuthology.orchestra.run.smithi063.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:25.989 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/156 2023-12-04T12:32:25.989 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/156 2023-12-04T12:32:25.989 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:26.001 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:26.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:26.120 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-12-04T12:32:26.856 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:26.872 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:26.874 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:26.879 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:26.879 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:27.682 INFO:teuthology.orchestra.run.smithi063.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:32:27.695 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/157 2023-12-04T12:32:27.696 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/157 2023-12-04T12:32:27.696 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:27.707 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:27.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:27.821 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-12-04T12:32:28.517 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:28.531 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:28.533 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:28.537 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:28.537 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:29.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:32:29.024 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:32:29.303 INFO:teuthology.orchestra.run.smithi063.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-04T12:32:29.319 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/158 2023-12-04T12:32:29.319 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/158 2023-12-04T12:32:29.320 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:29.332 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:29.468 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:29.468 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-12-04T12:32:30.188 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:30.203 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:30.204 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:30.208 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:30.208 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:31.010 INFO:teuthology.orchestra.run.smithi063.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-04T12:32:31.027 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/159 2023-12-04T12:32:31.027 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/159 2023-12-04T12:32:31.027 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:31.037 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:31.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:31.120 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-12-04T12:32:31.783 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:31.798 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:31.800 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:31.804 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:31.804 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:32.613 INFO:teuthology.orchestra.run.smithi063.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-04T12:32:32.630 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/160 2023-12-04T12:32:32.630 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/160 2023-12-04T12:32:32.630 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:32.643 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:32.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:32.710 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-12-04T12:32:33.378 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:33.394 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:33.396 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:33.400 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:33.400 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:34.525 INFO:teuthology.orchestra.run.smithi063.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/161 2023-12-04T12:32:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/161 2023-12-04T12:32:34.548 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:34.561 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:34.870 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:34.871 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-12-04T12:32:35.400 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:35.416 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:35.417 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:35.421 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:35.421 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:36.500 INFO:teuthology.orchestra.run.smithi063.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-04T12:32:36.631 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/162 2023-12-04T12:32:36.631 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/162 2023-12-04T12:32:36.631 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:36.643 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:36.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:36.974 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-12-04T12:32:37.504 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:37.518 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:37.519 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:37.523 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:37.523 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:38.573 INFO:teuthology.orchestra.run.smithi063.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-04T12:32:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/163 2023-12-04T12:32:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/163 2023-12-04T12:32:38.702 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:38.725 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:39.071 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:39.072 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-12-04T12:32:39.617 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:39.633 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:39.634 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:39.638 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:39.639 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:40.750 INFO:teuthology.orchestra.run.smithi063.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:40.772 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/164 2023-12-04T12:32:40.773 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/164 2023-12-04T12:32:40.773 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:40.789 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:41.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:41.064 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-12-04T12:32:41.603 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:41.619 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:41.620 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:41.624 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:41.624 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:42.745 INFO:teuthology.orchestra.run.smithi063.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:42.767 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/165 2023-12-04T12:32:42.767 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/165 2023-12-04T12:32:42.768 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:42.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:43.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:43.064 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-12-04T12:32:43.574 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:43.588 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:43.590 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:43.593 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:43.593 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:44.779 INFO:teuthology.orchestra.run.smithi063.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:44.807 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/166 2023-12-04T12:32:44.807 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/166 2023-12-04T12:32:44.807 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:44.821 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:45.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:45.056 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-12-04T12:32:45.613 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:45.627 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:45.629 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:45.632 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:45.632 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:46.768 INFO:teuthology.orchestra.run.smithi063.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:46.785 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/167 2023-12-04T12:32:46.787 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/167 2023-12-04T12:32:46.787 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:46.809 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:47.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:47.129 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-12-04T12:32:47.636 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:47.647 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:47.649 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:47.652 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:47.652 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:48.811 INFO:teuthology.orchestra.run.smithi063.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:48.849 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/168 2023-12-04T12:32:48.849 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/168 2023-12-04T12:32:48.849 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:48.862 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:49.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:49.136 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-12-04T12:32:49.654 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:49.669 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:49.671 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:49.675 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:49.675 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:51.114 INFO:teuthology.orchestra.run.smithi063.stdout:generic/169 2s 2023-12-04T12:32:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/169 2023-12-04T12:32:51.133 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:51.143 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:51.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:51.172 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-12-04T12:32:51.855 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:51.872 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:51.874 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:51.879 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:51.879 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:53.023 INFO:teuthology.orchestra.run.smithi063.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:53.046 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/170 2023-12-04T12:32:53.046 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/170 2023-12-04T12:32:53.046 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:53.062 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:53.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:53.334 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-12-04T12:32:53.864 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:53.880 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:53.882 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:53.885 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:53.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:55.049 INFO:teuthology.orchestra.run.smithi063.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:55.074 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/171 2023-12-04T12:32:55.076 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/171 2023-12-04T12:32:55.076 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:55.091 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:55.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:55.371 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-12-04T12:32:55.910 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:55.926 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:55.928 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:55.932 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:55.932 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:57.077 INFO:teuthology.orchestra.run.smithi063.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:57.101 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/172 2023-12-04T12:32:57.102 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/172 2023-12-04T12:32:57.102 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:57.118 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:57.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:57.447 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-12-04T12:32:57.970 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:32:57.984 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:32:57.985 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:32:57.988 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:32:57.989 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:59.118 INFO:teuthology.orchestra.run.smithi063.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/173 2023-12-04T12:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/173 2023-12-04T12:32:59.139 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:32:59.152 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:32:59.171 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:32:59.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:32:59.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:32:59.465 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-12-04T12:32:59.991 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:00.007 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:00.009 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:00.013 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:00.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:01.224 INFO:teuthology.orchestra.run.smithi063.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:01.250 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/174 2023-12-04T12:33:01.250 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/174 2023-12-04T12:33:01.250 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:01.267 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:01.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:01.560 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-12-04T12:33:02.104 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:02.120 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:02.123 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:02.129 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:02.129 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:03.273 INFO:teuthology.orchestra.run.smithi063.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:03.290 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/175 2023-12-04T12:33:03.290 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/175 2023-12-04T12:33:03.290 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:03.303 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:03.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:03.585 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-12-04T12:33:04.112 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:04.126 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:04.128 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:04.131 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:04.132 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:05.347 INFO:teuthology.orchestra.run.smithi063.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:05.371 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/176 2023-12-04T12:33:05.371 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/176 2023-12-04T12:33:05.371 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:05.383 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:05.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:05.702 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-12-04T12:33:06.234 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:06.250 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:06.253 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:06.256 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:06.257 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:07.471 INFO:teuthology.orchestra.run.smithi063.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T12:33:07.487 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/177 2023-12-04T12:33:07.487 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/177 2023-12-04T12:33:07.488 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:07.500 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:07.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:07.637 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-12-04T12:33:08.346 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:08.360 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:08.362 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:08.365 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:08.365 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:09.197 INFO:teuthology.orchestra.run.smithi063.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:33:09.212 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/178 2023-12-04T12:33:09.213 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/178 2023-12-04T12:33:09.213 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:09.225 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:09.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:09.372 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-12-04T12:33:10.026 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:10.039 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:10.041 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:10.044 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:10.044 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:10.773 INFO:teuthology.orchestra.run.smithi063.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:33:10.786 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/179 2023-12-04T12:33:10.787 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/179 2023-12-04T12:33:10.787 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:10.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:10.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:10.908 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-12-04T12:33:11.613 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:11.628 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:11.630 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:11.634 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:11.634 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:12.365 INFO:teuthology.orchestra.run.smithi063.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:33:12.379 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/180 2023-12-04T12:33:12.379 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/180 2023-12-04T12:33:12.379 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:12.390 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:12.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:12.505 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-12-04T12:33:13.213 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:13.228 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:13.229 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:13.233 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:13.233 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:14.033 INFO:teuthology.orchestra.run.smithi063.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:33:14.050 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/181 2023-12-04T12:33:14.050 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/181 2023-12-04T12:33:14.051 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:14.062 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:14.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:14.164 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-12-04T12:33:14.879 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:14.891 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:14.893 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:14.896 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:14.896 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:15.616 INFO:teuthology.orchestra.run.smithi063.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-04T12:33:15.628 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/182 2023-12-04T12:33:15.628 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/182 2023-12-04T12:33:15.629 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:15.638 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:15.759 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:15.759 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-12-04T12:33:16.462 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:16.476 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:16.478 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:16.482 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:16.482 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:17.464 INFO:teuthology.orchestra.run.smithi063.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:17.481 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/183 2023-12-04T12:33:17.481 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/183 2023-12-04T12:33:17.481 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:17.495 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:17.603 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:17.603 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-12-04T12:33:18.217 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:18.232 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:18.234 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:18.238 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:18.239 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:19.053 INFO:teuthology.orchestra.run.smithi063.stdout:generic/184 1s 2023-12-04T12:33:19.073 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/184 2023-12-04T12:33:19.073 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:19.084 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:19.138 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:19.138 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-12-04T12:33:19.769 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:19.783 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:19.784 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:19.788 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:19.788 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:20.810 INFO:teuthology.orchestra.run.smithi063.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:20.825 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/185 2023-12-04T12:33:20.825 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/185 2023-12-04T12:33:20.825 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:20.841 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:21.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:21.019 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-12-04T12:33:21.566 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:21.580 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:21.582 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:21.586 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:21.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:22.573 INFO:teuthology.orchestra.run.smithi063.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:22.590 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/186 2023-12-04T12:33:22.590 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/186 2023-12-04T12:33:22.590 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:22.604 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:22.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:22.896 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-12-04T12:33:23.434 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:23.448 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:23.450 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:23.453 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:23.453 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:24.484 INFO:teuthology.orchestra.run.smithi063.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:24.506 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/187 2023-12-04T12:33:24.506 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/187 2023-12-04T12:33:24.506 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:24.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:24.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:24.811 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-12-04T12:33:25.329 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:25.343 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:25.345 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:25.349 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:25.349 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:26.369 INFO:teuthology.orchestra.run.smithi063.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:26.387 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/188 2023-12-04T12:33:26.388 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/188 2023-12-04T12:33:26.388 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:26.400 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:26.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:26.583 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-12-04T12:33:27.144 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:27.156 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:27.157 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:27.160 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:27.160 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:28.214 INFO:teuthology.orchestra.run.smithi063.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:28.231 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/189 2023-12-04T12:33:28.231 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/189 2023-12-04T12:33:28.231 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:28.242 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:28.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:28.473 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-12-04T12:33:28.995 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:29.007 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:29.009 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:29.012 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:29.012 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:29.393 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:33:29.399 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:33:29.951 INFO:teuthology.orchestra.run.smithi063.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:29.969 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/190 2023-12-04T12:33:29.969 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/190 2023-12-04T12:33:29.970 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:29.982 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:30.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:30.280 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-12-04T12:33:30.790 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:30.804 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:30.805 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:30.809 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:30.809 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:31.865 INFO:teuthology.orchestra.run.smithi063.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:31.887 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/191 2023-12-04T12:33:31.888 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/191 2023-12-04T12:33:31.888 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:31.909 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:32.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:32.102 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-12-04T12:33:32.640 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:32.653 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:32.654 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:32.657 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:32.657 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:33.359 INFO:teuthology.orchestra.run.smithi063.stdout:generic/192 [not run] atime not maintained by ceph 2023-12-04T12:33:33.374 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/192 2023-12-04T12:33:33.374 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/192 2023-12-04T12:33:33.374 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:33.386 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:33.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:33.429 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-12-04T12:33:34.088 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:34.102 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:34.104 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:34.108 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:34.108 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:36.711 INFO:teuthology.orchestra.run.smithi063.stdout:generic/193 2s 2023-12-04T12:33:36.728 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/193 2023-12-04T12:33:36.728 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:36.737 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:36.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:36.871 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-12-04T12:33:37.578 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:37.594 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:37.596 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:37.599 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:37.599 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:38.589 INFO:teuthology.orchestra.run.smithi063.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:38.612 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/194 2023-12-04T12:33:38.613 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/194 2023-12-04T12:33:38.613 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:38.626 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:38.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:38.798 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-12-04T12:33:39.353 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:39.368 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:39.370 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:39.373 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:39.373 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:40.375 INFO:teuthology.orchestra.run.smithi063.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:40.393 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/195 2023-12-04T12:33:40.393 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/195 2023-12-04T12:33:40.393 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:40.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:40.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:40.640 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-12-04T12:33:41.187 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:41.200 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:41.202 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:41.205 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:41.205 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:42.187 INFO:teuthology.orchestra.run.smithi063.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:42.208 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/196 2023-12-04T12:33:42.208 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/196 2023-12-04T12:33:42.208 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:42.222 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:42.383 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:42.383 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-12-04T12:33:42.965 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:42.978 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:42.980 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:42.984 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:42.984 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:44.040 INFO:teuthology.orchestra.run.smithi063.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:44.062 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/197 2023-12-04T12:33:44.063 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/197 2023-12-04T12:33:44.063 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:44.084 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:44.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:44.294 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-12-04T12:33:44.851 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:44.864 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:44.866 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:44.869 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:44.869 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:46.721 INFO:teuthology.orchestra.run.smithi063.stdout:generic/198 1s 2023-12-04T12:33:46.740 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/198 2023-12-04T12:33:46.740 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:46.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:46.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:46.849 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-12-04T12:33:47.547 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:47.560 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:47.562 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:47.565 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:47.565 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:48.505 INFO:teuthology.orchestra.run.smithi063.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:48.523 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/199 2023-12-04T12:33:48.526 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/199 2023-12-04T12:33:48.526 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:48.541 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:48.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:48.692 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-12-04T12:33:49.278 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:49.292 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:49.294 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:49.297 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:49.297 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:50.160 INFO:teuthology.orchestra.run.smithi063.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:50.176 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/200 2023-12-04T12:33:50.176 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/200 2023-12-04T12:33:50.177 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:50.192 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:50.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:50.513 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-12-04T12:33:51.019 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:51.031 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:51.032 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:51.035 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:51.036 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:52.047 INFO:teuthology.orchestra.run.smithi063.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:52.067 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/201 2023-12-04T12:33:52.067 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/201 2023-12-04T12:33:52.067 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:52.079 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:52.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:52.432 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-12-04T12:33:52.927 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:52.942 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:52.943 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:52.946 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:52.946 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:53.991 INFO:teuthology.orchestra.run.smithi063.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:54.008 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/202 2023-12-04T12:33:54.008 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/202 2023-12-04T12:33:54.008 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:54.019 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:54.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:54.177 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-12-04T12:33:54.758 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:54.773 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:54.775 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:54.780 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:54.780 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:55.801 INFO:teuthology.orchestra.run.smithi063.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/203 2023-12-04T12:33:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/203 2023-12-04T12:33:55.823 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:55.836 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:56.047 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:56.047 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-12-04T12:33:56.607 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:56.622 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:56.624 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:56.627 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:56.627 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:58.174 INFO:teuthology.orchestra.run.smithi063.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:33:58.188 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/204 2023-12-04T12:33:58.188 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/204 2023-12-04T12:33:58.189 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:58.200 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:58.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:33:58.251 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-12-04T12:33:58.856 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:33:58.870 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:33:58.872 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:33:58.876 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:33:58.877 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:33:59.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:33:59.558 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:33:59.826 INFO:teuthology.orchestra.run.smithi063.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:33:59.853 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/205 2023-12-04T12:33:59.853 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/205 2023-12-04T12:33:59.853 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:33:59.868 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:34:00.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:34:00.109 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-12-04T12:34:00.642 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:34:00.655 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:34:00.657 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:34:00.661 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:34:00.661 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:34:01.696 INFO:teuthology.orchestra.run.smithi063.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:34:01.725 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/206 2023-12-04T12:34:01.725 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/206 2023-12-04T12:34:01.725 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:34:01.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:34:01.979 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:34:01.980 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-12-04T12:34:02.521 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:34:02.535 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:34:02.536 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:34:02.540 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:34:02.540 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:34:11.331 INFO:teuthology.orchestra.run.smithi063.stdout:generic/207 9s 2023-12-04T12:34:11.349 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/207 2023-12-04T12:34:11.349 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:34:11.358 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:34:11.466 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:34:11.466 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-12-04T12:34:12.178 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:34:12.192 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:34:12.194 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:34:12.198 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:34:12.198 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:34:29.714 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:34:29.720 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:34:59.859 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:34:59.867 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:35:30.301 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:35:30.306 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:36:00.431 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:36:00.442 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:36:30.593 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:36:30.601 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:37:01.723 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:37:01.731 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:37:31.869 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:37:31.880 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:37:33.150 INFO:teuthology.orchestra.run.smithi063.stdout:generic/208 201s 2023-12-04T12:37:33.167 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/208 2023-12-04T12:37:33.167 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:37:33.176 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:37:33.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:37:33.250 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-12-04T12:37:33.963 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:37:33.983 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:37:33.984 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:37:33.987 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:37:33.987 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:02.033 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:38:02.046 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:38:23.854 INFO:teuthology.orchestra.run.smithi063.stdout:generic/209 49s 2023-12-04T12:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/209 2023-12-04T12:38:23.871 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:23.881 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:23.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:23.973 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-12-04T12:38:24.721 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:24.737 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:24.738 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:24.742 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:24.742 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:25.599 INFO:teuthology.orchestra.run.smithi063.stdout:generic/210 1s 2023-12-04T12:38:25.623 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/210 2023-12-04T12:38:25.623 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:25.636 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:25.739 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:25.740 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-12-04T12:38:26.432 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:26.447 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:26.449 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:26.452 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:26.452 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:27.776 INFO:teuthology.orchestra.run.smithi063.stdout:generic/211 1s 2023-12-04T12:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/211 2023-12-04T12:38:27.793 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:27.805 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:27.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:27.847 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-12-04T12:38:28.477 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:28.493 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:28.494 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:28.498 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:28.498 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:29.340 INFO:teuthology.orchestra.run.smithi063.stdout:generic/212 1s 2023-12-04T12:38:29.360 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/212 2023-12-04T12:38:29.360 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:29.370 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:29.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:29.411 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-12-04T12:38:30.055 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:30.070 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:30.072 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:30.076 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:30.076 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:30.747 INFO:teuthology.orchestra.run.smithi063.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:38:30.760 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/213 2023-12-04T12:38:30.760 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/213 2023-12-04T12:38:30.760 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:30.770 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:30.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:30.813 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-12-04T12:38:31.431 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:31.444 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:31.445 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:31.449 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:31.449 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:32.172 INFO:teuthology.orchestra.run.smithi063.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:38:32.183 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/214 2023-12-04T12:38:32.183 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/214 2023-12-04T12:38:32.183 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:32.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:32.231 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-12-04T12:38:32.290 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:38:32.297 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:38:32.831 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:32.848 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:32.850 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:32.853 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:32.854 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:35.702 INFO:teuthology.orchestra.run.smithi063.stdout:generic/215 2s 2023-12-04T12:38:35.727 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/215 2023-12-04T12:38:35.727 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:35.739 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:35.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:35.823 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-12-04T12:38:36.451 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:36.466 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:36.469 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:36.472 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:36.472 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:37.515 INFO:teuthology.orchestra.run.smithi063.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:38:37.532 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/216 2023-12-04T12:38:37.532 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/216 2023-12-04T12:38:37.532 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:37.552 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:37.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:37.687 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-12-04T12:38:38.268 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:38.281 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:38.283 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:38.286 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:38.286 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:39.303 INFO:teuthology.orchestra.run.smithi063.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:38:39.324 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/217 2023-12-04T12:38:39.324 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/217 2023-12-04T12:38:39.325 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:39.343 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:39.551 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:39.551 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-12-04T12:38:40.117 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:40.131 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:40.132 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:40.135 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:40.135 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:41.189 INFO:teuthology.orchestra.run.smithi063.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:38:41.206 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/218 2023-12-04T12:38:41.206 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/218 2023-12-04T12:38:41.207 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:41.242 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:41.523 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:41.523 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-12-04T12:38:42.071 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:42.087 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:42.089 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:42.094 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:42.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:42.740 INFO:teuthology.orchestra.run.smithi063.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:38:42.752 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/219 2023-12-04T12:38:42.752 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/219 2023-12-04T12:38:42.752 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:42.761 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:42.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:42.799 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-12-04T12:38:43.389 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:43.403 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:43.404 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:43.408 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:43.408 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:44.405 INFO:teuthology.orchestra.run.smithi063.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:38:44.421 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/220 2023-12-04T12:38:44.421 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/220 2023-12-04T12:38:44.422 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:44.441 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:44.726 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:44.726 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-12-04T12:38:45.242 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:45.256 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:45.257 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:45.260 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:45.260 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:47.007 INFO:teuthology.orchestra.run.smithi063.stdout:generic/221 1s 2023-12-04T12:38:47.023 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/221 2023-12-04T12:38:47.024 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:47.032 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:47.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:47.081 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-12-04T12:38:47.708 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:47.725 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:47.727 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:47.730 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:47.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:48.751 INFO:teuthology.orchestra.run.smithi063.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:38:48.775 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/222 2023-12-04T12:38:48.775 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/222 2023-12-04T12:38:48.775 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:48.785 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:48.997 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:48.997 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-12-04T12:38:49.558 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:49.572 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:49.574 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:49.578 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:49.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:50.227 INFO:teuthology.orchestra.run.smithi063.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:38:50.241 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/223 2023-12-04T12:38:50.241 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/223 2023-12-04T12:38:50.241 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:50.250 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:50.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:50.293 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-12-04T12:38:50.920 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:50.937 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:50.939 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:50.944 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:50.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:51.576 INFO:teuthology.orchestra.run.smithi063.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:38:51.590 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/224 2023-12-04T12:38:51.590 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/224 2023-12-04T12:38:51.590 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:51.600 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:51.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:51.641 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-12-04T12:38:52.290 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:52.305 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:52.308 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:52.313 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:52.313 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:53.096 INFO:teuthology.orchestra.run.smithi063.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T12:38:53.112 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/225 2023-12-04T12:38:53.112 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/225 2023-12-04T12:38:53.112 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:53.125 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:53.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:53.234 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-12-04T12:38:53.940 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:53.954 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:53.956 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:53.959 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:53.959 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:54.721 INFO:teuthology.orchestra.run.smithi063.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:38:54.738 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/226 2023-12-04T12:38:54.738 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/226 2023-12-04T12:38:54.738 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:54.750 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:54.788 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:54.789 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-12-04T12:38:55.425 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:55.442 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:55.443 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:55.447 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:55.447 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:56.449 INFO:teuthology.orchestra.run.smithi063.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:38:56.465 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/227 2023-12-04T12:38:56.466 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/227 2023-12-04T12:38:56.466 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:56.479 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:56.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:56.649 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-12-04T12:38:57.229 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:57.243 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:57.245 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:57.249 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:57.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:57.977 INFO:teuthology.orchestra.run.smithi063.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:38:57.993 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/228 2023-12-04T12:38:57.993 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/228 2023-12-04T12:38:57.993 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:58.006 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:58.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:38:58.053 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-12-04T12:38:58.719 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:38:58.735 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:38:58.737 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:38:58.740 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:38:58.740 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:38:59.723 INFO:teuthology.orchestra.run.smithi063.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:38:59.740 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/229 2023-12-04T12:38:59.740 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/229 2023-12-04T12:38:59.740 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:38:59.753 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:00.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:00.080 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-12-04T12:39:00.577 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:00.591 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:00.593 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:00.597 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:00.597 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:01.271 INFO:teuthology.orchestra.run.smithi063.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:39:01.284 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/230 2023-12-04T12:39:01.285 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/230 2023-12-04T12:39:01.285 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:01.294 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:01.345 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:01.346 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-12-04T12:39:02.003 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:02.017 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:02.019 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:02.022 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:02.022 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:02.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:39:02.453 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:39:02.554 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T12:39:02.553+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 305732) UID: 0 2023-12-04T12:39:02.554 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T12:39:02.553+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 305732) UID: 0 2023-12-04T12:39:02.555 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T12:39:02.553+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 305732) UID: 0 2023-12-04T12:39:02.555 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T12:39:02.553+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 305732) UID: 0 2023-12-04T12:39:02.639 INFO:teuthology.orchestra.run.smithi063.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:39:02.650 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/231 2023-12-04T12:39:02.650 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/231 2023-12-04T12:39:02.650 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:02.659 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:02.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:02.694 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-12-04T12:39:03.270 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:03.284 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:03.286 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:03.289 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:03.289 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:03.885 INFO:teuthology.orchestra.run.smithi063.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:39:03.898 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/232 2023-12-04T12:39:03.898 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/232 2023-12-04T12:39:03.899 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:03.910 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:03.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:03.949 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-12-04T12:39:04.509 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:04.521 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:04.523 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:04.526 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:04.526 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:05.087 INFO:teuthology.orchestra.run.smithi063.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:39:05.100 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/233 2023-12-04T12:39:05.100 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/233 2023-12-04T12:39:05.100 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:05.109 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:05.143 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:05.143 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-12-04T12:39:05.706 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:05.719 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:05.721 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:05.725 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:05.725 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:06.298 INFO:teuthology.orchestra.run.smithi063.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:39:06.310 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/234 2023-12-04T12:39:06.310 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/234 2023-12-04T12:39:06.310 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:06.317 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:06.349 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:06.349 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-12-04T12:39:06.895 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:06.907 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:06.909 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:06.912 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:07.479 INFO:teuthology.orchestra.run.smithi063.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:39:07.491 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/235 2023-12-04T12:39:07.491 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/235 2023-12-04T12:39:07.491 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:07.500 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:07.532 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:07.533 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-12-04T12:39:08.095 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:08.107 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:08.108 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:08.111 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:08.111 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:09.839 INFO:teuthology.orchestra.run.smithi063.stdout:generic/236 1s 2023-12-04T12:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/236 2023-12-04T12:39:09.853 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:09.860 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:09.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:09.940 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-12-04T12:39:10.643 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:10.656 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:10.658 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:10.661 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:10.661 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:11.423 INFO:teuthology.orchestra.run.smithi063.stdout:generic/237 1s 2023-12-04T12:39:11.440 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/237 2023-12-04T12:39:11.440 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:11.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:11.555 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:11.555 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-12-04T12:39:12.263 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:12.276 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:12.277 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:12.280 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:12.280 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:13.186 INFO:teuthology.orchestra.run.smithi063.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:39:13.197 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/238 2023-12-04T12:39:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/238 2023-12-04T12:39:13.198 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:39:13.210 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:39:13.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:39:13.468 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-12-04T12:39:13.989 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:39:13.999 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:39:14.001 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:39:14.003 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:39:14.003 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:41:21.865 INFO:teuthology.orchestra.run.smithi063.stdout:generic/239 127s 2023-12-04T12:41:21.878 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/239 2023-12-04T12:41:21.878 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:41:21.884 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:41:21.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:41:21.958 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-12-04T12:41:22.710 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:41:22.723 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:41:22.725 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:41:22.728 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:41:22.728 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:41:24.316 INFO:teuthology.orchestra.run.smithi063.stdout:generic/240 2s 2023-12-04T12:41:24.345 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/240 2023-12-04T12:41:24.345 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:41:24.357 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:41:24.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:41:24.453 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-12-04T12:41:25.163 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:41:25.176 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:41:25.177 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:41:25.180 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:41:25.181 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:27.936 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:42:27.946 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:42:39.511 INFO:teuthology.orchestra.run.smithi063.stdout:generic/241 74s 2023-12-04T12:42:39.529 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/241 2023-12-04T12:42:39.529 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:42:39.539 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:40.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:42:40.287 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-12-04T12:42:41.035 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:42:41.055 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:42:41.057 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:42:41.065 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:42:41.065 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:42.196 INFO:teuthology.orchestra.run.smithi063.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:42:42.212 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/242 2023-12-04T12:42:42.212 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/242 2023-12-04T12:42:42.212 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:42:42.224 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:42.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:42:42.491 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-12-04T12:42:42.995 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:42:43.008 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:42:43.010 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:42:43.012 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:42:43.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:44.024 INFO:teuthology.orchestra.run.smithi063.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:42:44.037 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/243 2023-12-04T12:42:44.037 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/243 2023-12-04T12:42:44.038 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:42:44.054 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:44.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:42:44.269 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-12-04T12:42:44.883 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:42:44.899 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:42:44.900 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:42:44.904 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:42:44.905 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:45.590 INFO:teuthology.orchestra.run.smithi063.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:42:45.604 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/244 2023-12-04T12:42:45.605 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/244 2023-12-04T12:42:45.605 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:42:45.617 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:45.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:42:45.663 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-12-04T12:42:46.306 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:42:46.322 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:42:46.324 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:42:46.328 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:42:46.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:47.141 INFO:teuthology.orchestra.run.smithi063.stdout:generic/245 1s 2023-12-04T12:42:47.160 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/245 2023-12-04T12:42:47.160 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:42:47.169 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:47.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:42:47.290 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-12-04T12:42:47.974 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:42:47.988 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:42:47.989 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:42:47.992 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:42:47.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:48.796 INFO:teuthology.orchestra.run.smithi063.stdout:generic/246 0s 2023-12-04T12:42:48.814 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/246 2023-12-04T12:42:48.814 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:42:48.823 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:48.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:42:48.942 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-12-04T12:42:49.645 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:42:49.658 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:42:49.660 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:42:49.663 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:42:49.663 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:42:58.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:42:58.310 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:43:02.991 INFO:teuthology.orchestra.run.smithi063.stdout:generic/247 13s 2023-12-04T12:43:03.005 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/247 2023-12-04T12:43:03.006 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:03.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:03.036 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:03.037 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-12-04T12:43:03.648 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:03.660 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:03.661 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:03.664 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:03.665 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:04.424 INFO:teuthology.orchestra.run.smithi063.stdout:generic/248 1s 2023-12-04T12:43:04.443 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/248 2023-12-04T12:43:04.443 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:04.453 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:04.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:04.502 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-12-04T12:43:05.131 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:05.146 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:05.148 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:05.152 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:05.152 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:06.345 INFO:teuthology.orchestra.run.smithi063.stdout:generic/249 1s 2023-12-04T12:43:06.362 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/249 2023-12-04T12:43:06.362 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:06.371 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:06.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:06.504 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-12-04T12:43:07.234 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:07.249 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:07.250 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:07.254 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:07.254 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:08.025 INFO:teuthology.orchestra.run.smithi063.stdout:generic/250 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:43:08.042 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/250 2023-12-04T12:43:08.042 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/250 2023-12-04T12:43:08.042 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:08.054 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:08.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:08.107 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-12-04T12:43:08.763 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:08.778 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:08.780 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:08.784 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:08.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:09.655 INFO:teuthology.orchestra.run.smithi063.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:09.682 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/251 2023-12-04T12:43:09.682 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/251 2023-12-04T12:43:09.682 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:09.691 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:09.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:09.727 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-12-04T12:43:10.342 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:10.357 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:10.359 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:10.362 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:10.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:11.091 INFO:teuthology.orchestra.run.smithi063.stdout:generic/252 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:43:11.105 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/252 2023-12-04T12:43:11.105 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/252 2023-12-04T12:43:11.105 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:11.116 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:11.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:11.156 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-12-04T12:43:11.776 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:11.791 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:11.792 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:11.796 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:11.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:12.887 INFO:teuthology.orchestra.run.smithi063.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:43:12.908 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/253 2023-12-04T12:43:12.908 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/253 2023-12-04T12:43:12.908 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:12.921 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:13.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:13.210 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-12-04T12:43:13.756 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:13.772 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:13.774 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:13.777 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:13.778 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:14.884 INFO:teuthology.orchestra.run.smithi063.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:43:14.901 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/254 2023-12-04T12:43:14.901 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/254 2023-12-04T12:43:14.902 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:14.914 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:15.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:15.212 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-12-04T12:43:15.733 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:15.749 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:15.751 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:15.755 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:15.755 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:16.723 INFO:teuthology.orchestra.run.smithi063.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:43:16.735 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/255 2023-12-04T12:43:16.736 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/255 2023-12-04T12:43:16.736 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:16.745 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:16.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:16.843 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-12-04T12:43:17.564 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:17.578 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:17.580 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:17.583 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:17.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:19.312 INFO:teuthology.orchestra.run.smithi063.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:43:19.329 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/256 2023-12-04T12:43:19.329 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/256 2023-12-04T12:43:19.329 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:19.342 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:19.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:19.388 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-12-04T12:43:20.052 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:20.064 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:20.066 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:20.069 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:20.069 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:21.936 INFO:teuthology.orchestra.run.smithi063.stdout:generic/257 1s 2023-12-04T12:43:21.956 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/257 2023-12-04T12:43:21.956 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:21.967 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:22.073 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:22.073 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-12-04T12:43:22.729 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:22.742 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:22.743 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:22.747 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:22.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:23.349 INFO:teuthology.orchestra.run.smithi063.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-12-04T12:43:23.361 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/258 2023-12-04T12:43:23.361 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/258 2023-12-04T12:43:23.361 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:23.369 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:23.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:23.437 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-12-04T12:43:24.077 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:24.093 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:24.094 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:24.098 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:24.098 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:25.135 INFO:teuthology.orchestra.run.smithi063.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:43:25.152 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/259 2023-12-04T12:43:25.152 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/259 2023-12-04T12:43:25.152 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:25.165 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:25.426 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:25.427 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-12-04T12:43:25.977 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:25.993 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:25.995 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:25.998 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:25.998 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:26.905 INFO:teuthology.orchestra.run.smithi063.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:26.929 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/260 2023-12-04T12:43:26.930 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/260 2023-12-04T12:43:26.930 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:26.939 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:26.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:26.978 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-12-04T12:43:27.615 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:27.631 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:27.633 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:27.637 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:27.637 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:28.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:43:28.459 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:43:28.640 INFO:teuthology.orchestra.run.smithi063.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:43:28.657 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/261 2023-12-04T12:43:28.657 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/261 2023-12-04T12:43:28.657 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:28.670 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:28.968 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:28.969 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-12-04T12:43:29.503 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:29.516 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:29.518 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:29.521 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:29.522 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:30.556 INFO:teuthology.orchestra.run.smithi063.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:43:30.579 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/262 2023-12-04T12:43:30.579 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/262 2023-12-04T12:43:30.580 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:43:30.593 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:30.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:43:30.824 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-12-04T12:43:31.370 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:43:31.381 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:43:31.383 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:43:31.385 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:43:31.385 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:43:58.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:43:58.632 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:44:28.763 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:44:28.774 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:44:58.915 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:44:58.925 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:45:08.738 INFO:teuthology.orchestra.run.smithi063.stdout:generic/263 97s 2023-12-04T12:45:08.756 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/263 2023-12-04T12:45:08.756 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:08.765 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:08.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:08.903 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-12-04T12:45:09.627 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:09.643 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:09.646 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:09.651 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:09.651 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:10.713 INFO:teuthology.orchestra.run.smithi063.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:10.734 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/264 2023-12-04T12:45:10.735 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/264 2023-12-04T12:45:10.735 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:10.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:11.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:11.069 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-12-04T12:45:11.565 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:11.578 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:11.579 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:11.582 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:11.582 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:12.772 INFO:teuthology.orchestra.run.smithi063.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:12.795 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/265 2023-12-04T12:45:12.798 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/265 2023-12-04T12:45:12.798 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:12.812 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:13.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:13.017 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-12-04T12:45:13.544 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:13.559 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:13.561 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:13.564 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:13.565 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:14.701 INFO:teuthology.orchestra.run.smithi063.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:14.718 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/266 2023-12-04T12:45:14.718 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/266 2023-12-04T12:45:14.718 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:14.731 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:14.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:14.984 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-12-04T12:45:15.534 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:15.549 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:15.551 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:15.555 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:15.555 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:16.704 INFO:teuthology.orchestra.run.smithi063.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:16.723 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/267 2023-12-04T12:45:16.723 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/267 2023-12-04T12:45:16.723 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:16.736 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:16.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:16.998 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-12-04T12:45:17.527 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:17.541 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:17.543 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:17.547 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:17.547 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:18.694 INFO:teuthology.orchestra.run.smithi063.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:18.715 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/268 2023-12-04T12:45:18.716 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/268 2023-12-04T12:45:18.716 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:18.733 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:18.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:18.857 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-12-04T12:45:19.455 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:19.471 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:19.474 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:19.478 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:19.478 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:20.232 INFO:teuthology.orchestra.run.smithi063.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:45:20.248 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/269 2023-12-04T12:45:20.248 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/269 2023-12-04T12:45:20.248 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:20.261 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:20.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:20.315 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-12-04T12:45:20.955 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:20.970 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:20.972 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:20.976 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:20.976 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:21.645 INFO:teuthology.orchestra.run.smithi063.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:45:21.659 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/270 2023-12-04T12:45:21.660 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/270 2023-12-04T12:45:21.660 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:21.671 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:21.723 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:21.723 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-12-04T12:45:22.395 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:22.410 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:22.412 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:22.416 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:22.416 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:23.586 INFO:teuthology.orchestra.run.smithi063.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:23.603 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/271 2023-12-04T12:45:23.603 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/271 2023-12-04T12:45:23.603 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:23.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:23.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:23.784 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-12-04T12:45:24.354 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:24.370 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:24.372 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:24.376 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:24.376 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:25.566 INFO:teuthology.orchestra.run.smithi063.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:25.589 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/272 2023-12-04T12:45:25.589 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/272 2023-12-04T12:45:25.589 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:25.601 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:25.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:25.837 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-12-04T12:45:26.394 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:26.407 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:26.408 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:26.412 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:26.412 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:27.147 INFO:teuthology.orchestra.run.smithi063.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:45:27.161 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/273 2023-12-04T12:45:27.161 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/273 2023-12-04T12:45:27.161 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:27.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:27.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:27.233 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-12-04T12:45:27.887 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:27.900 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:27.902 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:27.905 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:27.906 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:28.666 INFO:teuthology.orchestra.run.smithi063.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-04T12:45:28.680 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/274 2023-12-04T12:45:28.680 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/274 2023-12-04T12:45:28.680 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:28.690 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:28.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:28.756 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-12-04T12:45:29.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:45:29.082 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:45:29.371 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:29.388 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:29.389 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:29.393 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:29.393 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:30.108 INFO:teuthology.orchestra.run.smithi063.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:45:30.123 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/275 2023-12-04T12:45:30.123 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/275 2023-12-04T12:45:30.123 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:30.135 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:30.187 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:30.187 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-12-04T12:45:30.850 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:30.866 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:30.868 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:30.872 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:30.872 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:32.018 INFO:teuthology.orchestra.run.smithi063.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:32.041 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/276 2023-12-04T12:45:32.041 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/276 2023-12-04T12:45:32.041 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:32.058 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:32.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:32.318 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-12-04T12:45:32.843 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:32.857 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:32.859 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:32.862 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:32.862 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:33.638 INFO:teuthology.orchestra.run.smithi063.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-12-04T12:45:33.653 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/277 2023-12-04T12:45:33.654 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/277 2023-12-04T12:45:33.654 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:33.666 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:33.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:33.739 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-12-04T12:45:34.413 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:34.428 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:34.429 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:34.433 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:34.433 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:35.600 INFO:teuthology.orchestra.run.smithi063.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:35.617 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/278 2023-12-04T12:45:35.618 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/278 2023-12-04T12:45:35.618 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:35.631 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:35.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:35.821 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-12-04T12:45:36.377 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:36.391 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:36.393 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:36.397 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:36.397 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:37.583 INFO:teuthology.orchestra.run.smithi063.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:37.600 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/279 2023-12-04T12:45:37.600 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/279 2023-12-04T12:45:37.600 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:37.613 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:37.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:37.866 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-12-04T12:45:38.376 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:38.390 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:38.392 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:38.395 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:38.395 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:39.137 INFO:teuthology.orchestra.run.smithi063.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:45:39.153 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/280 2023-12-04T12:45:39.153 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/280 2023-12-04T12:45:39.153 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:39.167 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:39.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:39.218 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-12-04T12:45:39.863 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:39.880 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:39.882 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:39.886 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:39.887 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:41.067 INFO:teuthology.orchestra.run.smithi063.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:41.084 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/281 2023-12-04T12:45:41.084 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/281 2023-12-04T12:45:41.085 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:41.097 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:41.350 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:41.350 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-12-04T12:45:41.874 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:41.889 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:41.892 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:41.896 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:41.896 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:43.063 INFO:teuthology.orchestra.run.smithi063.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:43.079 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/282 2023-12-04T12:45:43.080 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/282 2023-12-04T12:45:43.080 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:43.092 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:43.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:43.368 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-12-04T12:45:43.890 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:43.905 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:43.907 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:43.911 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:43.911 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:45.116 INFO:teuthology.orchestra.run.smithi063.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:45.133 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/283 2023-12-04T12:45:45.133 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/283 2023-12-04T12:45:45.133 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:45.146 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:45.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:45.363 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-12-04T12:45:45.911 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:45.928 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:45.930 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:45.935 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:45.935 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:46.984 INFO:teuthology.orchestra.run.smithi063.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:47.002 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/284 2023-12-04T12:45:47.002 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/284 2023-12-04T12:45:47.002 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:47.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:47.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:47.355 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-12-04T12:45:47.870 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:47.886 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:47.889 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:47.893 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:47.893 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:51.380 INFO:teuthology.orchestra.run.smithi063.stdout:generic/285 3s 2023-12-04T12:45:51.396 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/285 2023-12-04T12:45:51.397 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:51.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:51.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:51.927 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-12-04T12:45:52.721 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:52.736 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:52.738 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:52.741 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:52.741 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:53.378 INFO:teuthology.orchestra.run.smithi063.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:45:53.392 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/286 2023-12-04T12:45:53.392 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/286 2023-12-04T12:45:53.392 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:53.405 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:53.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:53.448 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-12-04T12:45:54.084 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:54.100 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:54.101 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:54.104 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:54.105 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:55.024 INFO:teuthology.orchestra.run.smithi063.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:55.040 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/287 2023-12-04T12:45:55.041 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/287 2023-12-04T12:45:55.041 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:55.052 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:55.261 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:55.261 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-12-04T12:45:55.925 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:55.943 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:55.943 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:55.947 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:55.947 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:56.761 INFO:teuthology.orchestra.run.smithi063.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:56.781 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/288 2023-12-04T12:45:56.781 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/288 2023-12-04T12:45:56.782 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:56.790 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:56.824 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:56.824 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-12-04T12:45:57.346 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:57.361 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:57.363 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:57.367 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:57.367 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:58.352 INFO:teuthology.orchestra.run.smithi063.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:45:58.368 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/289 2023-12-04T12:45:58.368 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/289 2023-12-04T12:45:58.369 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:45:58.382 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:58.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:45:58.612 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-12-04T12:45:59.170 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:45:59.184 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:45:59.185 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:45:59.188 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:45:59.188 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:45:59.224 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:45:59.232 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:45:59.362 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T12:45:59.360+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99613) UID: 0 2023-12-04T12:45:59.363 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T12:45:59.360+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99613) UID: 0 2023-12-04T12:45:59.363 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T12:45:59.360+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99613) UID: 0 2023-12-04T12:45:59.363 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T12:45:59.360+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99613) UID: 0 2023-12-04T12:46:00.123 INFO:teuthology.orchestra.run.smithi063.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:00.141 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/290 2023-12-04T12:46:00.141 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/290 2023-12-04T12:46:00.141 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:00.153 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:00.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:00.384 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-12-04T12:46:00.987 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:01.002 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:01.004 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:01.007 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:01.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:02.064 INFO:teuthology.orchestra.run.smithi063.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/291 2023-12-04T12:46:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/291 2023-12-04T12:46:02.085 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:02.103 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:02.329 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:02.329 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-12-04T12:46:02.848 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:02.862 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:02.865 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:02.866 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:02.867 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:03.916 INFO:teuthology.orchestra.run.smithi063.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:03.934 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/292 2023-12-04T12:46:03.934 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/292 2023-12-04T12:46:03.934 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:03.946 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:04.145 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:04.145 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-12-04T12:46:04.717 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:04.734 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:04.736 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:04.740 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:04.740 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:05.786 INFO:teuthology.orchestra.run.smithi063.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:05.804 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/293 2023-12-04T12:46:05.804 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/293 2023-12-04T12:46:05.804 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:05.817 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:05.946 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:05.946 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-12-04T12:46:06.539 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:06.551 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:06.553 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:06.556 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:06.556 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:07.757 INFO:teuthology.orchestra.run.smithi063.stdout:generic/294 1s 2023-12-04T12:46:07.796 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/294 2023-12-04T12:46:07.797 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:07.809 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:07.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:07.849 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-12-04T12:46:08.421 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:08.435 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:08.436 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:08.440 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:08.440 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:09.476 INFO:teuthology.orchestra.run.smithi063.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:09.499 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/295 2023-12-04T12:46:09.500 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/295 2023-12-04T12:46:09.500 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:09.511 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:09.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:09.773 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-12-04T12:46:10.312 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:10.325 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:10.327 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:10.331 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:10.331 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:11.370 INFO:teuthology.orchestra.run.smithi063.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:11.390 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/296 2023-12-04T12:46:11.390 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/296 2023-12-04T12:46:11.391 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:11.403 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:11.655 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:11.655 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-12-04T12:46:12.211 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:12.224 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:12.226 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:12.230 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:12.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:13.240 INFO:teuthology.orchestra.run.smithi063.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:13.257 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/297 2023-12-04T12:46:13.258 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/297 2023-12-04T12:46:13.258 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:13.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:13.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:13.413 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-12-04T12:46:13.976 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:13.988 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:13.989 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:13.992 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:13.992 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:14.986 INFO:teuthology.orchestra.run.smithi063.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:15.007 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/298 2023-12-04T12:46:15.007 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/298 2023-12-04T12:46:15.008 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:15.020 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:15.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:15.221 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-12-04T12:46:15.765 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:15.778 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:15.780 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:15.784 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:15.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:16.608 INFO:teuthology.orchestra.run.smithi063.stdout:generic/299 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:46:16.622 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/299 2023-12-04T12:46:16.622 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/299 2023-12-04T12:46:16.622 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:16.632 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:16.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:16.676 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-12-04T12:46:17.304 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:17.318 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:17.320 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:17.323 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:17.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:18.090 INFO:teuthology.orchestra.run.smithi063.stdout:generic/300 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:46:18.106 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/300 2023-12-04T12:46:18.106 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/300 2023-12-04T12:46:18.107 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:18.118 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:18.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:18.162 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-12-04T12:46:18.808 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:18.822 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:18.823 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:18.827 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:18.827 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:19.857 INFO:teuthology.orchestra.run.smithi063.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:19.875 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/301 2023-12-04T12:46:19.875 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/301 2023-12-04T12:46:19.875 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:19.887 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:20.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:20.133 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-12-04T12:46:20.682 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:20.698 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:20.700 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:20.703 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:20.703 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:21.654 INFO:teuthology.orchestra.run.smithi063.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:21.674 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/302 2023-12-04T12:46:21.674 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/302 2023-12-04T12:46:21.675 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:21.687 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:21.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:21.925 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-12-04T12:46:22.470 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:22.481 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:22.483 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:22.487 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:22.487 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:23.242 INFO:teuthology.orchestra.run.smithi063.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:46:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/303 2023-12-04T12:46:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/303 2023-12-04T12:46:23.255 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:23.266 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:23.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:23.374 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-12-04T12:46:24.079 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:24.095 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:24.096 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:24.099 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:24.099 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:24.858 INFO:teuthology.orchestra.run.smithi063.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-04T12:46:24.871 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/304 2023-12-04T12:46:24.872 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/304 2023-12-04T12:46:24.872 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:24.884 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:25.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:25.004 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-12-04T12:46:25.693 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:25.706 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:25.708 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:25.711 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:25.711 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:26.729 INFO:teuthology.orchestra.run.smithi063.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:46:26.755 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/305 2023-12-04T12:46:26.755 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/305 2023-12-04T12:46:26.756 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:26.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:26.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:26.965 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-12-04T12:46:27.529 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:27.541 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:27.543 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:27.547 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:27.547 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:28.843 INFO:teuthology.orchestra.run.smithi063.stdout:generic/306 1s 2023-12-04T12:46:28.888 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/306 2023-12-04T12:46:28.888 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:28.903 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:29.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:29.147 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-12-04T12:46:29.868 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:29.880 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:29.882 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:29.884 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:29.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:32.350 INFO:teuthology.orchestra.run.smithi063.stdout:generic/307 2s 2023-12-04T12:46:32.364 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/307 2023-12-04T12:46:32.365 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:32.372 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:32.399 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:32.399 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-12-04T12:46:33.029 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:33.045 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:33.047 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:33.050 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:33.051 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:33.803 INFO:teuthology.orchestra.run.smithi063.stdout:generic/308 0s 2023-12-04T12:46:33.821 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/308 2023-12-04T12:46:33.821 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:33.830 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:33.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:33.874 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-12-04T12:46:34.486 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:34.500 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:34.502 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:34.505 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:34.505 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:36.374 INFO:teuthology.orchestra.run.smithi063.stdout:generic/309 2s 2023-12-04T12:46:36.397 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/309 2023-12-04T12:46:36.398 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:46:36.410 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:46:36.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:46:36.506 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-12-04T12:46:37.206 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:46:37.221 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:46:37.222 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:46:37.226 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:46:37.226 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:07.373 INFO:teuthology.orchestra.run.smithi063.stdout:generic/310 90s 2023-12-04T12:48:08.478 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/310 2023-12-04T12:48:08.478 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:08.492 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:08.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:08.686 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-12-04T12:48:09.306 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:09.321 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:09.324 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:09.326 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:09.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:10.161 INFO:teuthology.orchestra.run.smithi063.stdout:generic/311 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:48:10.175 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/311 2023-12-04T12:48:10.175 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/311 2023-12-04T12:48:10.175 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:10.185 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:10.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:10.225 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-12-04T12:48:10.857 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:10.873 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:10.875 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:10.878 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:10.879 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:11.609 INFO:teuthology.orchestra.run.smithi063.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:48:11.625 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/312 2023-12-04T12:48:11.626 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/312 2023-12-04T12:48:11.626 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:11.639 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:11.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:11.690 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-12-04T12:48:12.323 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:12.341 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:12.343 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:12.346 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:12.346 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:17.162 INFO:teuthology.orchestra.run.smithi063.stdout:generic/313 5s 2023-12-04T12:48:17.182 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/313 2023-12-04T12:48:17.182 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:17.192 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:17.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:17.232 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-12-04T12:48:17.869 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:17.887 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:17.890 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:17.894 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:17.894 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:19.127 INFO:teuthology.orchestra.run.smithi063.stdout:generic/314 1s 2023-12-04T12:48:19.151 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/314 2023-12-04T12:48:19.151 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:19.163 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:19.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:19.210 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-12-04T12:48:19.883 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:19.898 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:19.900 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:19.903 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:19.903 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:20.637 INFO:teuthology.orchestra.run.smithi063.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-04T12:48:20.650 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/315 2023-12-04T12:48:20.651 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/315 2023-12-04T12:48:20.651 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:20.661 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:20.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:20.712 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-12-04T12:48:21.347 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:21.361 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:21.363 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:21.366 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:21.366 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:22.350 INFO:teuthology.orchestra.run.smithi063.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T12:48:22.363 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/316 2023-12-04T12:48:22.363 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/316 2023-12-04T12:48:22.363 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:22.373 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:22.496 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:22.496 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-12-04T12:48:23.205 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:23.220 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:23.222 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:23.226 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:23.226 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:25.027 INFO:teuthology.orchestra.run.smithi063.stdout:generic/317 2s 2023-12-04T12:48:25.044 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/317 2023-12-04T12:48:25.044 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:25.052 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:25.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:25.079 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-12-04T12:48:25.713 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:25.727 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:25.729 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:25.732 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:25.733 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:27.062 INFO:teuthology.orchestra.run.smithi063.stdout:generic/318 2s 2023-12-04T12:48:27.081 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/318 2023-12-04T12:48:27.081 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:27.090 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:27.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:27.120 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-12-04T12:48:27.764 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:27.778 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:27.780 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:27.784 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:27.784 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:28.767 INFO:teuthology.orchestra.run.smithi063.stdout:generic/319 0s 2023-12-04T12:48:28.784 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/319 2023-12-04T12:48:28.784 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:28.793 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:28.819 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:28.820 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-12-04T12:48:29.470 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:29.485 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:29.487 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:29.491 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:29.491 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:30.164 INFO:teuthology.orchestra.run.smithi063.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:48:30.179 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/320 2023-12-04T12:48:30.179 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/320 2023-12-04T12:48:30.179 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:30.189 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:30.234 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:30.234 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-12-04T12:48:30.898 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:30.913 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:30.914 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:30.918 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:30.918 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:31.632 INFO:teuthology.orchestra.run.smithi063.stdout:generic/321 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:48:31.647 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/321 2023-12-04T12:48:31.648 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/321 2023-12-04T12:48:31.648 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:31.660 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:31.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:31.712 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-12-04T12:48:32.356 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:32.373 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:32.375 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:32.379 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:32.379 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:33.092 INFO:teuthology.orchestra.run.smithi063.stdout:generic/322 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:48:33.107 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/322 2023-12-04T12:48:33.107 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/322 2023-12-04T12:48:33.107 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:48:33.117 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:33.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:48:33.158 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-12-04T12:48:33.792 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:48:33.805 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:48:33.807 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:48:33.811 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:48:33.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:48:53.884 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:48:53.890 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:49:24.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:49:24.069 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:49:54.218 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:49:54.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:50:24.366 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:50:24.371 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:50:24.567 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T12:50:24.566+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 355238) UID: 0 2023-12-04T12:50:24.567 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T12:50:24.566+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 355238) UID: 0 2023-12-04T12:50:24.568 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T12:50:24.567+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 355238) UID: 0 2023-12-04T12:50:24.572 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T12:50:24.566+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 355238) UID: 0 2023-12-04T12:50:35.393 INFO:teuthology.orchestra.run.smithi063.stdout:generic/323 121s 2023-12-04T12:50:35.426 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/323 2023-12-04T12:50:35.426 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:35.437 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:35.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:35.544 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-12-04T12:50:36.358 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:36.372 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:36.373 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:36.376 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:36.376 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:36.998 INFO:teuthology.orchestra.run.smithi063.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-12-04T12:50:37.012 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/324 2023-12-04T12:50:37.012 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/324 2023-12-04T12:50:37.012 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:37.022 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:37.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:37.069 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-12-04T12:50:37.667 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:37.681 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:37.683 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:37.686 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:37.687 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:39.277 INFO:teuthology.orchestra.run.smithi063.stdout:generic/325 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:50:39.290 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/325 2023-12-04T12:50:39.291 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/325 2023-12-04T12:50:39.291 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:39.302 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:39.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:39.343 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-12-04T12:50:39.941 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:39.955 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:39.957 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:39.961 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:39.961 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:40.894 INFO:teuthology.orchestra.run.smithi063.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:40.914 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/326 2023-12-04T12:50:40.914 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/326 2023-12-04T12:50:40.914 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:40.931 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:41.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:41.283 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-12-04T12:50:41.794 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:41.807 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:41.809 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:41.811 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:41.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:42.745 INFO:teuthology.orchestra.run.smithi063.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:42.767 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/327 2023-12-04T12:50:42.767 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/327 2023-12-04T12:50:42.767 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:42.782 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:43.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:43.105 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-12-04T12:50:43.604 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:43.619 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:43.620 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:43.623 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:43.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:45.340 INFO:teuthology.orchestra.run.smithi063.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:45.357 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/328 2023-12-04T12:50:45.357 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/328 2023-12-04T12:50:45.357 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:45.374 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:45.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:45.755 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-12-04T12:50:46.233 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:46.246 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:46.247 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:46.250 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:46.251 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:47.385 INFO:teuthology.orchestra.run.smithi063.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:47.403 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/329 2023-12-04T12:50:47.404 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/329 2023-12-04T12:50:47.404 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:47.421 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:47.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:47.671 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-12-04T12:50:48.142 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:48.154 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:48.155 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:48.158 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:48.158 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:49.197 INFO:teuthology.orchestra.run.smithi063.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:49.213 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/330 2023-12-04T12:50:49.213 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/330 2023-12-04T12:50:49.214 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:49.226 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:49.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:49.625 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-12-04T12:50:50.120 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:50.133 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:50.135 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:50.138 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:50.138 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:51.366 INFO:teuthology.orchestra.run.smithi063.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:51.382 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/331 2023-12-04T12:50:51.382 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/331 2023-12-04T12:50:51.383 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:51.397 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:51.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:51.479 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-12-04T12:50:51.989 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:52.002 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:52.004 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:52.007 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:52.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:52.929 INFO:teuthology.orchestra.run.smithi063.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:52.945 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/332 2023-12-04T12:50:52.945 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/332 2023-12-04T12:50:52.946 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:52.958 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:53.309 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:53.309 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-12-04T12:50:53.807 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:53.820 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:53.821 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:53.824 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:53.824 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:54.734 INFO:teuthology.orchestra.run.smithi063.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:54.758 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/333 2023-12-04T12:50:54.758 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/333 2023-12-04T12:50:54.758 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:54.782 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:55.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:55.105 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-12-04T12:50:55.602 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:55.614 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:55.615 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:55.618 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:55.618 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:56.535 INFO:teuthology.orchestra.run.smithi063.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:50:56.551 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/334 2023-12-04T12:50:56.551 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/334 2023-12-04T12:50:56.551 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:56.565 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:56.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:56.914 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-12-04T12:50:57.407 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:57.420 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:57.421 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:57.424 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:57.424 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:58.242 INFO:teuthology.orchestra.run.smithi063.stdout:generic/335 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/335 2023-12-04T12:50:58.257 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/335 2023-12-04T12:50:58.258 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:58.269 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:58.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:58.320 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-12-04T12:50:58.913 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:50:58.925 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:50:58.927 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:50:58.929 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:50:58.930 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:59.594 INFO:teuthology.orchestra.run.smithi063.stdout:generic/336 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:50:59.605 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/336 2023-12-04T12:50:59.605 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/336 2023-12-04T12:50:59.605 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:50:59.613 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:50:59.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:50:59.656 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-12-04T12:51:00.194 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:51:00.206 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:51:00.208 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:51:00.210 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:51:00.210 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:51:01.142 INFO:teuthology.orchestra.run.smithi063.stdout:generic/337 1s 2023-12-04T12:51:01.160 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/337 2023-12-04T12:51:01.161 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:51:01.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:51:01.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:51:01.198 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-12-04T12:51:01.764 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:51:01.777 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:51:01.779 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:51:01.782 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:51:01.782 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:51:02.399 INFO:teuthology.orchestra.run.smithi063.stdout:generic/338 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:51:02.412 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/338 2023-12-04T12:51:02.413 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/338 2023-12-04T12:51:02.413 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:51:02.425 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:51:02.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:51:02.471 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-12-04T12:51:03.036 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:51:03.049 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:51:03.051 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:51:03.054 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:51:03.054 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:22.778 INFO:teuthology.orchestra.run.smithi063.stdout:generic/339 79s 2023-12-04T12:52:22.792 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/339 2023-12-04T12:52:22.792 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:52:22.801 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:22.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:52:22.824 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-12-04T12:52:23.467 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:52:23.479 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:52:23.480 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:52:23.483 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:52:23.483 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:29.837 INFO:teuthology.orchestra.run.smithi063.stdout:generic/340 6s 2023-12-04T12:52:29.882 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/340 2023-12-04T12:52:29.883 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:52:29.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:29.956 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:52:29.956 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-12-04T12:52:30.841 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:52:30.851 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:52:30.853 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:52:30.855 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:52:30.855 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:31.501 INFO:teuthology.orchestra.run.smithi063.stdout:generic/341 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:52:31.514 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/341 2023-12-04T12:52:31.515 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/341 2023-12-04T12:52:31.515 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:52:31.524 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:31.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:52:31.567 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-12-04T12:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:32.744 INFO:teuthology.orchestra.run.smithi063.stdout:generic/342 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:52:32.759 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/342 2023-12-04T12:52:32.759 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/342 2023-12-04T12:52:32.759 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:52:32.771 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:32.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:52:32.812 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-12-04T12:52:33.348 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:52:33.359 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:52:33.361 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:52:33.363 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:52:33.363 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:36.313 INFO:teuthology.orchestra.run.smithi063.stdout:generic/343 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:52:36.327 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/343 2023-12-04T12:52:36.327 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/343 2023-12-04T12:52:36.327 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:52:36.336 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:36.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:52:36.389 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-12-04T12:52:36.947 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:52:36.960 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:52:36.962 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:52:36.965 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:52:36.965 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:48.110 INFO:teuthology.orchestra.run.smithi063.stdout:generic/344 11s 2023-12-04T12:52:48.144 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/344 2023-12-04T12:52:48.144 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:52:48.155 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:48.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:52:48.203 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-12-04T12:52:48.842 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:52:48.855 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:52:48.857 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:52:48.860 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:52:48.860 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:52:52.578 INFO:teuthology.orchestra.run.smithi063.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.0.log.1: 2023-12-04T12:52:52.578 INFO:teuthology.orchestra.run.smithi063.stderr:gzip: stdin: file size changed while zipping 2023-12-04T12:53:01.274 INFO:teuthology.orchestra.run.smithi063.stdout:generic/345 12s 2023-12-04T12:53:01.305 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/345 2023-12-04T12:53:01.306 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:01.324 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:01.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:01.366 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-12-04T12:53:01.943 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:01.956 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:01.957 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:01.960 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:01.960 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:07.681 INFO:teuthology.orchestra.run.smithi063.stdout:generic/346 5s 2023-12-04T12:53:07.720 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/346 2023-12-04T12:53:07.720 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:07.732 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:07.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:07.769 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-12-04T12:53:08.498 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:08.512 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:08.514 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:08.517 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:08.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:09.298 INFO:teuthology.orchestra.run.smithi063.stdout:generic/347 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:53:09.314 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/347 2023-12-04T12:53:09.315 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/347 2023-12-04T12:53:09.315 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:09.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:09.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:09.376 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-12-04T12:53:10.020 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:10.037 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:10.039 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:10.043 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:10.043 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:10.819 INFO:teuthology.orchestra.run.smithi063.stdout:generic/348 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:53:10.832 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/348 2023-12-04T12:53:10.832 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/348 2023-12-04T12:53:10.832 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:10.843 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:10.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:10.904 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-12-04T12:53:11.528 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:11.544 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:11.546 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:11.550 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:11.550 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:12.491 INFO:teuthology.orchestra.run.smithi063.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-04T12:53:12.502 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/349 2023-12-04T12:53:12.502 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/349 2023-12-04T12:53:12.502 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:12.511 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:12.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:12.569 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-12-04T12:53:13.212 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:13.228 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:13.229 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:13.233 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:13.233 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:14.902 INFO:teuthology.orchestra.run.smithi063.stdout:generic/350 1s 2023-12-04T12:53:14.920 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/350 2023-12-04T12:53:14.920 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:14.929 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:14.959 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:14.959 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-12-04T12:53:15.597 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:15.612 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:15.615 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:15.618 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:15.619 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:16.355 INFO:teuthology.orchestra.run.smithi063.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:53:16.368 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/351 2023-12-04T12:53:16.369 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/351 2023-12-04T12:53:16.369 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:16.379 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:16.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:16.429 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-12-04T12:53:17.093 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:17.108 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:17.110 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:17.114 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:17.114 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:18.160 INFO:teuthology.orchestra.run.smithi063.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:53:18.180 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/352 2023-12-04T12:53:18.181 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/352 2023-12-04T12:53:18.181 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:18.198 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:18.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:18.357 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-12-04T12:53:18.972 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:18.985 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:18.987 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:18.990 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:18.990 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:20.050 INFO:teuthology.orchestra.run.smithi063.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:53:20.068 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/353 2023-12-04T12:53:20.068 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/353 2023-12-04T12:53:20.068 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:20.081 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:20.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:20.347 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-12-04T12:53:20.903 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:20.919 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:20.920 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:20.924 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:20.924 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:27.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:53:27.085 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:53:27.251 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T12:53:27.250+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99733) UID: 0 2023-12-04T12:53:27.252 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T12:53:27.250+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99733) UID: 0 2023-12-04T12:53:27.252 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T12:53:27.250+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99733) UID: 0 2023-12-04T12:53:27.252 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T12:53:27.250+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99733) UID: 0 2023-12-04T12:53:32.771 INFO:teuthology.orchestra.run.smithi063.stdout:generic/354 11s 2023-12-04T12:53:32.805 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/354 2023-12-04T12:53:32.805 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:32.820 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:32.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:32.876 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-12-04T12:53:33.532 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:33.549 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:33.550 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:33.553 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:33.554 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:35.683 INFO:teuthology.orchestra.run.smithi063.stdout:generic/355 2s 2023-12-04T12:53:35.701 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/355 2023-12-04T12:53:35.701 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:35.708 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:35.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:35.814 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-12-04T12:53:36.512 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:36.525 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:36.526 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:36.530 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:36.530 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:37.540 INFO:teuthology.orchestra.run.smithi063.stdout:generic/356 [not run] swapfiles are not supported 2023-12-04T12:53:37.554 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/356 2023-12-04T12:53:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/356 2023-12-04T12:53:37.555 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:37.564 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:37.614 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:37.615 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-12-04T12:53:38.245 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:38.260 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:38.262 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:38.266 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:38.266 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:39.255 INFO:teuthology.orchestra.run.smithi063.stdout:generic/357 [not run] swapfiles are not supported 2023-12-04T12:53:39.271 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/357 2023-12-04T12:53:39.271 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/357 2023-12-04T12:53:39.272 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:39.285 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:39.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:39.331 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-12-04T12:53:39.994 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:40.011 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:40.012 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:40.016 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:40.016 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:41.077 INFO:teuthology.orchestra.run.smithi063.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:53:41.094 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/358 2023-12-04T12:53:41.094 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/358 2023-12-04T12:53:41.094 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:41.107 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:41.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:41.322 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-12-04T12:53:41.870 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:41.883 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:41.884 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:41.887 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:41.888 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:42.976 INFO:teuthology.orchestra.run.smithi063.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:53:43.002 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/359 2023-12-04T12:53:43.002 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/359 2023-12-04T12:53:43.002 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:43.015 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:43.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:43.213 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-12-04T12:53:43.759 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:43.774 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:43.776 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:43.780 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:43.780 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:44.553 INFO:teuthology.orchestra.run.smithi063.stdout:generic/360 0s 2023-12-04T12:53:44.570 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/360 2023-12-04T12:53:44.570 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:44.580 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:44.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:44.629 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-12-04T12:53:45.246 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:45.259 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:45.261 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:45.264 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:45.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:45.939 INFO:teuthology.orchestra.run.smithi063.stdout:generic/361 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:53:45.954 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/361 2023-12-04T12:53:45.954 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/361 2023-12-04T12:53:45.954 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:45.964 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:46.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:46.006 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-12-04T12:53:46.658 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:46.674 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:46.676 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:46.680 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:46.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:47.358 INFO:teuthology.orchestra.run.smithi063.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:47.373 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/362 2023-12-04T12:53:47.373 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/362 2023-12-04T12:53:47.374 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:47.386 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:47.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:47.433 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-12-04T12:53:48.091 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:48.106 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:48.108 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:48.111 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:48.112 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:48.825 INFO:teuthology.orchestra.run.smithi063.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:48.841 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/363 2023-12-04T12:53:48.841 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/363 2023-12-04T12:53:48.841 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:48.856 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:48.903 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:48.903 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-12-04T12:53:49.560 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:49.573 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:49.575 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:49.579 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:49.580 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:50.295 INFO:teuthology.orchestra.run.smithi063.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:50.309 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/364 2023-12-04T12:53:50.309 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/364 2023-12-04T12:53:50.310 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:50.319 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:50.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:50.365 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-12-04T12:53:51.013 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:51.028 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:51.030 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:51.034 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:51.034 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:51.786 INFO:teuthology.orchestra.run.smithi063.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:51.800 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/365 2023-12-04T12:53:51.800 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/365 2023-12-04T12:53:51.800 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:51.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:51.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:51.852 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-12-04T12:53:52.542 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:52.558 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:52.561 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:52.566 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:52.566 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:53.302 INFO:teuthology.orchestra.run.smithi063.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:53.317 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/366 2023-12-04T12:53:53.317 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/366 2023-12-04T12:53:53.317 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:53.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:53.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:53.377 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-12-04T12:53:54.018 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:54.033 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:54.035 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:54.038 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:54.039 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:54.725 INFO:teuthology.orchestra.run.smithi063.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:54.739 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/367 2023-12-04T12:53:54.739 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/367 2023-12-04T12:53:54.740 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:54.751 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:54.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:54.801 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-12-04T12:53:55.461 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:55.477 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:55.479 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:55.483 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:55.483 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:56.234 INFO:teuthology.orchestra.run.smithi063.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:56.249 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/368 2023-12-04T12:53:56.249 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/368 2023-12-04T12:53:56.250 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:56.262 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:56.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:56.315 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-12-04T12:53:56.963 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:56.979 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:56.981 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:56.986 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:56.986 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:57.715 INFO:teuthology.orchestra.run.smithi063.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:57.733 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/369 2023-12-04T12:53:57.733 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/369 2023-12-04T12:53:57.733 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:57.745 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:57.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:57.793 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-12-04T12:53:58.388 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:58.402 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:58.404 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:58.407 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:58.408 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:59.025 INFO:teuthology.orchestra.run.smithi063.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-04T12:53:59.037 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/370 2023-12-04T12:53:59.038 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/370 2023-12-04T12:53:59.038 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:53:59.046 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:53:59.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:53:59.086 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-12-04T12:53:59.650 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:53:59.663 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:53:59.664 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:53:59.667 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:53:59.667 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:00.341 INFO:teuthology.orchestra.run.smithi063.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:54:00.358 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/371 2023-12-04T12:54:00.358 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/371 2023-12-04T12:54:00.358 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:00.372 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:00.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:00.431 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-12-04T12:54:01.060 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:01.077 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:01.078 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:01.083 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:01.083 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:02.196 INFO:teuthology.orchestra.run.smithi063.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:54:02.218 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/372 2023-12-04T12:54:02.218 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/372 2023-12-04T12:54:02.218 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:02.238 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:02.510 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:02.510 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-12-04T12:54:03.029 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:03.042 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:03.043 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:03.046 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:03.046 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:04.119 INFO:teuthology.orchestra.run.smithi063.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:54:04.141 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/373 2023-12-04T12:54:04.143 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/373 2023-12-04T12:54:04.143 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:04.155 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:04.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:04.353 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-12-04T12:54:04.926 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:04.942 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:04.944 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:04.948 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:04.948 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:05.944 INFO:teuthology.orchestra.run.smithi063.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-04T12:54:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/374 2023-12-04T12:54:06.027 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/374 2023-12-04T12:54:06.028 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:06.049 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:06.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:06.437 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-12-04T12:54:06.961 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:06.974 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:06.975 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:06.979 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:06.979 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:07.922 INFO:teuthology.orchestra.run.smithi063.stdout:generic/375 0s 2023-12-04T12:54:07.943 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/375 2023-12-04T12:54:07.943 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:07.953 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:08.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:08.083 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-12-04T12:54:08.770 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:08.782 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:08.784 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:08.787 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:08.787 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:09.502 INFO:teuthology.orchestra.run.smithi063.stdout:generic/376 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:54:09.516 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/376 2023-12-04T12:54:09.516 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/376 2023-12-04T12:54:09.517 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:09.529 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:09.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:09.575 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-12-04T12:54:10.235 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:10.250 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:10.252 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:10.255 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:10.255 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:11.391 INFO:teuthology.orchestra.run.smithi063.stdout:generic/377 1s 2023-12-04T12:54:11.409 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/377 2023-12-04T12:54:11.409 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:11.418 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:11.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:11.446 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-12-04T12:54:12.074 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:12.091 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:12.092 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:12.096 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:12.096 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:13.413 INFO:teuthology.orchestra.run.smithi063.stdout:generic/378 1s 2023-12-04T12:54:13.427 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/378 2023-12-04T12:54:13.427 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:13.436 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:13.552 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:13.552 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-12-04T12:54:14.225 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:14.239 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:14.240 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:14.243 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:14.243 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:14.954 INFO:teuthology.orchestra.run.smithi063.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:14.969 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/379 2023-12-04T12:54:14.969 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/379 2023-12-04T12:54:14.970 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:14.983 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:15.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:15.035 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-12-04T12:54:15.716 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:15.731 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:15.733 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:15.737 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:15.737 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:16.457 INFO:teuthology.orchestra.run.smithi063.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:16.470 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/380 2023-12-04T12:54:16.471 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/380 2023-12-04T12:54:16.471 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:16.481 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:16.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:16.534 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-12-04T12:54:17.174 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:17.189 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:17.191 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:17.194 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:17.195 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:17.943 INFO:teuthology.orchestra.run.smithi063.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:17.960 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/381 2023-12-04T12:54:17.961 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/381 2023-12-04T12:54:17.961 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:17.974 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:18.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:18.024 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-12-04T12:54:18.681 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:18.696 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:18.698 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:18.702 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:18.702 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:19.392 INFO:teuthology.orchestra.run.smithi063.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:19.408 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/382 2023-12-04T12:54:19.409 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/382 2023-12-04T12:54:19.409 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:19.421 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:19.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:19.473 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-12-04T12:54:20.118 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:20.132 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:20.134 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:20.137 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:20.137 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:20.825 INFO:teuthology.orchestra.run.smithi063.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:20.839 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/383 2023-12-04T12:54:20.840 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/383 2023-12-04T12:54:20.840 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:20.853 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:20.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:20.902 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-12-04T12:54:21.538 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:21.552 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:21.553 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:21.557 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:21.557 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:22.260 INFO:teuthology.orchestra.run.smithi063.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:22.273 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/384 2023-12-04T12:54:22.273 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/384 2023-12-04T12:54:22.273 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:22.283 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:22.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:22.329 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-12-04T12:54:22.971 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:22.986 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:22.988 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:22.991 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:22.991 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:23.692 INFO:teuthology.orchestra.run.smithi063.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:23.707 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/385 2023-12-04T12:54:23.707 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/385 2023-12-04T12:54:23.707 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:23.720 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:23.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:23.772 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-12-04T12:54:24.456 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:24.473 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:24.474 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:24.477 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:24.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:25.152 INFO:teuthology.orchestra.run.smithi063.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:25.169 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/386 2023-12-04T12:54:25.169 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/386 2023-12-04T12:54:25.169 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:25.183 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:25.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:25.237 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-12-04T12:54:25.905 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:25.922 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:25.924 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:25.928 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:25.928 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:26.994 INFO:teuthology.orchestra.run.smithi063.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:54:27.012 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/387 2023-12-04T12:54:27.012 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/387 2023-12-04T12:54:27.013 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:27.026 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:27.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:27.270 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-12-04T12:54:27.832 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:27.848 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:27.850 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:27.854 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:27.854 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:28.637 INFO:teuthology.orchestra.run.smithi063.stdout:generic/388 [not run] require 172.21.15.63:6789:/scratch to be local device 2023-12-04T12:54:28.652 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/388 2023-12-04T12:54:28.652 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/388 2023-12-04T12:54:28.652 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:28.663 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:28.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:28.718 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-12-04T12:54:29.363 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:29.376 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:29.378 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:29.381 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:29.381 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:30.084 INFO:teuthology.orchestra.run.smithi063.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-04T12:54:30.097 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/389 2023-12-04T12:54:30.097 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/389 2023-12-04T12:54:30.097 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:30.108 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:30.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:30.160 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-12-04T12:54:30.817 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:30.833 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:30.835 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:30.839 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:30.840 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:31.557 INFO:teuthology.orchestra.run.smithi063.stdout:generic/390 [not run] ceph does not support freezing 2023-12-04T12:54:31.571 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/390 2023-12-04T12:54:31.572 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/390 2023-12-04T12:54:31.572 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:31.585 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:31.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:31.632 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-12-04T12:54:32.293 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:32.308 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:32.310 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:32.314 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:33.087 INFO:teuthology.orchestra.run.smithi063.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:54:33.099 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/391 2023-12-04T12:54:33.099 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/391 2023-12-04T12:54:33.099 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:33.109 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:33.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:33.162 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-12-04T12:54:33.800 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:33.816 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:33.818 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:33.821 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:33.821 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:34.691 INFO:teuthology.orchestra.run.smithi063.stdout:generic/392 [not run] ceph does not support shutdown 2023-12-04T12:54:34.718 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/392 2023-12-04T12:54:34.718 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/392 2023-12-04T12:54:34.718 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:34.728 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:34.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:34.775 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-12-04T12:54:35.414 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:35.428 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:35.429 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:35.432 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:35.433 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:37.272 INFO:teuthology.orchestra.run.smithi063.stdout:generic/393 2s 2023-12-04T12:54:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/393 2023-12-04T12:54:37.288 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:37.296 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:37.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:37.323 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-12-04T12:54:37.976 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:37.993 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:37.994 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:37.998 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:37.998 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:38.794 INFO:teuthology.orchestra.run.smithi063.stdout:generic/394 0s 2023-12-04T12:54:38.811 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/394 2023-12-04T12:54:38.811 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:38.819 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:38.937 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:38.937 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-12-04T12:54:39.671 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:39.689 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:39.690 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:39.693 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:39.693 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:41.766 INFO:teuthology.orchestra.run.smithi063.stdout:generic/395 2s 2023-12-04T12:54:41.806 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/395 2023-12-04T12:54:41.806 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:41.815 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:41.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:41.865 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-12-04T12:54:42.441 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:42.453 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:42.455 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:42.458 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:42.459 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:43.993 INFO:teuthology.orchestra.run.smithi063.stdout:generic/396 1s 2023-12-04T12:54:44.009 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/396 2023-12-04T12:54:44.010 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:44.018 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:44.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:44.044 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-12-04T12:54:44.699 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:44.716 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:44.718 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:44.723 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:44.723 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:47.369 INFO:teuthology.orchestra.run.smithi063.stdout:generic/397 3s 2023-12-04T12:54:47.387 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/397 2023-12-04T12:54:47.387 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:47.394 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:47.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:47.421 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-12-04T12:54:48.073 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:48.088 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:48.090 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:48.094 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:48.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:49.364 INFO:teuthology.orchestra.run.smithi063.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-12-04T12:54:49.381 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/398 2023-12-04T12:54:49.381 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/398 2023-12-04T12:54:49.381 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:49.393 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:49.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:49.494 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-12-04T12:54:50.198 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:50.211 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:50.213 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:50.216 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:50.216 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:51.381 INFO:teuthology.orchestra.run.smithi063.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-12-04T12:54:51.393 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/399 2023-12-04T12:54:51.393 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/399 2023-12-04T12:54:51.393 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:51.402 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:51.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:51.453 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-12-04T12:54:52.071 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:52.087 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:52.089 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:52.094 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:52.094 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:52.785 INFO:teuthology.orchestra.run.smithi063.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T12:54:52.803 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/400 2023-12-04T12:54:52.803 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/400 2023-12-04T12:54:52.803 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:52.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:52.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:52.861 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-12-04T12:54:53.514 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:53.528 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:53.530 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:53.533 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:53.533 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:54.765 INFO:teuthology.orchestra.run.smithi063.stdout:generic/401 1s 2023-12-04T12:54:54.794 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/401 2023-12-04T12:54:54.794 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:54.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:54.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:54.864 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-12-04T12:54:55.469 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:55.482 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:55.484 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:55.487 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:55.487 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:56.467 INFO:teuthology.orchestra.run.smithi063.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-12-04T12:54:56.508 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/402 2023-12-04T12:54:56.509 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/402 2023-12-04T12:54:56.509 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:56.521 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:56.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:56.572 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-12-04T12:54:57.212 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:57.228 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:57.230 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:57.234 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:57.234 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:58.742 INFO:teuthology.orchestra.run.smithi063.stdout:generic/403 1s 2023-12-04T12:54:58.761 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/403 2023-12-04T12:54:58.761 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:54:58.770 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:54:58.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:54:58.800 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-12-04T12:54:59.437 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:54:59.474 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:54:59.474 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:54:59.474 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:54:59.474 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:00.215 INFO:teuthology.orchestra.run.smithi063.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T12:55:00.228 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/404 2023-12-04T12:55:00.228 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/404 2023-12-04T12:55:00.228 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:00.238 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:00.289 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:00.289 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-12-04T12:55:00.947 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:00.967 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:00.967 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:00.970 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:00.970 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:01.784 INFO:teuthology.orchestra.run.smithi063.stdout:generic/405 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T12:55:01.798 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/405 2023-12-04T12:55:01.799 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/405 2023-12-04T12:55:01.799 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:01.811 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:01.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:01.863 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-12-04T12:55:02.520 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:02.536 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:02.537 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:02.541 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:02.541 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:07.447 INFO:teuthology.orchestra.run.smithi063.stdout:generic/406 5s 2023-12-04T12:55:07.465 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/406 2023-12-04T12:55:07.465 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:07.473 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:07.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:07.501 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-12-04T12:55:08.147 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:08.164 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:08.166 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:08.170 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:08.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:09.018 INFO:teuthology.orchestra.run.smithi063.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T12:55:09.033 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/407 2023-12-04T12:55:09.033 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/407 2023-12-04T12:55:09.033 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:09.045 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:09.185 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:09.185 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-12-04T12:55:09.902 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:09.916 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:09.918 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:09.921 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:09.921 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:10.719 INFO:teuthology.orchestra.run.smithi063.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-04T12:55:10.735 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/408 2023-12-04T12:55:10.736 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/408 2023-12-04T12:55:10.736 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:10.749 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:10.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:10.860 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-12-04T12:55:11.568 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:11.580 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:11.582 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:11.585 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:11.585 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:12.274 INFO:teuthology.orchestra.run.smithi063.stdout:generic/409 [not run] require 172.21.15.63:6789:/scratch to be local device 2023-12-04T12:55:12.289 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/409 2023-12-04T12:55:12.290 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/409 2023-12-04T12:55:12.290 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:12.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:12.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:12.351 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-12-04T12:55:13.036 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:13.052 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:13.053 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:13.057 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:13.057 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:13.832 INFO:teuthology.orchestra.run.smithi063.stdout:generic/410 [not run] require 172.21.15.63:6789:/scratch to be local device 2023-12-04T12:55:13.848 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/410 2023-12-04T12:55:13.849 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/410 2023-12-04T12:55:13.849 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:13.860 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:13.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:13.914 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-12-04T12:55:14.548 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:14.564 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:14.566 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:14.570 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:14.571 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:15.315 INFO:teuthology.orchestra.run.smithi063.stdout:generic/411 [not run] require 172.21.15.63:6789:/scratch to be local device 2023-12-04T12:55:15.329 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/411 2023-12-04T12:55:15.329 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/411 2023-12-04T12:55:15.329 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:15.339 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:15.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:15.390 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-12-04T12:55:16.026 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:16.041 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:16.043 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:16.046 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:16.046 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:17.315 INFO:teuthology.orchestra.run.smithi063.stdout:generic/412 1s 2023-12-04T12:55:17.331 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/412 2023-12-04T12:55:17.331 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:17.338 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:17.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:17.365 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-12-04T12:55:17.972 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:17.990 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:17.991 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:17.995 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:17.995 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:18.927 INFO:teuthology.orchestra.run.smithi063.stdout:generic/413 [not run] mount 172.21.15.63:6789:/scratch with dax failed 2023-12-04T12:55:18.942 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/413 2023-12-04T12:55:18.942 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/413 2023-12-04T12:55:18.942 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:18.951 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:19.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:19.004 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-12-04T12:55:19.646 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:19.662 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:19.664 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:19.668 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:19.668 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:20.832 INFO:teuthology.orchestra.run.smithi063.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:55:20.854 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/414 2023-12-04T12:55:20.854 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/414 2023-12-04T12:55:20.854 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:20.866 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:21.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:21.044 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-12-04T12:55:21.637 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:21.651 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:21.654 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:21.658 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:21.658 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:22.736 INFO:teuthology.orchestra.run.smithi063.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T12:55:22.755 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/415 2023-12-04T12:55:22.755 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/415 2023-12-04T12:55:22.755 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:22.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:23.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:23.018 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-12-04T12:55:23.569 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:23.584 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:23.585 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:23.589 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:23.589 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:24.305 INFO:teuthology.orchestra.run.smithi063.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:55:24.319 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/416 2023-12-04T12:55:24.319 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/416 2023-12-04T12:55:24.319 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:24.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:24.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:24.379 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-12-04T12:55:25.004 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:25.018 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:25.020 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:25.023 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:25.023 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:25.933 INFO:teuthology.orchestra.run.smithi063.stdout:generic/417 [not run] ceph does not support shutdown 2023-12-04T12:55:25.959 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/417 2023-12-04T12:55:25.959 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/417 2023-12-04T12:55:25.959 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:25.968 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:26.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:26.008 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-12-04T12:55:26.667 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:26.684 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:26.686 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:26.691 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:26.691 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:27.475 INFO:teuthology.orchestra.run.smithi063.stdout:generic/418 [not run] require 172.21.15.63:6789:/test to be valid block disk 2023-12-04T12:55:27.490 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/418 2023-12-04T12:55:27.491 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/418 2023-12-04T12:55:27.491 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:27.503 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:27.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:27.556 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-12-04T12:55:28.219 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:28.234 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:28.236 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:28.239 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:28.239 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:29.400 INFO:teuthology.orchestra.run.smithi063.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-12-04T12:55:29.411 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/419 2023-12-04T12:55:29.411 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/419 2023-12-04T12:55:29.411 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:29.419 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:29.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:29.522 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-12-04T12:55:30.184 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:30.198 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:30.199 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:30.202 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:30.202 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:31.231 INFO:teuthology.orchestra.run.smithi063.stdout:generic/420 1s 2023-12-04T12:55:31.247 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/420 2023-12-04T12:55:31.247 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:31.256 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:31.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:31.371 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-12-04T12:55:32.069 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:32.084 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:32.085 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:32.089 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:40.032 INFO:teuthology.orchestra.run.smithi063.stdout:generic/421 7s 2023-12-04T12:55:40.061 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/421 2023-12-04T12:55:40.061 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:40.072 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:40.124 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:40.125 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-12-04T12:55:40.726 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:40.740 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:40.742 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:40.746 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:40.746 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:41.550 INFO:teuthology.orchestra.run.smithi063.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-04T12:55:41.563 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/422 2023-12-04T12:55:41.563 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/422 2023-12-04T12:55:41.563 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:41.575 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:41.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:41.634 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-12-04T12:55:42.304 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:42.319 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:42.321 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:42.325 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:42.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:43.300 INFO:teuthology.orchestra.run.smithi063.stdout:generic/423 1s 2023-12-04T12:55:43.317 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/423 2023-12-04T12:55:43.318 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:43.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:43.476 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:43.476 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-12-04T12:55:44.177 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:44.192 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:44.194 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:44.196 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:44.196 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:44.947 INFO:teuthology.orchestra.run.smithi063.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-04T12:55:44.955 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/424 2023-12-04T12:55:44.955 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/424 2023-12-04T12:55:44.955 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:44.966 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:45.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:45.012 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-12-04T12:55:45.698 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:45.714 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:45.715 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:45.719 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:45.719 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:46.539 INFO:teuthology.orchestra.run.smithi063.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-12-04T12:55:46.555 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/425 2023-12-04T12:55:46.556 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/425 2023-12-04T12:55:46.556 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:55:46.569 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:55:46.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:55:46.668 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-12-04T12:55:47.379 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:55:47.391 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:55:47.392 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:55:47.395 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:55:47.396 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:56:23.066 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:56:23.077 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:56:50.091 INFO:teuthology.orchestra.run.smithi063.stdout:generic/426 62s 2023-12-04T12:56:50.220 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/426 2023-12-04T12:56:50.220 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:56:50.234 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:56:50.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:56:50.471 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-12-04T12:56:52.667 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:56:52.678 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:56:52.680 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:56:52.682 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:56:52.683 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:56:53.651 INFO:teuthology.orchestra.run.smithi063.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T12:56:53.663 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/427 2023-12-04T12:56:53.664 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/427 2023-12-04T12:56:53.664 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:56:53.671 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:56:53.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:56:53.709 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-12-04T12:56:54.114 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:56:54.119 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:56:54.273 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:56:54.285 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:56:54.287 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:56:54.290 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:56:54.290 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:56:55.042 INFO:teuthology.orchestra.run.smithi063.stdout:generic/428 1s 2023-12-04T12:56:55.062 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/428 2023-12-04T12:56:55.062 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:56:55.069 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:56:55.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:56:55.130 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-12-04T12:56:55.789 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:56:55.805 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:56:55.807 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:56:55.810 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:56:55.810 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:08.230 INFO:teuthology.orchestra.run.smithi063.stdout:generic/429 12s 2023-12-04T12:57:08.243 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/429 2023-12-04T12:57:08.244 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:57:08.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:08.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:57:08.270 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-12-04T12:57:08.813 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:57:08.829 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:57:08.833 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:57:08.834 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:57:08.834 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:09.878 INFO:teuthology.orchestra.run.smithi063.stdout:generic/430 0s 2023-12-04T12:57:09.897 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/430 2023-12-04T12:57:09.898 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:57:09.908 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:10.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:57:10.081 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-12-04T12:57:10.754 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:57:10.769 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:57:10.771 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:57:10.774 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:57:10.775 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:11.682 INFO:teuthology.orchestra.run.smithi063.stdout:generic/431 0s 2023-12-04T12:57:11.700 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/431 2023-12-04T12:57:11.700 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:57:11.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:11.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:57:11.866 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-12-04T12:57:12.564 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:57:12.579 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:57:12.580 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:57:12.584 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:57:12.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:13.591 INFO:teuthology.orchestra.run.smithi063.stdout:generic/432 1s 2023-12-04T12:57:13.610 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/432 2023-12-04T12:57:13.610 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:57:13.620 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:13.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:57:13.775 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-12-04T12:57:14.480 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:57:14.489 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:57:14.490 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:57:14.494 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:57:14.494 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:15.415 INFO:teuthology.orchestra.run.smithi063.stdout:generic/433 1s 2023-12-04T12:57:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/433 2023-12-04T12:57:15.434 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:57:15.444 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:15.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:57:15.611 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-12-04T12:57:16.308 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:57:16.321 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:57:16.322 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:57:16.325 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:57:16.325 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:17.251 INFO:teuthology.orchestra.run.smithi063.stdout:generic/434 1s 2023-12-04T12:57:17.270 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/434 2023-12-04T12:57:17.270 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T12:57:17.280 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:17.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T12:57:17.414 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-12-04T12:57:18.120 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T12:57:18.134 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T12:57:18.134 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T12:57:18.137 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T12:57:18.137 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T12:57:24.323 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:57:24.333 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:57:54.520 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:57:54.531 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:58:25.271 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:58:25.281 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T12:58:25.425 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T12:58:25.423+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 409921) UID: 0 2023-12-04T12:58:25.426 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T12:58:25.423+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 409921) UID: 0 2023-12-04T13:01:43.445 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:01:43.458 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:02:13.670 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:02:13.682 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:02:43.901 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:02:43.912 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:03:14.068 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:03:14.078 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:03:44.222 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:03:44.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:04:15.169 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:04:15.180 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:04:46.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:04:46.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:05:16.507 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:05:16.518 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:05:46.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:05:46.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:05:46.777 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T13:05:46.775+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 410318) UID: 0 2023-12-04T13:05:46.777 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T13:05:46.775+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 410318) UID: 0 2023-12-04T13:08:59.493 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:08:59.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:09:29.655 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:09:29.665 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:09:59.835 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:09:59.845 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:10:29.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:10:29.987 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:11:00.131 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:11:00.141 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:11:30.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:11:30.299 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:11:30.400 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T13:11:30.400+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 410435) UID: 0 2023-12-04T13:11:30.401 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T13:11:30.400+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 410435) UID: 0 2023-12-04T13:13:02.436 INFO:teuthology.orchestra.run.smithi063.stdout:generic/435 944s 2023-12-04T13:13:02.460 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/435 2023-12-04T13:13:02.460 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:13:02.472 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:13:02.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:13:02.518 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-12-04T13:13:03.129 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:13:03.141 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:13:03.143 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:13:03.146 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:13:03.146 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:13:04.516 INFO:teuthology.orchestra.run.smithi063.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T13:13:04.527 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/436 2023-12-04T13:13:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/436 2023-12-04T13:13:04.528 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:13:04.536 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:13:04.643 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:13:04.644 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-12-04T13:13:05.362 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:13:05.375 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:13:05.377 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:13:05.380 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:13:05.380 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:13:06.782 INFO:teuthology.orchestra.run.smithi063.stdout:generic/437 1s 2023-12-04T13:13:06.799 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/437 2023-12-04T13:13:06.799 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:13:06.808 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:13:06.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:13:06.857 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-12-04T13:13:07.416 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:13:07.429 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:13:07.431 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:13:07.434 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:13:07.434 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:14:39.617 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:14:39.628 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:15:09.779 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:15:09.785 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:15:39.935 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:15:39.940 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:16:10.074 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:16:10.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:16:30.549 INFO:teuthology.orchestra.run.smithi063.stdout:generic/438 203s 2023-12-04T13:16:30.567 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/438 2023-12-04T13:16:30.567 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:16:30.577 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:30.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:16:30.634 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-12-04T13:16:31.310 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:16:31.328 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:16:31.330 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:16:31.335 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:16:31.335 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:33.284 INFO:teuthology.orchestra.run.smithi063.stdout:generic/439 2s 2023-12-04T13:16:33.298 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/439 2023-12-04T13:16:33.298 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:16:33.305 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:33.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:16:33.336 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-12-04T13:16:33.943 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:16:33.956 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:16:33.957 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:16:33.960 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:16:33.960 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:36.469 INFO:teuthology.orchestra.run.smithi063.stdout:generic/440 2s 2023-12-04T13:16:36.483 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/440 2023-12-04T13:16:36.483 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:16:36.491 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:36.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:16:36.516 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-12-04T13:16:37.160 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:16:37.174 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:16:37.176 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:16:37.179 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:16:37.179 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:38.046 INFO:teuthology.orchestra.run.smithi063.stdout:generic/441 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T13:16:38.063 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/441 2023-12-04T13:16:38.063 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/441 2023-12-04T13:16:38.063 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:16:38.077 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:38.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:16:38.136 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-12-04T13:16:38.798 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:16:38.813 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:16:38.814 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:16:38.818 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:16:38.818 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:39.561 INFO:teuthology.orchestra.run.smithi063.stdout:generic/442 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T13:16:39.575 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/442 2023-12-04T13:16:39.575 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/442 2023-12-04T13:16:39.575 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:16:39.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:39.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:16:39.644 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-12-04T13:16:40.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:16:40.223 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:16:40.289 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:16:40.301 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:16:40.303 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:16:40.305 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:16:40.306 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:41.118 INFO:teuthology.orchestra.run.smithi063.stdout:generic/443 1s 2023-12-04T13:16:41.139 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/443 2023-12-04T13:16:41.139 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:16:41.149 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:41.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:16:41.213 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-12-04T13:16:41.878 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:16:41.894 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:16:41.895 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:16:41.899 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:16:41.899 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:42.859 INFO:teuthology.orchestra.run.smithi063.stdout:generic/444 0s 2023-12-04T13:16:42.884 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/444 2023-12-04T13:16:42.884 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:16:42.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:42.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:16:42.963 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-12-04T13:16:43.593 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:16:43.608 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:16:43.609 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:16:43.613 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:16:43.613 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:45.298 INFO:teuthology.orchestra.run.smithi063.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T13:16:45.315 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/445 2023-12-04T13:16:45.315 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/445 2023-12-04T13:16:45.315 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:16:45.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:16:45.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:16:45.434 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-12-04T13:16:46.162 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:16:46.177 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:16:46.179 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:16:46.182 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:16:46.183 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:17:10.370 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:17:10.379 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:17:40.518 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:17:40.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:17:54.480 INFO:teuthology.orchestra.run.smithi063.stdout:generic/446 68s 2023-12-04T13:17:54.507 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/446 2023-12-04T13:17:54.516 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:17:54.527 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:17:54.576 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:17:54.576 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-12-04T13:17:55.222 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:17:55.237 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:17:55.240 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:17:55.244 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:17:55.244 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:17:56.413 INFO:teuthology.orchestra.run.smithi063.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T13:17:56.435 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/447 2023-12-04T13:17:56.435 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/447 2023-12-04T13:17:56.435 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:17:56.446 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:17:56.749 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:17:56.750 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-12-04T13:17:57.277 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:17:57.293 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:17:57.295 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:17:57.299 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:17:57.299 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:00.022 INFO:teuthology.orchestra.run.smithi063.stdout:generic/448 3s 2023-12-04T13:18:00.039 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/448 2023-12-04T13:18:00.039 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:00.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:00.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:00.150 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-12-04T13:18:00.844 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:00.858 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:00.860 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:00.863 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:00.863 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:01.694 INFO:teuthology.orchestra.run.smithi063.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T13:18:01.709 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/449 2023-12-04T13:18:01.709 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/449 2023-12-04T13:18:01.709 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:01.720 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:01.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:01.848 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-12-04T13:18:02.564 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:02.578 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:02.580 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:02.584 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:02.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:04.752 INFO:teuthology.orchestra.run.smithi063.stdout:generic/450 2s 2023-12-04T13:18:04.768 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/450 2023-12-04T13:18:04.768 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:04.776 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:04.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:04.894 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-12-04T13:18:05.597 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:05.609 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:05.610 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:05.613 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:05.613 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:10.683 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:18:10.690 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:18:36.571 INFO:teuthology.orchestra.run.smithi063.stdout:generic/451 31s 2023-12-04T13:18:36.588 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/451 2023-12-04T13:18:36.588 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:36.597 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:36.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:36.698 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-12-04T13:18:37.409 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:37.424 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:37.425 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:37.429 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:37.429 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:38.616 INFO:teuthology.orchestra.run.smithi063.stdout:generic/452 1s 2023-12-04T13:18:38.634 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/452 2023-12-04T13:18:38.634 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:38.644 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:38.677 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:38.677 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-12-04T13:18:39.337 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:39.352 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:39.354 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:39.357 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:39.358 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:40.051 INFO:teuthology.orchestra.run.smithi063.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-12-04T13:18:40.062 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/453 2023-12-04T13:18:40.063 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/453 2023-12-04T13:18:40.063 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:40.071 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:40.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:40.125 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-12-04T13:18:40.762 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:40.777 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:40.779 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:40.783 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:40.783 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:40.849 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:18:40.856 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:18:41.483 INFO:teuthology.orchestra.run.smithi063.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-12-04T13:18:41.500 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/454 2023-12-04T13:18:41.500 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/454 2023-12-04T13:18:41.500 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:41.513 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:41.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:41.587 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-12-04T13:18:42.280 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:42.295 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:42.297 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:42.300 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:42.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:43.184 INFO:teuthology.orchestra.run.smithi063.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-04T13:18:43.200 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/455 2023-12-04T13:18:43.200 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/455 2023-12-04T13:18:43.201 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:43.213 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:43.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:43.268 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-12-04T13:18:43.925 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:43.940 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:43.942 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:43.945 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:43.945 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:44.714 INFO:teuthology.orchestra.run.smithi063.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T13:18:44.729 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/456 2023-12-04T13:18:44.729 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/456 2023-12-04T13:18:44.729 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:44.741 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:44.805 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:44.806 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-12-04T13:18:45.463 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:45.478 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:45.480 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:45.484 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:45.484 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:46.858 INFO:teuthology.orchestra.run.smithi063.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T13:18:46.881 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/457 2023-12-04T13:18:46.881 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/457 2023-12-04T13:18:46.881 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:46.897 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:46.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:46.976 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-12-04T13:18:47.496 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:47.512 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:47.513 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:47.517 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:47.517 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:48.605 INFO:teuthology.orchestra.run.smithi063.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T13:18:48.623 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/458 2023-12-04T13:18:48.623 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/458 2023-12-04T13:18:48.623 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:48.639 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:48.986 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:48.987 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-12-04T13:18:49.510 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:49.580 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:49.580 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:49.580 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:49.580 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:50.523 INFO:teuthology.orchestra.run.smithi063.stdout:generic/459 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T13:18:50.538 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/459 2023-12-04T13:18:50.538 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/459 2023-12-04T13:18:50.538 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:50.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:50.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:50.612 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-12-04T13:18:51.270 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:51.286 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:51.287 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:51.291 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:51.291 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:54.962 INFO:teuthology.orchestra.run.smithi063.stdout:generic/460 3s 2023-12-04T13:18:54.980 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/460 2023-12-04T13:18:54.980 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:54.990 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:55.019 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:55.019 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-12-04T13:18:55.678 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:55.693 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:55.694 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:55.698 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:55.698 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:56.663 INFO:teuthology.orchestra.run.smithi063.stdout:generic/461 [not run] ceph does not support shutdown 2023-12-04T13:18:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/461 2023-12-04T13:18:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/461 2023-12-04T13:18:56.673 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:56.680 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:56.719 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:56.719 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-12-04T13:18:57.355 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:57.369 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:57.371 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:57.374 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:57.375 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:58.306 INFO:teuthology.orchestra.run.smithi063.stdout:generic/462 [not run] mount 172.21.15.63:6789:/scratch with dax failed 2023-12-04T13:18:58.318 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/462 2023-12-04T13:18:58.318 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/462 2023-12-04T13:18:58.318 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:58.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:58.370 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:18:58.371 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-12-04T13:18:59.011 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:18:59.026 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:18:59.028 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:18:59.031 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:18:59.031 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:18:59.929 INFO:teuthology.orchestra.run.smithi063.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T13:18:59.945 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/463 2023-12-04T13:18:59.945 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/463 2023-12-04T13:18:59.945 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:18:59.958 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:19:00.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:19:00.086 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-12-04T13:19:00.815 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:19:00.829 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:19:00.831 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:19:00.835 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:19:00.835 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:19:11.532 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:19:11.544 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:19:41.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:19:41.768 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:20:01.789 INFO:teuthology.orchestra.run.smithi063.stdout:generic/464 60s 2023-12-04T13:20:01.805 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/464 2023-12-04T13:20:01.806 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:20:01.814 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:01.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:20:01.842 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-12-04T13:20:02.455 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:20:02.471 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:20:02.473 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:20:02.476 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:20:02.477 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:12.460 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:20:12.473 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:20:12.553 INFO:teuthology.orchestra.run.smithi063.stdout:generic/465 9s 2023-12-04T13:20:12.732 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/465 2023-12-04T13:20:12.735 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:20:12.748 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:12.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:20:12.797 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-12-04T13:20:13.310 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:20:13.322 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:20:13.323 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:20:13.326 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:20:13.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:13.966 INFO:teuthology.orchestra.run.smithi063.stdout:generic/466 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T13:20:13.980 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/466 2023-12-04T13:20:13.980 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/466 2023-12-04T13:20:13.980 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:20:13.989 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:14.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:20:14.034 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-12-04T13:20:14.713 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:20:14.727 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:20:14.729 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:20:14.732 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:20:14.732 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:28.242 INFO:teuthology.orchestra.run.smithi063.stdout:generic/467 14s 2023-12-04T13:20:28.306 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/467 2023-12-04T13:20:28.306 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:20:28.331 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:28.550 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:20:28.550 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-12-04T13:20:30.332 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:20:30.349 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:20:30.351 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:20:30.356 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:20:30.356 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:31.625 INFO:teuthology.orchestra.run.smithi063.stdout:generic/468 [not run] ceph does not support shutdown 2023-12-04T13:20:31.654 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/468 2023-12-04T13:20:31.654 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/468 2023-12-04T13:20:31.655 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:20:31.667 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:31.711 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:20:31.712 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-12-04T13:20:32.335 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:20:32.348 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:20:32.350 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:20:32.355 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:20:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:33.112 INFO:teuthology.orchestra.run.smithi063.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-04T13:20:33.129 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/469 2023-12-04T13:20:33.130 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/469 2023-12-04T13:20:33.130 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:20:33.142 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:33.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:20:33.200 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-12-04T13:20:33.828 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:20:33.843 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:20:33.845 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:20:33.849 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:20:33.849 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:34.632 INFO:teuthology.orchestra.run.smithi063.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-04T13:20:34.646 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/470 2023-12-04T13:20:34.646 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/470 2023-12-04T13:20:34.646 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:20:34.658 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:34.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:20:34.703 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-12-04T13:20:35.348 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:20:35.363 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:20:35.364 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:20:35.368 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:20:35.368 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:20:43.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:20:43.183 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:21:13.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:21:13.367 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:21:40.760 INFO:teuthology.orchestra.run.smithi063.stdout:generic/471 65s 2023-12-04T13:21:40.790 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/471 2023-12-04T13:21:40.790 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:21:40.802 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:40.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:21:40.973 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-12-04T13:21:41.830 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:21:41.841 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:21:41.842 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:21:41.844 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:21:41.844 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:42.894 INFO:teuthology.orchestra.run.smithi063.stdout:generic/472 [not run] swapfiles are not supported 2023-12-04T13:21:42.910 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/472 2023-12-04T13:21:42.910 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/472 2023-12-04T13:21:42.910 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:21:42.922 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:42.976 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:21:42.976 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-12-04T13:21:43.532 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:21:43.566 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:21:43.639 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:21:43.652 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:21:43.654 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:21:43.657 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:21:43.657 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:44.542 INFO:teuthology.orchestra.run.smithi063.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T13:21:44.558 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/473 2023-12-04T13:21:44.559 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/473 2023-12-04T13:21:44.559 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:21:44.572 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:44.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:21:44.639 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-12-04T13:21:45.283 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:21:45.299 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:21:45.300 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:21:45.304 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:21:45.304 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:46.247 INFO:teuthology.orchestra.run.smithi063.stdout:generic/474 [not run] ceph does not support shutdown 2023-12-04T13:21:46.275 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/474 2023-12-04T13:21:46.275 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/474 2023-12-04T13:21:46.275 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:21:46.286 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:46.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:21:46.332 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-12-04T13:21:46.996 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:21:47.013 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:21:47.016 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:21:47.020 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:21:47.021 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:47.873 INFO:teuthology.orchestra.run.smithi063.stdout:generic/475 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T13:21:47.890 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/475 2023-12-04T13:21:47.891 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/475 2023-12-04T13:21:47.891 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T13:21:47.901 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:21:47.948 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T13:21:47.948 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-12-04T13:21:48.576 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T13:21:48.590 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T13:21:48.591 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T13:21:48.594 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T13:21:48.594 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T13:22:13.725 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:22:13.731 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:22:43.991 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:22:44.007 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:23:15.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:23:15.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:23:45.263 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:23:45.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:24:15.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:24:15.673 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:24:45.858 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:24:45.869 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:25:16.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:25:16.344 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:25:46.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:25:46.564 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:26:17.080 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:26:17.092 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:26:49.281 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:26:49.292 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:26:49.488 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T13:26:49.482+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100898) UID: 0 2023-12-04T13:26:49.490 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T13:26:49.488+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100898) UID: 0 2023-12-04T13:26:49.491 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T13:26:49.489+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100898) UID: 0 2023-12-04T13:26:49.494 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T13:26:49.493+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 100898) UID: 0 2023-12-04T13:30:59.258 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:30:59.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:31:00.249 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T13:31:00.244+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 537428) UID: 0 2023-12-04T13:31:00.250 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T13:31:00.246+0000 7effea0e4640 -1 Fail to open '/proc/537428/cmdline' error = (2) No such file or directory 2023-12-04T13:31:00.250 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T13:31:00.246+0000 7effea0e4640 -1 received signal: Hangup from (PID: 537428) UID: 0 2023-12-04T13:36:43.443 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T13:36:43.440+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 537719) UID: 0 2023-12-04T13:36:43.444 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T13:36:43.440+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 537719) UID: 0 2023-12-04T13:36:43.445 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T13:36:43.440+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 537719) UID: 0 2023-12-04T13:36:43.445 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T13:36:43.440+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 537719) UID: 0 2023-12-04T13:43:47.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:43:47.343 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:43:47.558 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T13:43:47.557+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101120) UID: 0 2023-12-04T13:43:47.561 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T13:43:47.560+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101120) UID: 0 2023-12-04T13:43:47.567 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T13:43:47.565+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101120) UID: 0 2023-12-04T13:43:47.570 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T13:43:47.568+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101120) UID: 0 2023-12-04T13:43:47.857 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T13:43:47.855+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 537825) UID: 0 2023-12-04T13:43:47.858 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T13:43:47.855+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 537825) UID: 0 2023-12-04T13:43:47.858 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T13:43:47.856+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 537825) UID: 0 2023-12-04T13:43:47.859 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T13:43:47.856+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 537825) UID: 0 2023-12-04T13:56:09.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:56:09.358 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T13:56:09.513 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T13:56:09.512+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101235) UID: 0 2023-12-04T13:56:09.514 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T13:56:09.512+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101235) UID: 0 2023-12-04T13:56:09.514 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T13:56:09.512+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101235) UID: 0 2023-12-04T13:56:09.514 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T13:56:09.512+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101235) UID: 0 2023-12-04T13:56:09.819 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T13:56:09.817+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 537956) UID: 0 2023-12-04T13:56:09.819 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T13:56:09.817+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 537956) UID: 0 2023-12-04T14:05:05.157 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T14:05:05.155+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 538071) UID: 0 2023-12-04T14:05:05.158 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T14:05:05.155+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 538071) UID: 0 2023-12-04T14:05:05.158 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T14:05:05.155+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 538071) UID: 0 2023-12-04T14:05:05.158 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T14:05:05.155+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 538071) UID: 0 2023-12-04T14:13:45.100 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:13:45.111 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:13:46.124 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T14:13:46.122+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 538153) UID: 0 2023-12-04T14:13:46.125 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T14:13:46.122+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 538153) UID: 0 2023-12-04T14:13:48.783 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T14:13:48.779+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101379) UID: 0 2023-12-04T14:13:48.796 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T14:13:48.782+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101379) UID: 0 2023-12-04T14:13:48.804 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T14:13:48.803+0000 7f113ab9e640 -1 Fail to open '/proc/101379/cmdline' error = (2) No such file or directory 2023-12-04T14:13:48.804 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T14:13:48.803+0000 7f113ab9e640 -1 received signal: Hangup from (PID: 101379) UID: 0 2023-12-04T14:13:48.804 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T14:13:48.801+0000 7fdfcdee3640 -1 Fail to open '/proc/101379/cmdline' error = (2) No such file or directory 2023-12-04T14:13:48.804 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T14:13:48.801+0000 7fdfcdee3640 -1 received signal: Hangup from (PID: 101379) UID: 0 2023-12-04T14:20:29.712 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T14:20:29.709+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 538187) UID: 0 2023-12-04T14:20:29.713 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T14:20:29.709+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 538187) UID: 0 2023-12-04T14:20:29.713 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T14:20:29.709+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 538187) UID: 0 2023-12-04T14:20:29.713 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T14:20:29.709+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 538187) UID: 0 2023-12-04T14:27:41.443 INFO:teuthology.orchestra.run.smithi063.stdout:generic/476 3953s 2023-12-04T14:27:41.530 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/476 2023-12-04T14:27:41.531 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:27:41.542 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:27:41.581 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:27:41.581 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-12-04T14:27:54.477 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:27:54.509 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:27:54.511 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:27:54.516 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:27:54.516 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:34:10.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:34:11.000 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:34:11.210 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T14:34:11.209+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101510) UID: 0 2023-12-04T14:34:11.210 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T14:34:11.209+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101510) UID: 0 2023-12-04T14:34:11.210 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T14:34:11.209+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101510) UID: 0 2023-12-04T14:34:11.210 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T14:34:11.209+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101510) UID: 0 2023-12-04T14:34:11.393 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T14:34:11.391+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 538551) UID: 0 2023-12-04T14:34:11.393 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T14:34:11.391+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 538551) UID: 0 2023-12-04T14:36:14.662 INFO:teuthology.orchestra.run.smithi063.stdout:generic/477 53s 2023-12-04T14:36:14.922 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/477 2023-12-04T14:36:14.923 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:14.959 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:15.224 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:15.225 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-12-04T14:36:18.855 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:18.870 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:18.871 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:18.874 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:18.874 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:31.447 INFO:teuthology.orchestra.run.smithi063.stdout:generic/478 12s 2023-12-04T14:36:31.471 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/478 2023-12-04T14:36:31.471 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:31.482 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:31.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:31.546 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-12-04T14:36:32.209 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:32.223 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:32.226 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:32.230 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:33.626 INFO:teuthology.orchestra.run.smithi063.stdout:generic/479 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:36:33.637 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/479 2023-12-04T14:36:33.637 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/479 2023-12-04T14:36:33.637 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:33.649 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:33.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:33.710 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-12-04T14:36:34.372 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:34.389 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:34.390 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:34.394 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:34.395 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:35.203 INFO:teuthology.orchestra.run.smithi063.stdout:generic/480 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:36:35.219 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/480 2023-12-04T14:36:35.219 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/480 2023-12-04T14:36:35.219 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:35.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:35.296 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:35.297 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-12-04T14:36:35.996 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:36.012 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:36.015 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:36.019 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:36.019 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:36.789 INFO:teuthology.orchestra.run.smithi063.stdout:generic/481 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:36:36.809 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/481 2023-12-04T14:36:36.809 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/481 2023-12-04T14:36:36.809 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:36.817 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:36.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:36.874 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-12-04T14:36:37.541 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:37.561 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:37.562 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:37.567 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:37.567 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:38.504 INFO:teuthology.orchestra.run.smithi063.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-04T14:36:38.518 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/482 2023-12-04T14:36:38.518 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/482 2023-12-04T14:36:38.518 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:38.528 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:38.571 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:38.571 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-12-04T14:36:39.612 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:39.627 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:39.628 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:39.631 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:39.631 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:40.548 INFO:teuthology.orchestra.run.smithi063.stdout:generic/483 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:36:40.559 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/483 2023-12-04T14:36:40.559 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/483 2023-12-04T14:36:40.559 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:40.569 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:40.609 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:40.609 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-12-04T14:36:41.642 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:41.657 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:41.659 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:41.662 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:41.662 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:42.600 INFO:teuthology.orchestra.run.smithi063.stdout:generic/484 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:36:42.612 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/484 2023-12-04T14:36:42.612 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/484 2023-12-04T14:36:42.613 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:42.621 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:42.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:42.668 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-12-04T14:36:43.333 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:43.352 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:43.355 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:43.358 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:43.358 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:44.154 INFO:teuthology.orchestra.run.smithi063.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-04T14:36:44.168 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/485 2023-12-04T14:36:44.168 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/485 2023-12-04T14:36:44.168 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:44.177 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:44.228 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:44.229 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-12-04T14:36:44.873 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:44.889 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:44.892 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:44.895 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:44.895 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:46.121 INFO:teuthology.orchestra.run.smithi063.stdout:generic/486 1s 2023-12-04T14:36:46.148 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/486 2023-12-04T14:36:46.148 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:46.158 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:46.193 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:46.194 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-12-04T14:36:46.850 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:46.864 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:46.865 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:46.870 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:46.870 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:47.716 INFO:teuthology.orchestra.run.smithi063.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-12-04T14:36:47.732 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/487 2023-12-04T14:36:47.732 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/487 2023-12-04T14:36:47.732 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:47.747 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:47.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:47.804 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-12-04T14:36:48.485 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:48.503 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:48.504 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:48.507 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:48.508 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:49.192 INFO:teuthology.orchestra.run.smithi063.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T14:36:49.206 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/488 2023-12-04T14:36:49.207 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/488 2023-12-04T14:36:49.207 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:49.219 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:49.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:49.269 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-12-04T14:36:49.947 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:49.967 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:49.969 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:49.972 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:49.972 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:50.720 INFO:teuthology.orchestra.run.smithi063.stdout:generic/489 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:36:50.735 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/489 2023-12-04T14:36:50.735 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/489 2023-12-04T14:36:50.735 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:50.746 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:50.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:50.799 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-12-04T14:36:51.479 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:51.490 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:51.491 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:51.494 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:51.494 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:54.116 INFO:teuthology.orchestra.run.smithi063.stdout:generic/490 3s 2023-12-04T14:36:54.134 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/490 2023-12-04T14:36:54.134 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:54.145 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:54.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:54.301 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-12-04T14:36:55.123 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:55.141 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:55.142 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:55.145 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:55.968 INFO:teuthology.orchestra.run.smithi063.stdout:generic/491 [not run] ceph does not support freezing 2023-12-04T14:36:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/491 2023-12-04T14:36:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/491 2023-12-04T14:36:55.983 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:55.995 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:56.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:56.058 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-12-04T14:36:56.719 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:56.737 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:56.739 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:56.741 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:56.742 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:57.458 INFO:teuthology.orchestra.run.smithi063.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-12-04T14:36:57.469 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/492 2023-12-04T14:36:57.469 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/492 2023-12-04T14:36:57.469 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:57.480 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:57.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:57.526 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-12-04T14:36:58.216 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:36:58.233 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:36:58.235 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:36:58.239 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:36:58.240 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:59.349 INFO:teuthology.orchestra.run.smithi063.stdout:generic/493 [not run] swapfiles are not supported 2023-12-04T14:36:59.365 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/493 2023-12-04T14:36:59.365 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/493 2023-12-04T14:36:59.365 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:36:59.381 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:36:59.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:36:59.438 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-12-04T14:37:00.105 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:00.119 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:00.121 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:00.124 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:00.124 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:01.145 INFO:teuthology.orchestra.run.smithi063.stdout:generic/494 [not run] swapfiles are not supported 2023-12-04T14:37:01.159 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/494 2023-12-04T14:37:01.159 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/494 2023-12-04T14:37:01.159 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:01.173 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:01.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:01.228 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-12-04T14:37:01.873 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:01.891 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:01.894 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:01.898 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:01.898 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:02.994 INFO:teuthology.orchestra.run.smithi063.stdout:generic/495 [not run] swapfiles are not supported 2023-12-04T14:37:03.006 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/495 2023-12-04T14:37:03.006 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/495 2023-12-04T14:37:03.006 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:03.015 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:03.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:03.064 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-12-04T14:37:03.735 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:03.752 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:03.754 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:03.757 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:03.758 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:04.826 INFO:teuthology.orchestra.run.smithi063.stdout:generic/496 [not run] swapfiles are not supported 2023-12-04T14:37:04.842 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/496 2023-12-04T14:37:04.842 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/496 2023-12-04T14:37:04.842 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:04.852 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:04.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:04.911 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-12-04T14:37:05.565 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:05.580 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:05.581 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:05.584 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:05.584 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:06.638 INFO:teuthology.orchestra.run.smithi063.stdout:generic/497 [not run] swapfiles are not supported 2023-12-04T14:37:06.653 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/497 2023-12-04T14:37:06.653 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/497 2023-12-04T14:37:06.656 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:06.664 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:06.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:06.709 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-12-04T14:37:07.392 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:07.408 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:07.409 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:07.412 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:07.412 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:08.185 INFO:teuthology.orchestra.run.smithi063.stdout:generic/498 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:37:08.200 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/498 2023-12-04T14:37:08.200 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/498 2023-12-04T14:37:08.201 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:08.210 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:08.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:08.271 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-12-04T14:37:08.939 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:08.952 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:08.953 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:08.957 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:08.957 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:09.681 INFO:teuthology.orchestra.run.smithi063.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-04T14:37:09.694 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/499 2023-12-04T14:37:09.694 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/499 2023-12-04T14:37:09.694 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:09.704 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:09.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:09.770 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-12-04T14:37:10.432 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:10.450 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:10.453 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:10.457 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:10.457 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:11.278 INFO:teuthology.orchestra.run.smithi063.stdout:generic/500 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:37:11.291 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/500 2023-12-04T14:37:11.291 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/500 2023-12-04T14:37:11.291 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:11.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:11.356 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:11.356 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-12-04T14:37:12.035 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:12.053 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:12.055 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:12.059 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:12.059 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:13.220 INFO:teuthology.orchestra.run.smithi063.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T14:37:13.245 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/501 2023-12-04T14:37:13.245 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/501 2023-12-04T14:37:13.245 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:13.262 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:13.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:13.514 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-12-04T14:37:14.129 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:14.145 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:14.146 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:14.150 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:14.150 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:15.105 INFO:teuthology.orchestra.run.smithi063.stdout:generic/502 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:37:15.118 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/502 2023-12-04T14:37:15.118 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/502 2023-12-04T14:37:15.118 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:15.129 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:15.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:15.199 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-12-04T14:37:15.807 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:15.818 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:15.819 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:15.822 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:15.822 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:16.796 INFO:teuthology.orchestra.run.smithi063.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T14:37:16.808 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/503 2023-12-04T14:37:16.808 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/503 2023-12-04T14:37:16.809 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:16.816 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:16.876 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:16.876 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-12-04T14:37:17.555 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:17.572 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:17.574 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:17.578 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:17.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:18.641 INFO:teuthology.orchestra.run.smithi063.stdout:generic/504 1s 2023-12-04T14:37:18.662 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/504 2023-12-04T14:37:18.662 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:18.673 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:18.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:18.728 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-12-04T14:37:19.388 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:19.403 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:19.404 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:19.408 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:19.408 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:20.318 INFO:teuthology.orchestra.run.smithi063.stdout:generic/505 [not run] ceph does not support shutdown 2023-12-04T14:37:20.348 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/505 2023-12-04T14:37:20.348 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/505 2023-12-04T14:37:20.348 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:20.359 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:20.416 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:20.416 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-12-04T14:37:21.058 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:21.076 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:21.077 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:21.082 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:21.082 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:21.973 INFO:teuthology.orchestra.run.smithi063.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T14:37:21.984 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/506 2023-12-04T14:37:21.985 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/506 2023-12-04T14:37:21.985 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:21.994 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:22.035 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:22.035 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-12-04T14:37:22.732 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:22.748 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:22.754 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:22.754 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:23.552 INFO:teuthology.orchestra.run.smithi063.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-04T14:37:23.568 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/507 2023-12-04T14:37:23.568 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/507 2023-12-04T14:37:23.568 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:23.578 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:23.647 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:23.647 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-12-04T14:37:24.327 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:24.342 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:24.343 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:24.348 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:24.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:25.099 INFO:teuthology.orchestra.run.smithi063.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-12-04T14:37:25.114 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/508 2023-12-04T14:37:25.114 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/508 2023-12-04T14:37:25.115 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:25.127 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:25.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:25.177 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-12-04T14:37:25.855 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:25.878 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:25.880 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:25.885 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:25.885 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:26.668 INFO:teuthology.orchestra.run.smithi063.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-12-04T14:37:26.683 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/509 2023-12-04T14:37:26.683 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/509 2023-12-04T14:37:26.684 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:26.695 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:26.753 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:26.753 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-12-04T14:37:27.439 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:27.460 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:27.462 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:27.465 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:27.465 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:28.255 INFO:teuthology.orchestra.run.smithi063.stdout:generic/510 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:37:28.268 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/510 2023-12-04T14:37:28.268 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/510 2023-12-04T14:37:28.269 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:28.278 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:28.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:28.326 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-12-04T14:37:28.965 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:28.982 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:28.984 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:28.987 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:28.987 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:29.697 INFO:teuthology.orchestra.run.smithi063.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-04T14:37:29.716 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/511 2023-12-04T14:37:29.718 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/511 2023-12-04T14:37:29.718 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:29.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:29.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:29.811 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-12-04T14:37:30.504 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:30.522 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:30.524 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:30.528 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:31.302 INFO:teuthology.orchestra.run.smithi063.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T14:37:31.316 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/512 2023-12-04T14:37:31.316 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/512 2023-12-04T14:37:31.316 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:31.326 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:31.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:31.380 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-12-04T14:37:32.047 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:32.060 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:32.061 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:32.064 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:32.064 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:33.155 INFO:teuthology.orchestra.run.smithi063.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T14:37:33.171 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/513 2023-12-04T14:37:33.172 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/513 2023-12-04T14:37:33.172 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:33.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:33.504 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:33.504 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-12-04T14:37:34.189 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:34.205 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:34.206 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:34.210 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:34.210 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:35.325 INFO:teuthology.orchestra.run.smithi063.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T14:37:35.342 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/514 2023-12-04T14:37:35.342 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/514 2023-12-04T14:37:35.343 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:35.357 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:35.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:35.573 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-12-04T14:37:36.287 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:36.303 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:36.305 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:36.309 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:36.309 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:37.446 INFO:teuthology.orchestra.run.smithi063.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T14:37:37.462 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/515 2023-12-04T14:37:37.462 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/515 2023-12-04T14:37:37.462 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:37.473 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:37.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:37.671 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-12-04T14:37:38.397 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:38.411 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:38.412 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:38.416 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:38.416 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:39.224 INFO:teuthology.orchestra.run.smithi063.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-04T14:37:39.235 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/516 2023-12-04T14:37:39.235 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/516 2023-12-04T14:37:39.235 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:39.243 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:39.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:39.373 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-12-04T14:37:40.126 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:40.150 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:40.151 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:40.155 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:40.155 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:41.152 INFO:teuthology.orchestra.run.smithi063.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-04T14:37:41.252 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/517 2023-12-04T14:37:41.253 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/517 2023-12-04T14:37:41.253 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:41.267 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:41.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:41.592 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-12-04T14:37:42.299 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:42.319 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:42.320 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:42.323 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:42.323 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:43.745 INFO:teuthology.orchestra.run.smithi063.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T14:37:43.765 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/518 2023-12-04T14:37:43.765 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/518 2023-12-04T14:37:43.766 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:43.782 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:43.993 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:43.993 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-12-04T14:37:44.684 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:44.699 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:44.705 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:44.709 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:44.709 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:45.497 INFO:teuthology.orchestra.run.smithi063.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-12-04T14:37:45.512 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/519 2023-12-04T14:37:45.513 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/519 2023-12-04T14:37:45.513 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:45.528 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:45.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:45.659 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-12-04T14:37:46.501 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:46.521 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:46.522 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:46.527 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:46.527 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:47.266 INFO:teuthology.orchestra.run.smithi063.stdout:generic/520 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T14:37:47.282 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/520 2023-12-04T14:37:47.283 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/520 2023-12-04T14:37:47.283 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T14:37:47.292 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:37:47.342 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T14:37:47.342 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-12-04T14:37:48.022 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T14:37:48.043 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T14:37:48.045 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T14:37:48.048 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T14:37:48.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T14:43:03.555 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T14:43:03.552+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559823) UID: 0 2023-12-04T14:43:03.555 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T14:43:03.552+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559823) UID: 0 2023-12-04T14:43:03.556 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T14:43:03.552+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559823) UID: 0 2023-12-04T14:43:03.556 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T14:43:03.552+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559823) UID: 0 2023-12-04T14:49:18.640 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:49:18.651 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:49:18.863 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T14:49:18.861+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101558) UID: 0 2023-12-04T14:49:18.864 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T14:49:18.861+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101558) UID: 0 2023-12-04T14:49:18.864 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T14:49:18.861+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101558) UID: 0 2023-12-04T14:49:18.864 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T14:49:18.862+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101558) UID: 0 2023-12-04T14:49:19.176 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T14:49:19.175+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559847) UID: 0 2023-12-04T14:49:19.176 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T14:49:19.175+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559847) UID: 0 2023-12-04T14:49:19.177 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T14:49:19.175+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559847) UID: 0 2023-12-04T14:49:19.177 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T14:49:19.177+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559847) UID: 0 2023-12-04T14:54:32.929 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:54:32.934 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:55:06.755 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:55:06.761 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:55:37.447 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:55:37.453 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:56:08.555 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:56:08.562 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T14:56:08.697 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T14:56:08.696+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559930) UID: 0 2023-12-04T14:56:08.697 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T14:56:08.696+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559930) UID: 0 2023-12-04T14:56:08.698 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T14:56:08.696+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559930) UID: 0 2023-12-04T14:56:08.698 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T14:56:08.696+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 559930) UID: 0 2023-12-04T15:00:16.810 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:00:16.818 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:00:47.269 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:00:47.282 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:01:17.723 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:01:17.729 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:01:47.870 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:01:47.878 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:01:47.996 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T15:01:47.996+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560021) UID: 0 2023-12-04T15:01:47.997 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T15:01:47.996+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560021) UID: 0 2023-12-04T15:01:47.999 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T15:01:47.996+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560021) UID: 0 2023-12-04T15:01:47.999 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T15:01:47.999+0000 7faa95261640 -1 Fail to open '/proc/560021/cmdline' error = (2) No such file or directory 2023-12-04T15:01:47.999 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T15:01:47.999+0000 7faa95261640 -1 received signal: Hangup from (PID: 560021) UID: 0 2023-12-04T15:05:53.713 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:05:53.720 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:06:23.891 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:06:23.897 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:06:54.035 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:06:54.041 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:07:24.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:07:24.179 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:07:54.319 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:07:54.326 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:08:24.467 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:08:24.474 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:08:24.583 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T15:08:24.581+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560137) UID: 0 2023-12-04T15:08:24.583 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T15:08:24.581+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560137) UID: 0 2023-12-04T15:08:24.584 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T15:08:24.581+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560137) UID: 0 2023-12-04T15:08:24.584 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T15:08:24.582+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560137) UID: 0 2023-12-04T15:12:29.401 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:12:29.408 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:12:29.551 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T15:12:29.550+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101868) UID: 0 2023-12-04T15:12:29.552 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T15:12:29.550+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101868) UID: 0 2023-12-04T15:12:29.552 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T15:12:29.550+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101868) UID: 0 2023-12-04T15:12:29.552 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T15:12:29.551+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101868) UID: 0 2023-12-04T15:16:40.576 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:16:40.583 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:16:40.810 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T15:16:40.809+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101891) UID: 0 2023-12-04T15:16:40.812 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T15:16:40.809+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101891) UID: 0 2023-12-04T15:16:40.812 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T15:16:40.810+0000 7fdcb8c4a640 -1 Fail to open '/proc/101891/cmdline' error = (2) No such file or directory 2023-12-04T15:16:40.812 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T15:16:40.810+0000 7fdcb8c4a640 -1 received signal: Hangup from (PID: 101891) UID: 0 2023-12-04T15:16:40.813 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T15:16:40.811+0000 7f113ab9e640 -1 Fail to open '/proc/101891/cmdline' error = (2) No such file or directory 2023-12-04T15:16:40.813 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T15:16:40.811+0000 7f113ab9e640 -1 received signal: Hangup from (PID: 101891) UID: 0 2023-12-04T15:21:07.786 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:21:07.794 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:21:07.936 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T15:21:07.935+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101919) UID: 0 2023-12-04T15:21:07.936 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T15:21:07.936+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101919) UID: 0 2023-12-04T15:21:07.937 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T15:21:07.936+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101919) UID: 0 2023-12-04T15:21:07.937 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T15:21:07.936+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101919) UID: 0 2023-12-04T15:25:07.434 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:25:07.442 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:25:07.564 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T15:25:07.563+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101942) UID: 0 2023-12-04T15:25:07.565 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T15:25:07.564+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101942) UID: 0 2023-12-04T15:25:07.566 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T15:25:07.564+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101942) UID: 0 2023-12-04T15:25:07.567 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T15:25:07.565+0000 7fdcb8c4a640 -1 Fail to open '/proc/101942/cmdline' error = (2) No such file or directory 2023-12-04T15:25:07.567 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T15:25:07.566+0000 7fdcb8c4a640 -1 received signal: Hangup from (PID: 101942) UID: 0 2023-12-04T15:29:23.452 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:29:23.459 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:29:53.647 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:29:53.654 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:30:23.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:30:23.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:30:54.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:30:54.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:31:24.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:31:24.715 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:31:24.831 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T15:31:24.830+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560328) UID: 0 2023-12-04T15:31:24.831 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T15:31:24.830+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560328) UID: 0 2023-12-04T15:31:24.831 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T15:31:24.830+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560328) UID: 0 2023-12-04T15:31:24.832 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T15:31:24.831+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560328) UID: 0 2023-12-04T15:35:26.016 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:35:26.023 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:35:26.140 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T15:35:26.139+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560353) UID: 0 2023-12-04T15:35:26.140 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T15:35:26.139+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560353) UID: 0 2023-12-04T15:35:26.140 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T15:35:26.139+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560353) UID: 0 2023-12-04T15:35:26.141 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T15:35:26.140+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560353) UID: 0 2023-12-04T15:44:13.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:44:13.171 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:44:13.304 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T15:44:13.299+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560384) UID: 0 2023-12-04T15:44:13.304 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T15:44:13.299+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 560384) UID: 0 2023-12-04T15:44:13.315 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T15:44:13.314+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102090) UID: 0 2023-12-04T15:44:13.316 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T15:44:13.314+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102090) UID: 0 2023-12-04T15:44:13.316 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T15:44:13.315+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102090) UID: 0 2023-12-04T15:44:13.317 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T15:44:13.314+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102090) UID: 0 2023-12-04T15:47:43.363 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T15:47:43.360+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560389) UID: 0 2023-12-04T15:47:43.363 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T15:47:43.360+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560389) UID: 0 2023-12-04T15:47:43.364 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T15:47:43.361+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560389) UID: 0 2023-12-04T15:47:43.366 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T15:47:43.364+0000 7faa95261640 -1 Fail to open '/proc/560389/cmdline' error = (2) No such file or directory 2023-12-04T15:47:43.366 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T15:47:43.364+0000 7faa95261640 -1 received signal: Hangup from (PID: 560389) UID: 0 2023-12-04T15:51:59.175 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:51:59.182 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:51:59.367 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T15:51:59.366+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102117) UID: 0 2023-12-04T15:51:59.368 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T15:51:59.366+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102117) UID: 0 2023-12-04T15:51:59.368 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T15:51:59.366+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102117) UID: 0 2023-12-04T15:51:59.368 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T15:51:59.367+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102117) UID: 0 2023-12-04T15:56:14.752 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:56:14.760 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:56:44.917 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:56:44.925 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:57:15.070 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:57:15.076 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:57:45.227 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:57:45.232 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:58:15.376 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:58:15.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:58:45.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:58:45.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:59:16.433 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:59:16.443 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:59:46.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T15:59:46.917 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:00:17.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:00:17.075 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:00:17.184 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T16:00:17.182+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560587) UID: 0 2023-12-04T16:00:17.184 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T16:00:17.182+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560587) UID: 0 2023-12-04T16:00:17.186 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T16:00:17.184+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560587) UID: 0 2023-12-04T16:00:17.187 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T16:00:17.184+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 560587) UID: 0 2023-12-04T16:04:21.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:04:21.362 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:04:51.494 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:04:51.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:05:21.637 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:05:21.647 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:05:40.200 INFO:teuthology.orchestra.run.smithi063.stdout:generic/521 5272s 2023-12-04T16:05:40.255 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/521 2023-12-04T16:05:40.255 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T16:05:40.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T16:05:40.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T16:05:40.380 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-12-04T16:05:41.442 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T16:05:41.458 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T16:05:41.459 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T16:05:41.462 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T16:05:41.462 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T16:05:51.788 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:05:51.793 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:05:51.919 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T16:05:51.917+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102376) UID: 0 2023-12-04T16:05:51.919 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T16:05:51.918+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102376) UID: 0 2023-12-04T16:05:51.919 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T16:05:51.918+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102376) UID: 0 2023-12-04T16:05:51.920 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T16:05:51.918+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102376) UID: 0 2023-12-04T16:09:54.144 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:09:54.152 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:09:54.286 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T16:09:54.283+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561174) UID: 0 2023-12-04T16:09:54.286 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T16:09:54.284+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561174) UID: 0 2023-12-04T16:09:54.287 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T16:09:54.284+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561174) UID: 0 2023-12-04T16:09:54.287 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T16:09:54.284+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561174) UID: 0 2023-12-04T16:09:54.338 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T16:09:54.336+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102401) UID: 0 2023-12-04T16:09:54.338 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T16:09:54.336+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102401) UID: 0 2023-12-04T16:09:54.338 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T16:09:54.336+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102401) UID: 0 2023-12-04T16:09:54.339 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T16:09:54.336+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102401) UID: 0 2023-12-04T16:17:19.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:17:19.943 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:17:51.209 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:17:51.219 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:18:21.357 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:18:21.364 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:18:51.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:18:51.516 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:19:22.297 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:19:22.306 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:19:53.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:19:53.558 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:20:23.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:20:23.716 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:20:53.857 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:20:53.863 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:20:53.964 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T16:20:53.964+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561333) UID: 0 2023-12-04T16:20:53.965 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T16:20:53.964+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561333) UID: 0 2023-12-04T16:20:53.965 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T16:20:53.964+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561333) UID: 0 2023-12-04T16:20:53.965 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T16:20:53.964+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561333) UID: 0 2023-12-04T16:24:57.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:24:57.444 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:25:28.252 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:25:28.260 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:25:58.411 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:25:58.417 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:26:28.544 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:26:28.550 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:26:58.690 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:26:58.697 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:27:28.838 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:27:28.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:27:28.979 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T16:27:28.978+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102674) UID: 0 2023-12-04T16:27:28.979 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T16:27:28.978+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102674) UID: 0 2023-12-04T16:27:28.981 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T16:27:28.980+0000 7fdfcdee3640 -1 received signal: Hangup from (PID: 102674) UID: 0 2023-12-04T16:27:28.982 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T16:27:28.980+0000 7feca2544640 -1 received signal: Hangup from (PID: 102674) UID: 0 2023-12-04T16:31:27.797 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:31:27.806 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:31:27.943 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T16:31:27.942+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561484) UID: 0 2023-12-04T16:31:27.944 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T16:31:27.942+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561484) UID: 0 2023-12-04T16:31:27.944 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T16:31:27.942+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561484) UID: 0 2023-12-04T16:31:27.944 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T16:31:27.942+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561484) UID: 0 2023-12-04T16:40:03.266 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:40:03.303 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:40:03.425 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T16:40:03.425+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102749) UID: 0 2023-12-04T16:40:03.425 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T16:40:03.425+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102749) UID: 0 2023-12-04T16:40:03.426 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T16:40:03.425+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102749) UID: 0 2023-12-04T16:40:03.426 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T16:40:03.425+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102749) UID: 0 2023-12-04T16:44:00.309 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:44:00.315 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:44:30.462 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:44:30.469 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:44:30.588 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T16:44:30.588+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102791) UID: 0 2023-12-04T16:44:30.589 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T16:44:30.588+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102791) UID: 0 2023-12-04T16:44:30.589 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T16:44:30.588+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102791) UID: 0 2023-12-04T16:44:30.589 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T16:44:30.588+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102791) UID: 0 2023-12-04T16:48:33.726 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:48:33.732 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:48:33.849 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T16:48:33.847+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561578) UID: 0 2023-12-04T16:48:33.849 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T16:48:33.847+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561578) UID: 0 2023-12-04T16:48:33.849 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T16:48:33.847+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561578) UID: 0 2023-12-04T16:48:33.850 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T16:48:33.847+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561578) UID: 0 2023-12-04T16:48:33.919 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T16:48:33.918+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102815) UID: 0 2023-12-04T16:48:33.920 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T16:48:33.918+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102815) UID: 0 2023-12-04T16:48:33.920 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T16:48:33.918+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102815) UID: 0 2023-12-04T16:48:33.924 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T16:48:33.921+0000 7feca2544640 -1 Fail to open '/proc/102815/cmdline' error = (2) No such file or directory 2023-12-04T16:48:33.924 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T16:48:33.921+0000 7feca2544640 -1 received signal: Hangup from (PID: 102815) UID: 0 2023-12-04T16:52:50.318 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:52:50.324 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:52:50.447 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T16:52:50.446+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 561602) UID: 0 2023-12-04T16:52:50.447 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T16:52:50.446+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 561602) UID: 0 2023-12-04T16:57:01.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:57:01.659 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:57:31.790 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:57:31.797 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:58:01.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:58:01.946 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:58:32.085 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:58:32.090 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:59:02.825 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:59:02.832 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T16:59:02.942 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T16:59:02.940+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561701) UID: 0 2023-12-04T16:59:02.942 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T16:59:02.940+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561701) UID: 0 2023-12-04T16:59:02.942 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T16:59:02.941+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561701) UID: 0 2023-12-04T16:59:02.944 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T16:59:02.942+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 561701) UID: 0 2023-12-04T17:03:11.264 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:03:11.272 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:03:27.688 INFO:teuthology.orchestra.run.smithi063.stdout:generic/522 3466s 2023-12-04T17:03:27.742 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/522 2023-12-04T17:03:27.742 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:27.753 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:27.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:27.810 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-12-04T17:03:28.641 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:28.658 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:28.660 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:28.664 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:28.664 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:29.710 INFO:teuthology.orchestra.run.smithi063.stdout:generic/523 1s 2023-12-04T17:03:29.728 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/523 2023-12-04T17:03:29.728 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:29.738 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:29.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:29.766 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-12-04T17:03:30.389 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:30.405 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:30.407 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:30.411 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:30.411 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:37.500 INFO:teuthology.orchestra.run.smithi063.stdout:generic/524 7s 2023-12-04T17:03:37.522 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/524 2023-12-04T17:03:37.522 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:37.532 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:37.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:37.564 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-12-04T17:03:38.155 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:38.168 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:38.169 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:38.172 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:38.172 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:39.066 INFO:teuthology.orchestra.run.smithi063.stdout:generic/525 [not run] filesystem does not support huge file size 2023-12-04T17:03:39.091 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/525 2023-12-04T17:03:39.091 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/525 2023-12-04T17:03:39.091 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:39.101 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:39.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:39.147 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-12-04T17:03:39.779 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:39.794 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:39.796 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:39.800 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:39.800 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:40.551 INFO:teuthology.orchestra.run.smithi063.stdout:generic/526 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:03:40.564 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/526 2023-12-04T17:03:40.564 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/526 2023-12-04T17:03:40.564 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:40.574 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:40.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:40.626 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-12-04T17:03:41.281 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:41.294 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:41.296 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:41.300 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:41.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:42.028 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:03:42.033 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:03:42.130 INFO:teuthology.orchestra.run.smithi063.stdout:generic/527 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:03:42.143 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/527 2023-12-04T17:03:42.143 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/527 2023-12-04T17:03:42.143 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:42.152 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:42.207 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:42.207 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-12-04T17:03:42.837 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:42.854 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:42.856 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:42.859 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:42.859 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:43.821 INFO:teuthology.orchestra.run.smithi063.stdout:generic/528 0s 2023-12-04T17:03:44.055 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/528 2023-12-04T17:03:44.055 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:44.062 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:44.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:44.162 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-12-04T17:03:44.920 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:44.935 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:44.937 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:44.941 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:44.942 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:45.995 INFO:teuthology.orchestra.run.smithi063.stdout:generic/529 0s 2023-12-04T17:03:46.014 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/529 2023-12-04T17:03:46.015 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:46.022 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:46.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:46.051 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-12-04T17:03:46.667 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:46.681 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:46.682 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:46.686 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:46.686 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:47.539 INFO:teuthology.orchestra.run.smithi063.stdout:generic/530 [not run] ceph does not support shutdown 2023-12-04T17:03:47.575 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/530 2023-12-04T17:03:47.577 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/530 2023-12-04T17:03:47.577 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:47.586 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:47.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:47.628 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-12-04T17:03:48.251 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:48.266 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:48.267 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:48.270 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:48.270 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:48.929 INFO:teuthology.orchestra.run.smithi063.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-12-04T17:03:48.939 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/531 2023-12-04T17:03:48.939 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/531 2023-12-04T17:03:48.940 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:48.950 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:48.991 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:48.991 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-12-04T17:03:49.616 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:49.631 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:49.633 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:49.636 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:49.636 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:50.391 INFO:teuthology.orchestra.run.smithi063.stdout:generic/532 1s 2023-12-04T17:03:50.409 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/532 2023-12-04T17:03:50.409 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:50.418 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:50.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:50.472 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-12-04T17:03:51.085 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:51.099 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:51.100 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:51.103 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:51.103 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:52.735 INFO:teuthology.orchestra.run.smithi063.stdout:generic/533 1s 2023-12-04T17:03:52.759 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/533 2023-12-04T17:03:52.759 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:52.768 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:52.809 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:52.810 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-12-04T17:03:53.426 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:53.440 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:53.442 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:53.447 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:53.447 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:54.114 INFO:teuthology.orchestra.run.smithi063.stdout:generic/534 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:03:54.128 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/534 2023-12-04T17:03:54.128 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/534 2023-12-04T17:03:54.128 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:54.135 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:54.174 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:54.174 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-12-04T17:03:54.773 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:54.791 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:54.793 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:54.796 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:54.797 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:55.476 INFO:teuthology.orchestra.run.smithi063.stdout:generic/535 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:03:55.488 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/535 2023-12-04T17:03:55.488 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/535 2023-12-04T17:03:55.488 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:55.498 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:55.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:55.537 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-12-04T17:03:56.140 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:56.153 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:56.155 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:56.157 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:56.157 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:56.996 INFO:teuthology.orchestra.run.smithi063.stdout:generic/536 [not run] ceph does not support shutdown 2023-12-04T17:03:57.027 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/536 2023-12-04T17:03:57.028 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/536 2023-12-04T17:03:57.028 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:57.039 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:57.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:57.080 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-12-04T17:03:57.688 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:57.701 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:57.702 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:57.706 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:57.706 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:58.551 INFO:teuthology.orchestra.run.smithi063.stdout:generic/537 [not run] FSTRIM not supported 2023-12-04T17:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/537 2023-12-04T17:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/537 2023-12-04T17:03:58.577 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:03:58.590 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:03:58.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:03:58.628 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-12-04T17:03:59.244 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:03:59.259 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:03:59.260 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:03:59.264 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:03:59.264 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:04:13.771 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:04:13.778 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:04:43.915 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:04:43.921 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:04:44.071 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T17:04:44.070+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103343) UID: 0 2023-12-04T17:04:44.071 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T17:04:44.070+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103343) UID: 0 2023-12-04T17:04:44.071 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T17:04:44.070+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103343) UID: 0 2023-12-04T17:04:44.072 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T17:04:44.070+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103343) UID: 0 2023-12-04T17:04:44.153 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T17:04:44.152+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570376) UID: 0 2023-12-04T17:04:44.154 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T17:04:44.153+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570376) UID: 0 2023-12-04T17:04:44.154 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T17:04:44.152+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570376) UID: 0 2023-12-04T17:04:44.154 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T17:04:44.152+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 570376) UID: 0 2023-12-04T17:08:49.600 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:08:49.610 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:09:20.495 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:09:20.503 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:09:20.631 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T17:09:20.630+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103517) UID: 0 2023-12-04T17:09:20.632 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T17:09:20.630+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103517) UID: 0 2023-12-04T17:09:20.632 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T17:09:20.629+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103517) UID: 0 2023-12-04T17:09:20.633 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T17:09:20.629+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103517) UID: 0 2023-12-04T17:13:16.609 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:13:16.616 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:13:16.737 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T17:13:16.736+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 574609) UID: 0 2023-12-04T17:13:16.737 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T17:13:16.736+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 574609) UID: 0 2023-12-04T17:13:16.738 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T17:13:16.736+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 574609) UID: 0 2023-12-04T17:13:16.738 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T17:13:16.736+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 574609) UID: 0 2023-12-04T17:16:55.885 INFO:teuthology.orchestra.run.smithi063.stdout:generic/538 776s 2023-12-04T17:16:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/538 2023-12-04T17:16:55.940 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:16:55.953 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:16:56.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:16:56.058 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-12-04T17:16:58.012 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:16:58.027 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:16:58.028 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:16:58.032 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:16:58.032 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:00.701 INFO:teuthology.orchestra.run.smithi063.stdout:generic/539 2s 2023-12-04T17:17:00.720 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/539 2023-12-04T17:17:00.720 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:00.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:00.821 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:00.821 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-12-04T17:17:01.598 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:01.615 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:01.617 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:01.621 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:01.621 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:02.690 INFO:teuthology.orchestra.run.smithi063.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T17:17:02.707 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/540 2023-12-04T17:17:02.707 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/540 2023-12-04T17:17:02.708 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:02.719 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:02.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:02.996 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-12-04T17:17:03.621 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:03.638 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:03.640 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:03.643 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:03.643 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:04.652 INFO:teuthology.orchestra.run.smithi063.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T17:17:04.676 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/541 2023-12-04T17:17:04.676 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/541 2023-12-04T17:17:04.676 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:04.694 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:04.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:04.837 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-12-04T17:17:05.548 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:05.561 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:05.563 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:05.566 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:05.566 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:06.585 INFO:teuthology.orchestra.run.smithi063.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T17:17:06.607 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/542 2023-12-04T17:17:06.607 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/542 2023-12-04T17:17:06.608 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:06.630 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:06.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:06.811 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-12-04T17:17:07.502 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:07.517 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:07.519 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:07.522 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:07.522 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:09.199 INFO:teuthology.orchestra.run.smithi063.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T17:17:09.225 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/543 2023-12-04T17:17:09.225 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/543 2023-12-04T17:17:09.225 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:09.238 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:09.520 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:09.520 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-12-04T17:17:10.146 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:10.163 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:10.165 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:10.169 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:10.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:11.207 INFO:teuthology.orchestra.run.smithi063.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T17:17:11.223 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/544 2023-12-04T17:17:11.223 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/544 2023-12-04T17:17:11.223 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:11.235 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:11.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:11.478 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-12-04T17:17:12.116 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:12.130 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:12.131 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:12.134 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:12.134 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:12.886 INFO:teuthology.orchestra.run.smithi063.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-04T17:17:12.901 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/545 2023-12-04T17:17:12.901 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/545 2023-12-04T17:17:12.901 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:12.911 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:12.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:12.978 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-12-04T17:17:13.621 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:13.638 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:13.639 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:13.642 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:13.642 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:14.850 INFO:teuthology.orchestra.run.smithi063.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T17:17:14.863 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/546 2023-12-04T17:17:14.863 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/546 2023-12-04T17:17:14.863 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:14.873 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:14.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:14.925 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-12-04T17:17:15.573 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:15.592 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:15.594 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:15.598 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:15.598 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:16.324 INFO:teuthology.orchestra.run.smithi063.stdout:generic/547 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:17:16.337 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/547 2023-12-04T17:17:16.337 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/547 2023-12-04T17:17:16.337 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:16.348 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:16.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:16.386 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-12-04T17:17:17.015 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:17.031 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:17.034 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:17.038 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:17.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:18.813 INFO:teuthology.orchestra.run.smithi063.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T17:17:18.826 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/548 2023-12-04T17:17:18.827 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/548 2023-12-04T17:17:18.827 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:18.839 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:18.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:18.895 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-12-04T17:17:19.525 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:19.542 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:19.544 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:19.548 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:19.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:21.837 INFO:teuthology.orchestra.run.smithi063.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T17:17:21.850 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/549 2023-12-04T17:17:21.850 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/549 2023-12-04T17:17:21.850 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:21.860 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:21.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:21.902 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-12-04T17:17:22.531 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:22.550 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:22.552 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:22.554 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:22.554 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:23.845 INFO:teuthology.orchestra.run.smithi063.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-12-04T17:17:23.877 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/550 2023-12-04T17:17:23.877 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/550 2023-12-04T17:17:23.877 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:17:23.888 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:23.930 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:17:23.930 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-12-04T17:17:24.372 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:17:24.379 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:17:24.550 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:17:24.565 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:17:24.566 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:17:24.570 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:17:24.570 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:17:54.516 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:17:54.525 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:18:25.325 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:18:25.332 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:18:55.465 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:18:55.472 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:19:25.615 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:19:25.623 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:19:55.771 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:19:55.780 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:20:26.726 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:20:26.737 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:20:26.870 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T17:20:26.868+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104839) UID: 0 2023-12-04T17:20:26.870 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T17:20:26.868+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104839) UID: 0 2023-12-04T17:20:26.871 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T17:20:26.869+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104839) UID: 0 2023-12-04T17:20:26.872 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T17:20:26.868+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104839) UID: 0 2023-12-04T17:20:26.873 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T17:20:26.871+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583848) UID: 0 2023-12-04T17:20:26.873 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T17:20:26.871+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583848) UID: 0 2023-12-04T17:20:26.873 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T17:20:26.872+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583848) UID: 0 2023-12-04T17:20:26.874 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T17:20:26.871+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583848) UID: 0 2023-12-04T17:24:42.819 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:24:42.827 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:25:13.065 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:25:13.072 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:25:43.995 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:25:44.002 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:26:14.238 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:26:14.248 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:26:44.380 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:26:44.391 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:27:14.525 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:27:14.532 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:27:44.664 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:27:44.669 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:27:44.796 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T17:27:44.795+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105439) UID: 0 2023-12-04T17:27:44.797 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T17:27:44.795+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105439) UID: 0 2023-12-04T17:27:44.797 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T17:27:44.795+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105439) UID: 0 2023-12-04T17:27:44.797 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T17:27:44.796+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105439) UID: 0 2023-12-04T17:31:55.463 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:31:55.473 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:32:25.626 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:32:25.633 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:32:56.478 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:32:56.485 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:33:26.622 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:33:26.627 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:33:56.819 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:33:56.827 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:33:56.969 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T17:33:56.968+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105944) UID: 0 2023-12-04T17:33:56.970 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T17:33:56.968+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105944) UID: 0 2023-12-04T17:33:56.970 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T17:33:56.968+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105944) UID: 0 2023-12-04T17:33:56.971 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T17:33:56.968+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105944) UID: 0 2023-12-04T17:37:52.177 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:37:52.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:37:52.632 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T17:37:52.630+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106040) UID: 0 2023-12-04T17:37:52.632 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T17:37:52.630+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106040) UID: 0 2023-12-04T17:37:52.632 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T17:37:52.630+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106040) UID: 0 2023-12-04T17:37:52.633 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T17:37:52.631+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106040) UID: 0 2023-12-04T17:42:06.858 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:42:06.865 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:42:06.996 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T17:42:06.994+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585866) UID: 0 2023-12-04T17:42:06.996 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T17:42:06.994+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585866) UID: 0 2023-12-04T17:42:06.996 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T17:42:06.994+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585866) UID: 0 2023-12-04T17:42:06.996 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T17:42:06.994+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 585866) UID: 0 2023-12-04T17:46:18.426 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:46:18.434 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:46:18.556 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T17:46:18.553+0000 7f6ff4a79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 586053) UID: 0 2023-12-04T17:46:18.557 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T17:46:18.553+0000 7f6a68df1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 586053) UID: 0 2023-12-04T17:46:18.557 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T17:46:18.554+0000 7faa95261640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 586053) UID: 0 2023-12-04T17:46:18.557 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T17:46:18.554+0000 7fa501c84640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 586053) UID: 0 2023-12-04T17:47:17.555 INFO:teuthology.orchestra.run.smithi063.stdout:generic/551 1793s 2023-12-04T17:47:17.617 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/551 2023-12-04T17:47:17.618 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:17.626 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:17.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:17.654 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2023-12-04T17:47:19.883 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:19.901 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:19.903 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:19.907 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:19.908 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:20.967 INFO:teuthology.orchestra.run.smithi063.stdout:generic/552 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:47:20.987 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/552 2023-12-04T17:47:20.987 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/552 2023-12-04T17:47:20.987 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:20.997 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:21.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:21.061 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2023-12-04T17:47:21.729 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:21.746 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:21.749 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:21.753 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:21.753 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:22.612 INFO:teuthology.orchestra.run.smithi063.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2023-12-04T17:47:22.626 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/553 2023-12-04T17:47:22.626 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/553 2023-12-04T17:47:22.626 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:22.637 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:22.758 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:22.758 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2023-12-04T17:47:23.618 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:23.629 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:23.630 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:23.633 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:23.633 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:24.816 INFO:teuthology.orchestra.run.smithi063.stdout:generic/554 [not run] swapfiles are not supported 2023-12-04T17:47:24.829 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/554 2023-12-04T17:47:24.829 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/554 2023-12-04T17:47:24.829 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:24.839 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:24.950 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:24.950 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2023-12-04T17:47:25.780 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:25.797 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:25.799 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:25.803 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:25.803 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:28.517 INFO:teuthology.orchestra.run.smithi063.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2023-12-04T17:47:28.532 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/555 2023-12-04T17:47:28.532 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/555 2023-12-04T17:47:28.532 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:28.544 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:28.669 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:28.670 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2023-12-04T17:47:29.538 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:29.552 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:29.554 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:29.556 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:29.557 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:30.255 INFO:teuthology.orchestra.run.smithi063.stdout:generic/556 [not run] ceph does not support casefold feature 2023-12-04T17:47:30.270 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/556 2023-12-04T17:47:30.271 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/556 2023-12-04T17:47:30.271 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:30.281 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:30.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:30.340 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2023-12-04T17:47:31.016 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:31.033 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:31.035 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:31.039 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:31.039 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:31.788 INFO:teuthology.orchestra.run.smithi063.stdout:generic/557 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:47:31.804 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/557 2023-12-04T17:47:31.804 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/557 2023-12-04T17:47:31.804 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:31.815 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:31.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:31.860 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2023-12-04T17:47:32.538 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:32.555 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:32.557 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:32.562 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:32.562 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:33.292 INFO:teuthology.orchestra.run.smithi063.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-04T17:47:33.309 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/558 2023-12-04T17:47:33.309 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/558 2023-12-04T17:47:33.309 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:33.318 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:33.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:33.373 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2023-12-04T17:47:34.023 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:34.041 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:34.042 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:34.047 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:34.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:34.753 INFO:teuthology.orchestra.run.smithi063.stdout:generic/559 [not run] duperemove utility required, skipped this test 2023-12-04T17:47:34.765 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/559 2023-12-04T17:47:34.765 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/559 2023-12-04T17:47:34.766 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:34.774 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:34.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:34.832 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2023-12-04T17:47:35.480 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:35.495 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:35.497 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:35.501 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:35.501 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:36.209 INFO:teuthology.orchestra.run.smithi063.stdout:generic/560 [not run] duperemove utility required, skipped this test 2023-12-04T17:47:36.221 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/560 2023-12-04T17:47:36.222 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/560 2023-12-04T17:47:36.222 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:36.236 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:36.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:36.275 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2023-12-04T17:47:36.938 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:36.956 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:36.957 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:36.960 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:36.960 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:37.686 INFO:teuthology.orchestra.run.smithi063.stdout:generic/561 [not run] duperemove utility required, skipped this test 2023-12-04T17:47:37.700 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/561 2023-12-04T17:47:37.701 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/561 2023-12-04T17:47:37.702 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:37.712 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:37.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:37.756 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2023-12-04T17:47:38.419 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:38.433 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:38.435 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:38.438 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:38.438 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:39.491 INFO:teuthology.orchestra.run.smithi063.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T17:47:39.508 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/562 2023-12-04T17:47:39.509 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/562 2023-12-04T17:47:39.509 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:39.527 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:39.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:39.792 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2023-12-04T17:47:40.531 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:40.544 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:40.546 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:40.549 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:40.549 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:41.427 INFO:teuthology.orchestra.run.smithi063.stdout:generic/563 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:47:41.442 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/563 2023-12-04T17:47:41.442 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/563 2023-12-04T17:47:41.442 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:41.452 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:41.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:41.500 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2023-12-04T17:47:42.171 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:42.189 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:42.191 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:42.194 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:42.195 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:43.430 INFO:teuthology.orchestra.run.smithi063.stdout:generic/564 1s 2023-12-04T17:47:43.453 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/564 2023-12-04T17:47:43.453 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:43.465 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:43.605 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:43.605 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2023-12-04T17:47:44.383 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:44.403 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:44.405 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:44.408 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:44.408 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:45.661 INFO:teuthology.orchestra.run.smithi063.stdout:generic/565 1s 2023-12-04T17:47:45.683 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/565 2023-12-04T17:47:45.683 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:45.694 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:45.814 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:45.815 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2023-12-04T17:47:46.710 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:46.724 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:46.726 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:46.728 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:46.729 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:47.436 INFO:teuthology.orchestra.run.smithi063.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T17:47:47.451 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/566 2023-12-04T17:47:47.452 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/566 2023-12-04T17:47:47.452 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:47.461 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:47.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:47.517 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2023-12-04T17:47:48.205 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:48.221 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:48.222 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:48.226 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:48.226 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:49.769 INFO:teuthology.orchestra.run.smithi063.stdout:generic/567 1s 2023-12-04T17:47:49.791 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/567 2023-12-04T17:47:49.791 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:49.801 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:49.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:49.832 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2023-12-04T17:47:50.467 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:50.480 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:50.482 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:50.486 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:50.487 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:51.237 INFO:teuthology.orchestra.run.smithi063.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T17:47:51.249 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/568 2023-12-04T17:47:51.249 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/568 2023-12-04T17:47:51.249 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:51.261 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:51.315 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:51.315 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2023-12-04T17:47:52.017 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:52.032 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:52.033 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:52.036 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:52.036 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:52.776 INFO:teuthology.orchestra.run.smithi063.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T17:47:52.798 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/569 2023-12-04T17:47:52.799 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/569 2023-12-04T17:47:52.799 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:52.808 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:52.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:52.859 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2023-12-04T17:47:53.575 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:53.589 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:53.591 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:53.596 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:53.596 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:54.355 INFO:teuthology.orchestra.run.smithi063.stdout:generic/570 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:47:54.368 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/570 2023-12-04T17:47:54.370 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/570 2023-12-04T17:47:54.370 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:54.379 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:54.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:54.429 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2023-12-04T17:47:55.117 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:55.137 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:55.138 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:55.142 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:55.142 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:58.039 INFO:teuthology.orchestra.run.smithi063.stdout:generic/571 [not run] Require fcntl setlease support 2023-12-04T17:47:58.052 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/571 2023-12-04T17:47:58.053 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/571 2023-12-04T17:47:58.053 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:58.063 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:58.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:58.127 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2023-12-04T17:47:58.722 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:47:58.732 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:47:58.734 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:47:58.736 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:47:58.736 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:59.451 INFO:teuthology.orchestra.run.smithi063.stdout:generic/572 [not run] fsverity utility required, skipped this test 2023-12-04T17:47:59.463 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/572 2023-12-04T17:47:59.463 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/572 2023-12-04T17:47:59.463 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:47:59.475 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:47:59.515 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:47:59.516 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2023-12-04T17:48:00.128 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:00.141 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:00.143 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:00.147 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:00.147 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:00.881 INFO:teuthology.orchestra.run.smithi063.stdout:generic/573 [not run] fsverity utility required, skipped this test 2023-12-04T17:48:00.896 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/573 2023-12-04T17:48:00.896 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/573 2023-12-04T17:48:00.896 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:00.905 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:00.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:00.946 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2023-12-04T17:48:01.584 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:01.603 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:01.605 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:01.609 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:01.609 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:02.317 INFO:teuthology.orchestra.run.smithi063.stdout:generic/574 [not run] fsverity utility required, skipped this test 2023-12-04T17:48:02.331 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/574 2023-12-04T17:48:02.331 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/574 2023-12-04T17:48:02.331 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:02.344 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:02.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:02.392 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2023-12-04T17:48:03.076 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:03.093 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:03.094 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:03.098 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:03.098 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:03.826 INFO:teuthology.orchestra.run.smithi063.stdout:generic/575 [not run] fsverity utility required, skipped this test 2023-12-04T17:48:03.841 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/575 2023-12-04T17:48:03.842 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/575 2023-12-04T17:48:03.842 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:03.856 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:03.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:03.899 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2023-12-04T17:48:04.564 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:04.579 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:04.581 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:04.585 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:04.585 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:05.416 INFO:teuthology.orchestra.run.smithi063.stdout:generic/576 [not run] fsverity utility required, skipped this test 2023-12-04T17:48:05.429 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/576 2023-12-04T17:48:05.430 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/576 2023-12-04T17:48:05.430 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:05.438 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:05.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:05.492 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2023-12-04T17:48:06.146 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:06.163 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:06.166 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:06.170 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:06.170 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:06.893 INFO:teuthology.orchestra.run.smithi063.stdout:generic/577 [not run] fsverity utility required, skipped this test 2023-12-04T17:48:06.906 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/577 2023-12-04T17:48:06.906 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/577 2023-12-04T17:48:06.906 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:06.915 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:06.960 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:06.960 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2023-12-04T17:48:07.629 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:07.644 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:07.646 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:07.653 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:07.653 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:08.424 INFO:teuthology.orchestra.run.smithi063.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T17:48:08.440 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/578 2023-12-04T17:48:08.440 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/578 2023-12-04T17:48:08.440 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:08.451 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:08.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:08.509 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2023-12-04T17:48:09.187 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:09.205 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:09.207 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:09.211 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:09.211 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:10.026 INFO:teuthology.orchestra.run.smithi063.stdout:generic/579 [not run] fsverity utility required, skipped this test 2023-12-04T17:48:10.036 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/579 2023-12-04T17:48:10.037 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/579 2023-12-04T17:48:10.037 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:10.048 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:10.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:10.104 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2023-12-04T17:48:10.750 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:10.768 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:10.769 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:10.772 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:10.772 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:14.385 INFO:teuthology.orchestra.run.smithi063.stdout:generic/580 3s 2023-12-04T17:48:14.411 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/580 2023-12-04T17:48:14.412 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:14.422 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:14.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:14.450 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2023-12-04T17:48:15.161 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:15.177 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:15.178 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:15.182 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:15.183 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:22.722 INFO:teuthology.orchestra.run.smithi063.stdout:generic/581 7s 2023-12-04T17:48:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/581 2023-12-04T17:48:22.750 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:22.762 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:22.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:22.791 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2023-12-04T17:48:23.471 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:23.486 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:23.488 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:23.491 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:23.491 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:25.348 INFO:teuthology.orchestra.run.smithi063.stdout:generic/582 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T17:48:25.365 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/582 2023-12-04T17:48:25.365 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/582 2023-12-04T17:48:25.365 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:25.378 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:25.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:25.459 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2023-12-04T17:48:26.095 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:26.112 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:26.113 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:26.117 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:26.117 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:28.180 INFO:teuthology.orchestra.run.smithi063.stdout:generic/583 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-04T17:48:28.192 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/583 2023-12-04T17:48:28.193 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/583 2023-12-04T17:48:28.193 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:28.200 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:28.270 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:28.270 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2023-12-04T17:48:28.954 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:28.972 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:28.973 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:28.979 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:28.979 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:30.351 INFO:teuthology.orchestra.run.smithi063.stdout:generic/584 [not run] encryption policy '-c 9 -n 9 -v 2 -f 0' is unusable; probably missing kernel crypto API support 2023-12-04T17:48:30.405 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/584 2023-12-04T17:48:30.405 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/584 2023-12-04T17:48:30.405 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:30.417 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:30.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:30.456 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2023-12-04T17:48:31.060 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:31.077 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:31.080 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:31.083 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:31.083 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:33.979 INFO:teuthology.orchestra.run.smithi063.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2023-12-04T17:48:33.994 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/585 2023-12-04T17:48:33.994 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/585 2023-12-04T17:48:33.995 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:34.007 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:34.093 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:34.093 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2023-12-04T17:48:34.976 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:34.995 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:34.997 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:35.001 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:35.001 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:36.016 INFO:teuthology.orchestra.run.smithi063.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T17:48:36.028 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/586 2023-12-04T17:48:36.029 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/586 2023-12-04T17:48:36.029 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:36.038 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:36.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:36.153 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2023-12-04T17:48:37.026 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:37.043 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:37.044 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:37.047 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:37.047 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:38.209 INFO:teuthology.orchestra.run.smithi063.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T17:48:38.222 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/587 2023-12-04T17:48:38.222 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/587 2023-12-04T17:48:38.222 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:38.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:38.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:38.292 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2023-12-04T17:48:39.016 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:39.031 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:39.032 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:39.036 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:39.036 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:40.215 INFO:teuthology.orchestra.run.smithi063.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T17:48:40.237 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/588 2023-12-04T17:48:40.237 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/588 2023-12-04T17:48:40.237 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:40.250 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:40.494 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:40.494 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2023-12-04T17:48:41.203 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:41.220 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:41.222 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:41.224 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:41.224 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:41.963 INFO:teuthology.orchestra.run.smithi063.stdout:generic/589 [not run] require 172.21.15.63:6789:/scratch to be local device 2023-12-04T17:48:41.975 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/589 2023-12-04T17:48:41.975 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/589 2023-12-04T17:48:41.975 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:41.985 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:42.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:42.033 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2023-12-04T17:48:42.726 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:42.741 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:42.742 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:42.746 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:42.746 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:43.493 INFO:teuthology.orchestra.run.smithi063.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T17:48:43.509 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/590 2023-12-04T17:48:43.509 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/590 2023-12-04T17:48:43.509 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:43.519 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:43.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:43.578 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2023-12-04T17:48:44.235 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:44.252 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:44.255 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:44.258 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:44.258 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:45.267 INFO:teuthology.orchestra.run.smithi063.stdout:generic/591 1s 2023-12-04T17:48:45.289 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/591 2023-12-04T17:48:45.291 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:45.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:45.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:45.429 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2023-12-04T17:48:46.303 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:46.320 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:46.322 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:46.329 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:46.329 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:47.975 INFO:teuthology.orchestra.run.smithi063.stdout:generic/592 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 8' 2023-12-04T17:48:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/592 2023-12-04T17:48:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/592 2023-12-04T17:48:48.005 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:48.013 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:48.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:48.066 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2023-12-04T17:48:48.864 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:48.886 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:48.888 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:48.895 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:48.895 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:52.843 INFO:teuthology.orchestra.run.smithi063.stdout:generic/593 3s 2023-12-04T17:48:52.864 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/593 2023-12-04T17:48:52.864 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:52.876 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:52.911 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:52.911 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2023-12-04T17:48:53.579 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:53.595 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:53.596 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:53.599 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:53.599 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:54.351 INFO:teuthology.orchestra.run.smithi063.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T17:48:54.364 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/594 2023-12-04T17:48:54.365 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/594 2023-12-04T17:48:54.365 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:48:54.373 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:48:54.433 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:48:54.433 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2023-12-04T17:48:55.109 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:48:55.130 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:48:55.131 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:48:55.135 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:48:55.135 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:01.739 INFO:teuthology.orchestra.run.smithi063.stdout:generic/595 6s 2023-12-04T17:49:01.775 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/595 2023-12-04T17:49:01.775 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:01.785 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:01.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:01.826 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2023-12-04T17:49:02.658 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:02.672 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:02.673 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:02.676 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:02.676 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:03.556 INFO:teuthology.orchestra.run.smithi063.stdout:generic/596 [not run] file system doesn't support chattr +S 2023-12-04T17:49:03.569 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/596 2023-12-04T17:49:03.570 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/596 2023-12-04T17:49:03.570 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:03.581 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:03.653 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:03.654 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2023-12-04T17:49:04.361 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:04.377 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:04.379 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:04.382 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:04.382 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:09.291 INFO:teuthology.orchestra.run.smithi063.stdout:generic/597 5s 2023-12-04T17:49:09.314 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/597 2023-12-04T17:49:09.315 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:09.328 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:09.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:09.453 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2023-12-04T17:49:10.337 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:10.357 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:10.358 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:10.362 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:10.362 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:12.291 INFO:teuthology.orchestra.run.smithi063.stdout:generic/598 2s 2023-12-04T17:49:12.311 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/598 2023-12-04T17:49:12.311 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:12.321 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:12.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:12.447 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2023-12-04T17:49:13.312 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:13.327 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:13.328 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:13.332 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:13.333 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:14.284 INFO:teuthology.orchestra.run.smithi063.stdout:generic/599 [not run] ceph does not support shutdown 2023-12-04T17:49:14.316 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/599 2023-12-04T17:49:14.316 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/599 2023-12-04T17:49:14.316 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:14.327 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:14.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:14.374 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2023-12-04T17:49:15.045 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:15.064 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:15.065 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:15.068 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:15.068 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:15.778 INFO:teuthology.orchestra.run.smithi063.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T17:49:15.792 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/600 2023-12-04T17:49:15.792 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/600 2023-12-04T17:49:15.792 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:15.802 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:15.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:15.850 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2023-12-04T17:49:16.534 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:16.551 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:16.553 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:16.557 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:16.557 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:17.296 INFO:teuthology.orchestra.run.smithi063.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T17:49:17.310 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/601 2023-12-04T17:49:17.311 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/601 2023-12-04T17:49:17.311 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:17.322 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:17.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:17.371 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2023-12-04T17:49:17.983 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:18.001 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:18.003 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:18.010 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:18.011 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:19.812 INFO:teuthology.orchestra.run.smithi063.stdout:generic/602 [not run] kernel does not support encryption policy: '-c 1 -n 4 -v 2 -f 16' 2023-12-04T17:49:19.849 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/602 2023-12-04T17:49:19.851 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/602 2023-12-04T17:49:19.851 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:19.861 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:19.904 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:19.905 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2023-12-04T17:49:20.682 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:20.696 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:20.698 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:20.703 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:20.703 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:21.473 INFO:teuthology.orchestra.run.smithi063.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-04T17:49:21.487 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/603 2023-12-04T17:49:21.487 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/603 2023-12-04T17:49:21.487 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:21.497 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:21.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:21.541 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2023-12-04T17:49:22.211 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:22.224 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:22.226 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:22.229 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:22.230 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:29.284 INFO:teuthology.orchestra.run.smithi063.stdout:generic/604 7s 2023-12-04T17:49:29.305 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/604 2023-12-04T17:49:29.306 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:29.316 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:29.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:29.352 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2023-12-04T17:49:30.053 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:30.075 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:30.077 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:30.081 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:30.081 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:32.702 INFO:teuthology.orchestra.run.smithi063.stdout:generic/605 [not run] mount 172.21.15.63:6789:/scratch with dax=always failed 2023-12-04T17:49:32.718 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/605 2023-12-04T17:49:32.718 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/605 2023-12-04T17:49:32.718 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:32.730 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:32.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:32.835 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2023-12-04T17:49:33.504 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:33.520 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:33.522 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:33.526 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:33.526 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:34.415 INFO:teuthology.orchestra.run.smithi063.stdout:generic/606 [not run] mount 172.21.15.63:6789:/scratch with dax=always failed 2023-12-04T17:49:34.429 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/606 2023-12-04T17:49:34.429 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/606 2023-12-04T17:49:34.429 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:34.440 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:34.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:34.482 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2023-12-04T17:49:35.083 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:35.098 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:35.100 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:35.104 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:35.105 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:35.876 INFO:teuthology.orchestra.run.smithi063.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2023-12-04T17:49:35.889 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/607 2023-12-04T17:49:35.889 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/607 2023-12-04T17:49:35.889 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:35.899 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:35.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:35.992 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2023-12-04T17:49:36.854 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:36.870 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:36.871 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:36.875 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:36.875 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:37.802 INFO:teuthology.orchestra.run.smithi063.stdout:generic/608 [not run] mount 172.21.15.63:6789:/scratch with dax=always failed 2023-12-04T17:49:37.816 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/608 2023-12-04T17:49:37.816 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/608 2023-12-04T17:49:37.816 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:37.824 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:37.867 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:37.867 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2023-12-04T17:49:38.566 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:38.580 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:38.581 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:38.584 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:38.585 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:39.678 INFO:teuthology.orchestra.run.smithi063.stdout:generic/609 1s 2023-12-04T17:49:39.695 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/609 2023-12-04T17:49:39.695 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:39.706 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:39.816 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:39.817 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2023-12-04T17:49:40.693 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:40.709 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:40.711 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:40.715 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:40.715 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:41.832 INFO:teuthology.orchestra.run.smithi063.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-04T17:49:41.843 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/610 2023-12-04T17:49:41.843 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/610 2023-12-04T17:49:41.844 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:41.852 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:41.916 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:41.917 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2023-12-04T17:49:42.528 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:42.543 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:42.545 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:42.548 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:42.548 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:44.293 INFO:teuthology.orchestra.run.smithi063.stdout:generic/611 2s 2023-12-04T17:49:44.309 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/611 2023-12-04T17:49:44.309 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:44.322 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:44.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:44.361 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2023-12-04T17:49:45.065 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:45.084 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:45.085 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:45.089 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:45.089 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:45.942 INFO:teuthology.orchestra.run.smithi063.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T17:49:45.955 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/612 2023-12-04T17:49:45.955 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/612 2023-12-04T17:49:45.955 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:45.966 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:46.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:46.082 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2023-12-04T17:49:46.928 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:46.941 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:46.943 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:46.945 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:46.945 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:48.687 INFO:teuthology.orchestra.run.smithi063.stdout:generic/613 [not run] _get_encryption_nonce() isn't implemented on ceph 2023-12-04T17:49:48.712 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/613 2023-12-04T17:49:48.712 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/613 2023-12-04T17:49:48.712 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:48.726 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:48.972 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:48.972 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2023-12-04T17:49:49.688 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:49.702 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:49.703 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:49.707 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:49.707 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:50.713 INFO:teuthology.orchestra.run.smithi063.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2023-12-04T17:49:50.748 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/614 2023-12-04T17:49:50.748 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/614 2023-12-04T17:49:50.749 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:49:50.757 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:49:50.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:49:50.809 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2023-12-04T17:49:51.481 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:49:51.497 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:49:51.499 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:49:51.502 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:49:51.503 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:31.869 INFO:teuthology.orchestra.run.smithi063.stdout:generic/615 100s 2023-12-04T17:51:31.892 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/615 2023-12-04T17:51:31.892 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:31.912 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:31.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:31.958 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2023-12-04T17:51:32.975 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:33.002 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:33.008 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:33.011 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:33.012 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:34.143 INFO:teuthology.orchestra.run.smithi063.stdout:generic/616 [not run] kernel does not support IO_URING 2023-12-04T17:51:34.160 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/616 2023-12-04T17:51:34.160 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/616 2023-12-04T17:51:34.160 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:34.174 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:34.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:34.252 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2023-12-04T17:51:35.256 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:35.284 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:35.286 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:35.293 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:35.293 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:36.571 INFO:teuthology.orchestra.run.smithi063.stdout:generic/617 [not run] kernel does not support IO_URING 2023-12-04T17:51:36.591 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/617 2023-12-04T17:51:36.591 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/617 2023-12-04T17:51:36.592 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:36.603 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:36.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:36.693 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2023-12-04T17:51:37.539 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:37.557 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:37.560 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:37.570 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:37.570 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:39.637 INFO:teuthology.orchestra.run.smithi063.stdout:generic/618 2s 2023-12-04T17:51:39.665 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/618 2023-12-04T17:51:39.665 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:39.683 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:39.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:39.728 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2023-12-04T17:51:40.711 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:40.741 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:40.745 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:40.751 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:40.751 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:41.585 INFO:teuthology.orchestra.run.smithi063.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-04T17:51:41.595 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/619 2023-12-04T17:51:41.595 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/619 2023-12-04T17:51:41.596 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:41.605 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:41.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:41.646 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2023-12-04T17:51:42.183 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:42.197 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:42.198 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:42.202 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:42.202 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:42.922 INFO:teuthology.orchestra.run.smithi063.stdout:generic/620 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:51:42.938 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/620 2023-12-04T17:51:42.938 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/620 2023-12-04T17:51:42.938 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:42.951 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:43.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:43.004 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2023-12-04T17:51:43.581 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:43.593 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:43.594 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:43.596 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:43.597 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:45.314 INFO:teuthology.orchestra.run.smithi063.stdout:generic/621 [not run] kernel doesn't support renameat2 syscall 2023-12-04T17:51:45.324 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/621 2023-12-04T17:51:45.324 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/621 2023-12-04T17:51:45.324 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:45.331 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:45.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:45.429 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2023-12-04T17:51:46.158 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:46.170 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:46.172 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:46.174 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:46.174 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:46.953 INFO:teuthology.orchestra.run.smithi063.stdout:generic/622 [not run] ceph does not support shutdown 2023-12-04T17:51:46.973 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/622 2023-12-04T17:51:46.973 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/622 2023-12-04T17:51:46.973 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:46.981 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:47.014 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:47.015 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2023-12-04T17:51:47.574 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:47.589 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:47.590 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:47.594 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:47.594 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:48.355 INFO:teuthology.orchestra.run.smithi063.stdout:generic/623 [not run] ceph does not support shutdown 2023-12-04T17:51:48.388 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/623 2023-12-04T17:51:48.388 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/623 2023-12-04T17:51:48.389 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:48.399 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:48.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:48.437 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2023-12-04T17:51:48.997 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:49.011 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:49.012 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:49.015 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:49.015 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:49.601 INFO:teuthology.orchestra.run.smithi063.stdout:generic/624 [not run] fsverity utility required, skipped this test 2023-12-04T17:51:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/624 2023-12-04T17:51:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/624 2023-12-04T17:51:49.613 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:49.622 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:49.658 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:49.658 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2023-12-04T17:51:50.232 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:50.244 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:50.246 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:50.249 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:50.249 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:50.848 INFO:teuthology.orchestra.run.smithi063.stdout:generic/625 [not run] fsverity utility required, skipped this test 2023-12-04T17:51:50.859 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/625 2023-12-04T17:51:50.859 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/625 2023-12-04T17:51:50.859 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:50.867 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:50.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:50.906 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2023-12-04T17:51:51.451 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:51.464 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:51.466 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:51.469 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:51.469 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:52.230 INFO:teuthology.orchestra.run.smithi063.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2023-12-04T17:51:52.243 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/626 2023-12-04T17:51:52.243 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/626 2023-12-04T17:51:52.243 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:52.253 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:52.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:52.335 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2023-12-04T17:51:53.083 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:53.095 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:53.097 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:53.100 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:53.100 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:53.857 INFO:teuthology.orchestra.run.smithi063.stdout:generic/627 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:51:53.869 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/627 2023-12-04T17:51:53.869 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/627 2023-12-04T17:51:53.869 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:53.877 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:53.921 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:53.922 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2023-12-04T17:51:54.446 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:54.459 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:54.460 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:54.463 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:54.464 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:55.598 INFO:teuthology.orchestra.run.smithi063.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T17:51:55.611 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/628 2023-12-04T17:51:55.611 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/628 2023-12-04T17:51:55.611 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:55.623 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:55.957 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:55.957 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2023-12-04T17:51:56.452 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:56.465 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:56.466 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:56.469 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:56.469 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:57.120 INFO:teuthology.orchestra.run.smithi063.stdout:generic/629 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:51:57.131 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/629 2023-12-04T17:51:57.131 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/629 2023-12-04T17:51:57.131 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:57.139 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:57.181 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:57.181 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2023-12-04T17:51:57.777 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:57.791 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:57.793 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:57.796 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:57.796 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:58.706 INFO:teuthology.orchestra.run.smithi063.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-04T17:51:58.837 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/630 2023-12-04T17:51:58.837 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/630 2023-12-04T17:51:58.837 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:51:58.848 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:51:59.310 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:51:59.311 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2023-12-04T17:51:59.812 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:51:59.825 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:51:59.826 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:51:59.829 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:51:59.829 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:32.065 INFO:teuthology.orchestra.run.smithi063.stdout:generic/631 - output mismatch (see /tmp/tmp.Qs710hMD8ixfstests-dev/results//generic/631.out.bad) 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: --- tests/generic/631.out 2023-12-04 10:45:43.632132591 +0000 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: +++ /tmp/tmp.Qs710hMD8ixfstests-dev/results//generic/631.out.bad 2023-12-04 17:52:32.018358639 +0000 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: @@ -1,2 +1,4022 @@ 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: QA output created by 631 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.088 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.089 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.090 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.091 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.092 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf' 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted.umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.093 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.094 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.095 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.096 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.097 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.098 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.099 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.100 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.101 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.102 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.103 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.104 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.105 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.106 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.107 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.108 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.109 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'touch: : No such file or directorycannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf' 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.110 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.111 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.112 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directorytouch: 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.113 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.114 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.115 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted./tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.116 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.117 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.118 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.119 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directorymv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.120 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.121 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.122 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf' 2023-12-04T17:52:32.123 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.124 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.125 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.126 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.127 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.128 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.129 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.130 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.131 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directorymv: 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.132 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.133 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.134 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.135 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.136 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.137 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.138 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.139 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.140 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: touch: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directorycannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf' 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.141 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.142 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.143 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.144 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.145 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.146 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.147 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.148 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.149 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.150 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.151 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.152 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.153 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.154 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.155 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.156 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf'umount: : No such file or directory/tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.157 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.158 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.159 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.160 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.161 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.167 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.168 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.169 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.170 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.171 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.172 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.173 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.174 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.175 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.176 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.177 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.178 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.179 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.180 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.181 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.182 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.183 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.184 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.185 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.186 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: mv: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.187 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.188 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.189 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.190 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: umount: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf'/tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.191 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.192 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.193 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.194 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.195 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.196 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.197 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.198 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.199 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mount: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'/tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.: No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.200 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.201 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.202 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.203 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.204 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.205 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.206 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.207 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.208 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.209 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.210 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf'cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.211 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.212 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.213 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.214 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.215 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.216 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.217 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.218 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.219 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.220 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.221 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.222 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.223 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf'mount: : No such file or directory/tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.224 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: umount: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'/tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.225 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.226 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.227 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.228 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.229 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.230 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.231 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.232 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.233 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.234 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.235 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.236 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.237 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.238 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.239 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.240 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.241 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.242 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.243 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.244 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.245 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.246 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.247 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.248 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.249 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.250 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.251 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.252 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.253 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.254 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.255 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.256 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.257 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.258 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.259 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.260 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.261 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.262 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.263 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.264 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.265 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.266 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.267 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.268 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.269 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.270 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted./tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.271 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.272 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf'cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.273 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted./tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.274 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.275 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf'cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.276 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.277 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.278 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.279 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.280 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.281 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.282 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.283 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.284 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.285 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.286 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.287 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.288 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf'mv: : No such file or directorycannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf' 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf'touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.289 INFO:teuthology.orchestra.run.smithi063.stdout: +: No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.290 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.291 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.292 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.293 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.294 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.295 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.296 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.297 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.298 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.299 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.300 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.301 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.302 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.303 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.304 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.305 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.306 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.307 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted.umount: 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.308 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.309 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.310 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.311 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.312 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.313 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted.umount: 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.314 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.315 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.316 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.317 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.318 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.319 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.320 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.321 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.322 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.323 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.324 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.325 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.326 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.327 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.328 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.329 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.330 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.331 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.332 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.333 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.334 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.335 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.336 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.337 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.338 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.339 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.340 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.341 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.342 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.343 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.344 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.345 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.346 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.347 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.348 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.349 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.350 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.351 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.352 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.353 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.354 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.355 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.356 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.357 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.358 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.359 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.360 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.361 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.362 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.363 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.364 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.365 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.366 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.367 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged4/etc/access.conf': No such file or directory 2023-12-04T17:52:32.368 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged4: not mounted. 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: /tmp/tmp.dLsp01GiBascratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +mount: mount: /tmp/tmp.dLsp01GiBascratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: /tmp/tmp.dLsp01GiBascratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +/tmp/tmp.dLsp01GiBascratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.dLsp01GiBascratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: + 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.369 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +mv: cannot stat '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged3/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged5/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged1/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged2/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +touch: cannot touch '/tmp/tmp.dLsp01GiBascratch/merged0/etc/access.conf': No such file or directory 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged5: not mounted. 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged2: not mounted. 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged3: not mounted. 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged1: not mounted. 2023-12-04T17:52:32.370 INFO:teuthology.orchestra.run.smithi063.stdout: +umount: /tmp/tmp.dLsp01GiBascratch/merged0: not mounted. 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout: Silence is golden. 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout:HINT: You _MAY_ be missing kernel fix: 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/631 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout:Failures: generic/631 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout:Failed 1 of 1 tests 2023-12-04T17:52:32.371 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:32.371 INFO:tasks.cephfs.xfstests_dev:Command failed 2023-12-04T17:52:32.371 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2023-12-04T17:52:32.372 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2023-12-04T17:52:32.937 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:32.955 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:32.956 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:32.959 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:32.959 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:36.272 INFO:teuthology.orchestra.run.smithi063.stdout:generic/632 3s 2023-12-04T17:52:36.291 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/632 2023-12-04T17:52:36.291 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:36.300 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:36.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:36.366 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2023-12-04T17:52:36.940 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:36.952 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:36.954 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:36.956 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:36.957 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:42.156 INFO:teuthology.orchestra.run.smithi063.stdout:generic/633 5s 2023-12-04T17:52:42.178 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/633 2023-12-04T17:52:42.178 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:42.187 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:42.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:42.332 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2023-12-04T17:52:43.098 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:43.109 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:43.111 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:43.113 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:43.113 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:44.855 INFO:teuthology.orchestra.run.smithi063.stdout:generic/634 1s 2023-12-04T17:52:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/634 2023-12-04T17:52:44.868 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:44.875 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:44.897 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:44.898 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2023-12-04T17:52:45.444 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:45.456 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:45.457 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:45.461 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:45.461 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:46.327 INFO:teuthology.orchestra.run.smithi063.stdout:generic/635 [not run] ceph does not support shutdown 2023-12-04T17:52:46.357 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/635 2023-12-04T17:52:46.358 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/635 2023-12-04T17:52:46.358 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:46.369 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:46.412 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:46.412 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2023-12-04T17:52:46.983 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:46.994 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:46.996 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:46.998 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:46.999 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:48.001 INFO:teuthology.orchestra.run.smithi063.stdout:generic/636 [not run] swapfiles are not supported 2023-12-04T17:52:48.014 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/636 2023-12-04T17:52:48.015 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/636 2023-12-04T17:52:48.015 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:48.025 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:48.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:48.086 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2023-12-04T17:52:48.675 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:48.690 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:48.691 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:48.694 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:48.695 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:50.197 INFO:teuthology.orchestra.run.smithi063.stdout:generic/637 2s 2023-12-04T17:52:50.211 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/637 2023-12-04T17:52:50.211 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:50.219 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:50.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:50.491 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2023-12-04T17:52:51.125 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:51.140 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:51.141 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:51.145 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:51.145 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:51.959 INFO:teuthology.orchestra.run.smithi063.stdout:generic/638 0s 2023-12-04T17:52:51.977 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/638 2023-12-04T17:52:51.978 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:51.987 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:52.050 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:52.050 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2023-12-04T17:52:52.621 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:52.635 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:52.637 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:52.640 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:52.640 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:53.519 INFO:teuthology.orchestra.run.smithi063.stdout:generic/639 1s 2023-12-04T17:52:53.536 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/639 2023-12-04T17:52:53.537 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:53.546 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:53.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:53.610 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2023-12-04T17:52:54.189 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:54.203 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:54.205 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:54.208 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:54.208 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:54.920 INFO:teuthology.orchestra.run.smithi063.stdout:generic/640 [not run] require 172.21.15.63:6789:/scratch to be valid block disk 2023-12-04T17:52:54.933 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/640 2023-12-04T17:52:54.933 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/640 2023-12-04T17:52:54.933 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:54.944 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:54.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:54.990 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2023-12-04T17:52:55.583 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:55.597 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:55.599 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:55.602 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:55.602 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:56.577 INFO:teuthology.orchestra.run.smithi063.stdout:generic/641 [not run] swapfiles are not supported 2023-12-04T17:52:56.589 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/641 2023-12-04T17:52:56.589 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/641 2023-12-04T17:52:56.589 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T17:52:56.599 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:52:56.666 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T17:52:56.667 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2023-12-04T17:52:57.240 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T17:52:57.251 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T17:52:57.253 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T17:52:57.256 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T17:52:57.256 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T17:57:55.153 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:57:55.166 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T17:57:55.286 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T17:57:55.285+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 669374) UID: 0 2023-12-04T17:57:55.286 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T17:57:55.285+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 669374) UID: 0 2023-12-04T17:57:55.294 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T17:57:55.291+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106937) UID: 0 2023-12-04T17:57:55.294 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T17:57:55.291+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106937) UID: 0 2023-12-04T17:57:55.294 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T17:57:55.291+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106937) UID: 0 2023-12-04T17:57:55.295 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T17:57:55.291+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106937) UID: 0 2023-12-04T18:02:54.968 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:02:54.976 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:02:55.103 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T18:02:55.101+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 669427) UID: 0 2023-12-04T18:02:55.104 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T18:02:55.101+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 669427) UID: 0 2023-12-04T18:06:12.835 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:06:12.846 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:06:42.982 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:06:42.992 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:06:55.554 INFO:teuthology.orchestra.run.smithi063.stdout:generic/642 838s 2023-12-04T18:06:55.604 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/642 2023-12-04T18:06:55.604 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T18:06:55.612 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:06:55.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T18:06:55.637 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2023-12-04T18:06:59.022 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T18:06:59.036 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T18:06:59.038 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T18:06:59.041 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T18:06:59.041 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:07:13.708 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:07:13.718 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:07:43.854 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:07:43.866 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:08:14.238 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:08:14.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:08:44.377 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:08:44.388 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:09:14.530 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:09:14.545 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:09:14.655 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T18:09:14.653+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 669838) UID: 0 2023-12-04T18:09:14.656 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T18:09:14.653+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 669838) UID: 0 2023-12-04T18:12:21.738 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:12:21.750 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:12:51.906 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:12:51.918 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:13:22.428 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:13:22.438 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:13:52.576 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:13:52.587 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:13:55.145 INFO:teuthology.orchestra.run.smithi063.stdout:generic/643 [not run] swapfiles are not supported 2023-12-04T18:13:55.155 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/643 2023-12-04T18:13:55.155 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/643 2023-12-04T18:13:55.155 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T18:13:55.162 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:13:55.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T18:13:55.200 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2023-12-04T18:13:55.777 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T18:13:55.792 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T18:13:55.794 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T18:13:55.797 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T18:13:55.798 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:13:56.756 INFO:teuthology.orchestra.run.smithi063.stdout:generic/644 0s 2023-12-04T18:13:56.776 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/644 2023-12-04T18:13:56.776 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T18:13:56.786 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:13:56.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T18:13:56.890 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2023-12-04T18:13:57.609 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T18:13:57.624 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T18:13:57.626 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T18:13:57.629 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T18:13:57.629 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:14:22.738 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:14:22.748 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:14:52.898 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:14:52.910 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:15:23.063 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:15:23.073 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:15:53.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:15:53.227 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:16:25.898 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:16:25.908 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:16:56.064 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:16:56.076 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:17:26.229 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:17:26.241 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:17:56.387 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:17:56.397 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:18:26.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:18:26.553 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:18:26.675 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T18:18:26.672+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 671221) UID: 0 2023-12-04T18:18:26.675 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T18:18:26.672+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 671221) UID: 0 2023-12-04T18:20:01.008 INFO:teuthology.orchestra.run.smithi063.stdout:generic/645 363s 2023-12-04T18:20:01.022 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/645 2023-12-04T18:20:01.022 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T18:20:01.029 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:01.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T18:20:01.090 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2023-12-04T18:20:01.776 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T18:20:01.794 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T18:20:01.796 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T18:20:01.800 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T18:20:01.800 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:02.961 INFO:teuthology.orchestra.run.smithi063.stdout:generic/646 [not run] ceph does not support shutdown 2023-12-04T18:20:02.989 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/646 2023-12-04T18:20:02.990 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/646 2023-12-04T18:20:02.990 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T18:20:03.002 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:03.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T18:20:03.043 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2023-12-04T18:20:03.554 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T18:20:03.565 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T18:20:03.566 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T18:20:03.569 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T18:20:03.569 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:04.628 INFO:teuthology.orchestra.run.smithi063.stdout:generic/647 1s 2023-12-04T18:20:04.642 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/647 2023-12-04T18:20:04.642 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T18:20:04.649 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:04.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T18:20:04.740 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2023-12-04T18:20:06.181 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T18:20:06.198 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T18:20:06.200 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T18:20:06.203 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T18:20:06.203 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:08.957 INFO:teuthology.orchestra.run.smithi063.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-04T18:20:08.973 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/648 2023-12-04T18:20:08.973 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/648 2023-12-04T18:20:08.974 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T18:20:08.985 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:09.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T18:20:09.033 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2023-12-04T18:20:09.619 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T18:20:09.634 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T18:20:09.635 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T18:20:09.639 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T18:20:09.639 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:10.427 INFO:teuthology.orchestra.run.smithi063.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2023-12-04T18:20:10.439 INFO:teuthology.orchestra.run.smithi063.stdout:Ran: generic/649 2023-12-04T18:20:10.439 INFO:teuthology.orchestra.run.smithi063.stdout:Not run: generic/649 2023-12-04T18:20:10.439 INFO:teuthology.orchestra.run.smithi063.stdout:Passed all 1 tests 2023-12-04T18:20:10.448 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:20:10.565 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-04T18:20:10.566 DEBUG:teuthology.orchestra.run.smithi063:> (cd /tmp/tmp.Qs710hMD8ixfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2023-12-04T18:20:11.354 INFO:teuthology.orchestra.run.smithi063.stdout:FSTYP -- ceph 2023-12-04T18:20:11.368 INFO:teuthology.orchestra.run.smithi063.stdout:PLATFORM -- Linux/x86_64 smithi063 6.6.0-g9c0b943f8476 #1 SMP PREEMPT_DYNAMIC Mon Dec 4 06:18:25 UTC 2023 2023-12-04T18:20:11.370 INFO:teuthology.orchestra.run.smithi063.stdout:MKFS_OPTIONS -- 172.21.15.63:6789:/scratch 2023-12-04T18:20:11.373 INFO:teuthology.orchestra.run.smithi063.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAnrW1lijCIJRAAQt9P7mW5I0AJvBF//1NSZA== -o context=system_u:object_r:root_t:s0 172.21.15.63:6789:/scratch /tmp/tmp.dLsp01GiBascratch 2023-12-04T18:20:11.373 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:21:28.913 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:21:28.922 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:21:59.133 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:21:59.144 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:22:29.523 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:22:29.531 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:22:59.932 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:22:59.939 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:23:30.138 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:23:30.153 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:23:30.378 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T18:23:30.374+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107807) UID: 0 2023-12-04T18:23:30.380 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T18:23:30.377+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107807) UID: 0 2023-12-04T18:23:30.400 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T18:23:30.395+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107807) UID: 0 2023-12-04T18:23:30.410 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T18:23:30.406+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107807) UID: 0 2023-12-04T18:27:26.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:27:26.337 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:27:26.465 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T18:27:26.463+0000 7fdfcdee3640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107895) UID: 0 2023-12-04T18:27:26.465 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T18:27:26.463+0000 7f113ab9e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107895) UID: 0 2023-12-04T18:27:26.466 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T18:27:26.463+0000 7feca2544640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107895) UID: 0 2023-12-04T18:27:26.466 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T18:27:26.463+0000 7fdcb8c4a640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107895) UID: 0 2023-12-04T18:34:45.038 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:34:45.047 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:35:16.738 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:35:16.751 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:35:46.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:35:46.989 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:36:17.110 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:36:17.124 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:36:47.262 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:36:47.273 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:37:17.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:37:17.635 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:37:47.922 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:37:47.930 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:38:18.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:38:18.115 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:38:21.446 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T18:38:21.443+0000 7f6a5f401640 -1 bdev(0x55f9bd294e00 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-04T18:38:21.551 INFO:tasks.ceph.osd.3.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f6a5f401640 time 2023-12-04T18:38:21.462086+0000 2023-12-04T18:38:21.551 INFO:tasks.ceph.osd.3.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-04T18:38:21.552 INFO:tasks.ceph.osd.3.smithi063.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:38:21.552 INFO:tasks.ceph.osd.3.smithi063.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55f9b9fa9f31] 2023-12-04T18:38:21.552 INFO:tasks.ceph.osd.3.smithi063.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55f9ba8fc646] 2023-12-04T18:38:21.553 INFO:tasks.ceph.osd.3.smithi063.stderr: 3: ceph-osd(+0xda3a71) [0x55f9ba8dca71] 2023-12-04T18:38:21.553 INFO:tasks.ceph.osd.3.smithi063.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f6a6c29f802] 2023-12-04T18:38:21.553 INFO:tasks.ceph.osd.3.smithi063.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f6a6c23f450] 2023-12-04T18:38:21.553 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T18:38:21.550+0000 7f6a5f401640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f6a5f401640 time 2023-12-04T18:38:21.462086+0000 2023-12-04T18:38:21.553 INFO:tasks.ceph.osd.3.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-04T18:38:21.554 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.554 INFO:tasks.ceph.osd.3.smithi063.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:38:21.554 INFO:tasks.ceph.osd.3.smithi063.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55f9b9fa9f31] 2023-12-04T18:38:21.554 INFO:tasks.ceph.osd.3.smithi063.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55f9ba8fc646] 2023-12-04T18:38:21.554 INFO:tasks.ceph.osd.3.smithi063.stderr: 3: ceph-osd(+0xda3a71) [0x55f9ba8dca71] 2023-12-04T18:38:21.554 INFO:tasks.ceph.osd.3.smithi063.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f6a6c29f802] 2023-12-04T18:38:21.554 INFO:tasks.ceph.osd.3.smithi063.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f6a6c23f450] 2023-12-04T18:38:21.554 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.571 INFO:tasks.ceph.osd.3.smithi063.stderr:*** Caught signal (Aborted) ** 2023-12-04T18:38:21.571 INFO:tasks.ceph.osd.3.smithi063.stderr: in thread 7f6a5f401640 thread_name:bstore_aio 2023-12-04T18:38:21.572 INFO:tasks.ceph.osd.3.smithi063.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:38:21.572 INFO:tasks.ceph.osd.3.smithi063.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f6a6c254db0] 2023-12-04T18:38:21.572 INFO:tasks.ceph.osd.3.smithi063.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f6a6c2a154c] 2023-12-04T18:38:21.572 INFO:tasks.ceph.osd.3.smithi063.stderr: 3: raise() 2023-12-04T18:38:21.572 INFO:tasks.ceph.osd.3.smithi063.stderr: 4: abort() 2023-12-04T18:38:21.572 INFO:tasks.ceph.osd.3.smithi063.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55f9b9fa9ff2] 2023-12-04T18:38:21.572 INFO:tasks.ceph.osd.3.smithi063.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x55f9ba8fc646] 2023-12-04T18:38:21.573 INFO:tasks.ceph.osd.3.smithi063.stderr: 7: ceph-osd(+0xda3a71) [0x55f9ba8dca71] 2023-12-04T18:38:21.573 INFO:tasks.ceph.osd.3.smithi063.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f6a6c29f802] 2023-12-04T18:38:21.573 INFO:tasks.ceph.osd.3.smithi063.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f6a6c23f450] 2023-12-04T18:38:21.606 INFO:tasks.ceph.osd.3.smithi063.stderr:2023-12-04T18:38:21.601+0000 7f6a5f401640 -1 *** Caught signal (Aborted) ** 2023-12-04T18:38:21.606 INFO:tasks.ceph.osd.3.smithi063.stderr: in thread 7f6a5f401640 thread_name:bstore_aio 2023-12-04T18:38:21.606 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.606 INFO:tasks.ceph.osd.3.smithi063.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:38:21.606 INFO:tasks.ceph.osd.3.smithi063.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f6a6c254db0] 2023-12-04T18:38:21.606 INFO:tasks.ceph.osd.3.smithi063.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f6a6c2a154c] 2023-12-04T18:38:21.606 INFO:tasks.ceph.osd.3.smithi063.stderr: 3: raise() 2023-12-04T18:38:21.607 INFO:tasks.ceph.osd.3.smithi063.stderr: 4: abort() 2023-12-04T18:38:21.607 INFO:tasks.ceph.osd.3.smithi063.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55f9b9fa9ff2] 2023-12-04T18:38:21.607 INFO:tasks.ceph.osd.3.smithi063.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x55f9ba8fc646] 2023-12-04T18:38:21.607 INFO:tasks.ceph.osd.3.smithi063.stderr: 7: ceph-osd(+0xda3a71) [0x55f9ba8dca71] 2023-12-04T18:38:21.607 INFO:tasks.ceph.osd.3.smithi063.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f6a6c29f802] 2023-12-04T18:38:21.607 INFO:tasks.ceph.osd.3.smithi063.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f6a6c23f450] 2023-12-04T18:38:21.607 INFO:tasks.ceph.osd.3.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-04T18:38:21.607 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.774 INFO:tasks.ceph.osd.3.smithi063.stderr: -3695> 2023-12-04T18:38:21.443+0000 7f6a5f401640 -1 bdev(0x55f9bd294e00 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-04T18:38:21.780 INFO:tasks.ceph.osd.3.smithi063.stderr: -1167> 2023-12-04T18:38:21.550+0000 7f6a5f401640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f6a5f401640 time 2023-12-04T18:38:21.462086+0000 2023-12-04T18:38:21.780 INFO:tasks.ceph.osd.3.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-04T18:38:21.780 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.780 INFO:tasks.ceph.osd.3.smithi063.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:38:21.780 INFO:tasks.ceph.osd.3.smithi063.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55f9b9fa9f31] 2023-12-04T18:38:21.780 INFO:tasks.ceph.osd.3.smithi063.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55f9ba8fc646] 2023-12-04T18:38:21.780 INFO:tasks.ceph.osd.3.smithi063.stderr: 3: ceph-osd(+0xda3a71) [0x55f9ba8dca71] 2023-12-04T18:38:21.781 INFO:tasks.ceph.osd.3.smithi063.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f6a6c29f802] 2023-12-04T18:38:21.781 INFO:tasks.ceph.osd.3.smithi063.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f6a6c23f450] 2023-12-04T18:38:21.781 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.782 INFO:tasks.ceph.osd.3.smithi063.stderr: -28> 2023-12-04T18:38:21.601+0000 7f6a5f401640 -1 *** Caught signal (Aborted) ** 2023-12-04T18:38:21.782 INFO:tasks.ceph.osd.3.smithi063.stderr: in thread 7f6a5f401640 thread_name:bstore_aio 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f6a6c254db0] 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f6a6c2a154c] 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: 3: raise() 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: 4: abort() 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55f9b9fa9ff2] 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x55f9ba8fc646] 2023-12-04T18:38:21.783 INFO:tasks.ceph.osd.3.smithi063.stderr: 7: ceph-osd(+0xda3a71) [0x55f9ba8dca71] 2023-12-04T18:38:21.784 INFO:tasks.ceph.osd.3.smithi063.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f6a6c29f802] 2023-12-04T18:38:21.784 INFO:tasks.ceph.osd.3.smithi063.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f6a6c23f450] 2023-12-04T18:38:21.784 INFO:tasks.ceph.osd.3.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-04T18:38:21.784 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.802 INFO:tasks.ceph.osd.3.smithi063.stderr: -4919> 2023-12-04T18:38:21.443+0000 7f6a5f401640 -1 bdev(0x55f9bd294e00 /var/lib/ceph/osd/ceph-3/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-04T18:38:21.838 INFO:tasks.ceph.osd.3.smithi063.stderr: -2391> 2023-12-04T18:38:21.550+0000 7f6a5f401640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f6a5f401640 time 2023-12-04T18:38:21.462086+0000 2023-12-04T18:38:21.838 INFO:tasks.ceph.osd.3.smithi063.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-04T18:38:21.838 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.839 INFO:tasks.ceph.osd.3.smithi063.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:38:21.839 INFO:tasks.ceph.osd.3.smithi063.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55f9b9fa9f31] 2023-12-04T18:38:21.839 INFO:tasks.ceph.osd.3.smithi063.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55f9ba8fc646] 2023-12-04T18:38:21.839 INFO:tasks.ceph.osd.3.smithi063.stderr: 3: ceph-osd(+0xda3a71) [0x55f9ba8dca71] 2023-12-04T18:38:21.839 INFO:tasks.ceph.osd.3.smithi063.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f6a6c29f802] 2023-12-04T18:38:21.839 INFO:tasks.ceph.osd.3.smithi063.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f6a6c23f450] 2023-12-04T18:38:21.839 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.839 INFO:tasks.ceph.osd.3.smithi063.stderr: -1252> 2023-12-04T18:38:21.601+0000 7f6a5f401640 -1 *** Caught signal (Aborted) ** 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: in thread 7f6a5f401640 thread_name:bstore_aio 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f6a6c254db0] 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f6a6c2a154c] 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 3: raise() 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 4: abort() 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55f9b9fa9ff2] 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x55f9ba8fc646] 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 7: ceph-osd(+0xda3a71) [0x55f9ba8dca71] 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f6a6c29f802] 2023-12-04T18:38:21.840 INFO:tasks.ceph.osd.3.smithi063.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f6a6c23f450] 2023-12-04T18:38:21.841 INFO:tasks.ceph.osd.3.smithi063.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-04T18:38:21.841 INFO:tasks.ceph.osd.3.smithi063.stderr: 2023-12-04T18:38:22.273 INFO:tasks.ceph.osd.3.smithi063.stderr:daemon-helper: command failed with exit status 5 2023-12-04T18:38:26.248 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-04T18:38:32.862 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~7s 2023-12-04T18:38:39.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~13s 2023-12-04T18:38:46.090 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~20s 2023-12-04T18:38:48.319 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:38:48.329 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:38:52.703 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~26s 2023-12-04T18:38:59.317 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~33s 2023-12-04T18:39:05.931 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~40s 2023-12-04T18:39:12.544 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~46s 2023-12-04T18:39:18.490 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:39:18.496 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:39:19.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~53s 2023-12-04T18:39:25.767 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~60s 2023-12-04T18:39:32.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~66s 2023-12-04T18:39:38.994 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~73s 2023-12-04T18:39:45.605 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~79s 2023-12-04T18:39:48.631 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:39:48.636 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:39:52.216 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~86s 2023-12-04T18:39:58.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~93s 2023-12-04T18:40:05.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~99s 2023-12-04T18:40:12.049 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~106s 2023-12-04T18:40:18.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~112s 2023-12-04T18:40:19.630 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:40:19.645 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:40:25.269 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~119s 2023-12-04T18:40:31.879 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~126s 2023-12-04T18:40:38.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~132s 2023-12-04T18:40:45.100 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~139s 2023-12-04T18:40:49.900 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:40:49.911 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:40:51.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~145s 2023-12-04T18:40:58.321 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~152s 2023-12-04T18:41:04.932 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~159s 2023-12-04T18:41:11.541 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~165s 2023-12-04T18:41:18.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~172s 2023-12-04T18:41:20.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:41:20.121 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:41:24.764 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~179s 2023-12-04T18:41:31.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~185s 2023-12-04T18:41:37.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~192s 2023-12-04T18:41:44.595 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~198s 2023-12-04T18:41:50.563 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:41:50.571 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:41:50.838 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T18:41:50.835+0000 7effea0e4640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 677249) UID: 0 2023-12-04T18:41:50.839 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T18:41:50.835+0000 7f8f22038640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 677249) UID: 0 2023-12-04T18:41:51.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~205s 2023-12-04T18:41:57.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~212s 2023-12-04T18:42:04.426 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~218s 2023-12-04T18:42:11.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~225s 2023-12-04T18:42:17.647 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~231s 2023-12-04T18:42:24.256 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~238s 2023-12-04T18:42:30.867 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~245s 2023-12-04T18:42:37.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~251s 2023-12-04T18:42:44.084 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~258s 2023-12-04T18:42:50.694 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~264s 2023-12-04T18:42:57.304 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~271s 2023-12-04T18:43:03.915 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~278s 2023-12-04T18:43:10.527 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~284s 2023-12-04T18:43:17.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~291s 2023-12-04T18:43:21.524 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T18:43:21.522+0000 7fdfc44f3640 -1 bdev(0x557066ddb880 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-04T18:43:21.576 INFO:tasks.ceph.osd.5.smithi066.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fdfc44f3640 time 2023-12-04T18:43:21.534021+0000 2023-12-04T18:43:21.576 INFO:tasks.ceph.osd.5.smithi066.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-04T18:43:21.576 INFO:tasks.ceph.osd.5.smithi066.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:43:21.576 INFO:tasks.ceph.osd.5.smithi066.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5570620a6f31] 2023-12-04T18:43:21.576 INFO:tasks.ceph.osd.5.smithi066.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x5570629f9646] 2023-12-04T18:43:21.577 INFO:tasks.ceph.osd.5.smithi066.stderr: 3: ceph-osd(+0xda3a71) [0x5570629d9a71] 2023-12-04T18:43:21.577 INFO:tasks.ceph.osd.5.smithi066.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fdfd149f802] 2023-12-04T18:43:21.577 INFO:tasks.ceph.osd.5.smithi066.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fdfd143f450] 2023-12-04T18:43:21.578 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T18:43:21.575+0000 7fdfc44f3640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fdfc44f3640 time 2023-12-04T18:43:21.534021+0000 2023-12-04T18:43:21.578 INFO:tasks.ceph.osd.5.smithi066.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-04T18:43:21.578 INFO:tasks.ceph.osd.5.smithi066.stderr: 2023-12-04T18:43:21.578 INFO:tasks.ceph.osd.5.smithi066.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:43:21.578 INFO:tasks.ceph.osd.5.smithi066.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5570620a6f31] 2023-12-04T18:43:21.578 INFO:tasks.ceph.osd.5.smithi066.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x5570629f9646] 2023-12-04T18:43:21.579 INFO:tasks.ceph.osd.5.smithi066.stderr: 3: ceph-osd(+0xda3a71) [0x5570629d9a71] 2023-12-04T18:43:21.579 INFO:tasks.ceph.osd.5.smithi066.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fdfd149f802] 2023-12-04T18:43:21.579 INFO:tasks.ceph.osd.5.smithi066.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fdfd143f450] 2023-12-04T18:43:21.579 INFO:tasks.ceph.osd.5.smithi066.stderr: 2023-12-04T18:43:21.586 INFO:tasks.ceph.osd.5.smithi066.stderr:*** Caught signal (Aborted) ** 2023-12-04T18:43:21.586 INFO:tasks.ceph.osd.5.smithi066.stderr: in thread 7fdfc44f3640 thread_name:bstore_aio 2023-12-04T18:43:21.587 INFO:tasks.ceph.osd.5.smithi066.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:43:21.587 INFO:tasks.ceph.osd.5.smithi066.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fdfd1454db0] 2023-12-04T18:43:21.587 INFO:tasks.ceph.osd.5.smithi066.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fdfd14a154c] 2023-12-04T18:43:21.587 INFO:tasks.ceph.osd.5.smithi066.stderr: 3: raise() 2023-12-04T18:43:21.587 INFO:tasks.ceph.osd.5.smithi066.stderr: 4: abort() 2023-12-04T18:43:21.587 INFO:tasks.ceph.osd.5.smithi066.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5570620a6ff2] 2023-12-04T18:43:21.587 INFO:tasks.ceph.osd.5.smithi066.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x5570629f9646] 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 7: ceph-osd(+0xda3a71) [0x5570629d9a71] 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fdfd149f802] 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fdfd143f450] 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr:2023-12-04T18:43:21.586+0000 7fdfc44f3640 -1 *** Caught signal (Aborted) ** 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: in thread 7fdfc44f3640 thread_name:bstore_aio 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fdfd1454db0] 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fdfd14a154c] 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 3: raise() 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 4: abort() 2023-12-04T18:43:21.588 INFO:tasks.ceph.osd.5.smithi066.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x5570620a6ff2] 2023-12-04T18:43:21.589 INFO:tasks.ceph.osd.5.smithi066.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x5570629f9646] 2023-12-04T18:43:21.589 INFO:tasks.ceph.osd.5.smithi066.stderr: 7: ceph-osd(+0xda3a71) [0x5570629d9a71] 2023-12-04T18:43:21.589 INFO:tasks.ceph.osd.5.smithi066.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7fdfd149f802] 2023-12-04T18:43:21.589 INFO:tasks.ceph.osd.5.smithi066.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7fdfd143f450] 2023-12-04T18:43:21.589 INFO:tasks.ceph.osd.5.smithi066.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-04T18:43:21.589 INFO:tasks.ceph.osd.5.smithi066.stderr: 2023-12-04T18:43:21.602 INFO:tasks.ceph.osd.5.smithi066.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fdfc3ce1640 time 2023-12-04T18:43:21.599851+0000 2023-12-04T18:43:21.602 INFO:tasks.ceph.osd.5.smithi066.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/18.0.0-7690-gc7b0e682/rpm/el9/BUILD/ceph-18.0.0-7690-gc7b0e682/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-04T18:43:21.602 INFO:tasks.ceph.osd.5.smithi066.stderr: ceph version 18.0.0-7690-gc7b0e682 (c7b0e682e685ca9c244e731128a4c5dcad3b99eb) reef (dev) 2023-12-04T18:43:21.602 INFO:tasks.ceph.osd.5.smithi066.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x5570620a6f31] 2023-12-04T18:43:21.602 INFO:tasks.ceph.osd.5.smithi066.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x5570629f9646] 2023-12-04T18:43:21.602 INFO:tasks.ceph.osd.5.smithi066.stderr: 3: ceph-osd(+0xda3a71) [0x5570629d9a71] 2023-12-04T18:43:21.602 INFO:tasks.ceph.osd.5.smithi066.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7fdfd149f802] 2023-12-04T18:43:21.602 INFO:tasks.ceph.osd.5.smithi066.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7fdfd143f450] 2023-12-04T18:43:23.746 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~298s 2023-12-04T18:43:30.355 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~304s 2023-12-04T18:43:30.355 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-04T18:43:30.356 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T18:43:30.356 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T18:43:30.423 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T18:43:30.423 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T18:43:30.470 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-04T18:43:32.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.244+0000 7f5b79b1f640 1 Processor -- start 2023-12-04T18:43:32.247 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.245+0000 7f5b79b1f640 1 -- start start 2023-12-04T18:43:32.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.246+0000 7f5b79b1f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740b0f00 0x7f5b7415e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.246+0000 7f5b79b1f640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5b740cb110 0x7f5b7415a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.246+0000 7f5b79b1f640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b7415b4f0 con 0x7f5b7415e250 2023-12-04T18:43:32.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.246+0000 7f5b79b1f640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b7415b210 con 0x7f5b740cb110 2023-12-04T18:43:32.248 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.246+0000 7f5b79b1f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740ca650 con 0x7f5b740b0f00 2023-12-04T18:43:32.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.247+0000 7f5b737fe640 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f5b7415e250 0x7f5b740b07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.63:37368/0 (socket says 172.21.15.63:37368) 2023-12-04T18:43:32.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.247+0000 7f5b737fe640 1 -- 172.21.15.63:0/1980792422 learned_addr learned my addr 172.21.15.63:0/1980792422 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T18:43:32.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.247+0000 7f5b73fff640 1 --2- 172.21.15.63:0/1980792422 >> v2:172.21.15.66:3300/0 conn(0x7f5b740cb110 0x7f5b7415a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.249 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.247+0000 7f5b72ffd640 1 --2- 172.21.15.63:0/1980792422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740b0f00 0x7f5b7415e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.325+0000 7f5b727fc640 1 -- 172.21.15.63:0/1980792422 <== mon.1 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 279863577 0 0) 0x7f5b7415b4f0 con 0x7f5b7415e250 2023-12-04T18:43:32.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.325+0000 7f5b727fc640 1 -- 172.21.15.63:0/1980792422 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b5c003520 con 0x7f5b7415e250 2023-12-04T18:43:32.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.325+0000 7f5b73fff640 1 -- 172.21.15.63:0/1980792422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740b0f00 msgr2=0x7f5b7415e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:32.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.325+0000 7f5b73fff640 1 --2- 172.21.15.63:0/1980792422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740b0f00 0x7f5b7415e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.355 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.325+0000 7f5b73fff640 1 -- 172.21.15.63:0/1980792422 >> v1:172.21.15.66:6789/0 conn(0x7f5b7415e250 legacy=0x7f5b740b07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.325+0000 7f5b73fff640 1 -- 172.21.15.63:0/1980792422 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b740ca930 con 0x7f5b740cb110 2023-12-04T18:43:32.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.327+0000 7f5b73fff640 1 --2- 172.21.15.63:0/1980792422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740cb110 0x7f5b7415a520 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009d90 tx=0x7f5b6c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c5faa5247cfe284 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:32.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.328+0000 7f5b727fc640 1 -- 172.21.15.63:0/1980792422 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c02cc60 con 0x7f5b740cb110 2023-12-04T18:43:32.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.328+0000 7f5b727fc640 1 -- 172.21.15.63:0/1980792422 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c02cdc0 con 0x7f5b740cb110 2023-12-04T18:43:32.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.328+0000 7f5b727fc640 1 -- 172.21.15.63:0/1980792422 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c034660 con 0x7f5b740cb110 2023-12-04T18:43:32.358 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.329+0000 7f5b79b1f640 1 -- 172.21.15.63:0/1980792422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740cb110 msgr2=0x7f5b7415a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.329+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/1980792422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740cb110 0x7f5b7415a520 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009d90 tx=0x7f5b6c02beb0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.330+0000 7f5b79b1f640 1 -- 172.21.15.63:0/1980792422 shutdown_connections 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.330+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/1980792422 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740cb110 0x7f5b7415a520 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.330+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/1980792422 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740b0f00 0x7f5b7415e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.330+0000 7f5b79b1f640 1 -- 172.21.15.63:0/1980792422 >> 172.21.15.63:0/1980792422 conn(0x7f5b740cb9d0 msgr2=0x7f5b740cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.330+0000 7f5b79b1f640 1 -- 172.21.15.63:0/1980792422 shutdown_connections 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.330+0000 7f5b79b1f640 1 -- 172.21.15.63:0/1980792422 wait complete. 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.333+0000 7f5b79b1f640 1 Processor -- start 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.333+0000 7f5b79b1f640 1 -- start start 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.334+0000 7f5b79b1f640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740b0f00 0x7f5b741f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.334+0000 7f5b79b1f640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740cb110 0x7f5b740cdd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.334+0000 7f5b79b1f640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b7415e250 0x7f5b740ce2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.334+0000 7f5b79b1f640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740b3290 con 0x7f5b7415e250 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.334+0000 7f5b79b1f640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740b2680 con 0x7f5b740b0f00 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.334+0000 7f5b79b1f640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b740b2960 con 0x7f5b740cb110 2023-12-04T18:43:32.359 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b73fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b7415e250 0x7f5b740ce2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b73fff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b7415e250 0x7f5b740ce2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55078/0 (socket says 172.21.15.63:55078) 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b73fff640 1 -- 172.21.15.63:0/2070689924 learned_addr learned my addr 172.21.15.63:0/2070689924 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b737fe640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740b0f00 0x7f5b741f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b73fff640 1 -- 172.21.15.63:0/2070689924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740cb110 msgr2=0x7f5b740cdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b73fff640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740cb110 0x7f5b740cdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b73fff640 1 -- 172.21.15.63:0/2070689924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740b0f00 msgr2=0x7f5b741f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b73fff640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740b0f00 0x7f5b741f62b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.335+0000 7f5b73fff640 1 -- 172.21.15.63:0/2070689924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c009a70 con 0x7f5b7415e250 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.336+0000 7f5b73fff640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b7415e250 0x7f5b740ce2d0 secure :-1 s=READY pgs=3048 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009eb0 tx=0x7f5b6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.336+0000 7f5b5bfff640 1 -- 172.21.15.63:0/2070689924 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c03e610 con 0x7f5b7415e250 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.336+0000 7f5b5bfff640 1 -- 172.21.15.63:0/2070689924 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c03e770 con 0x7f5b7415e250 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.337+0000 7f5b5bfff640 1 -- 172.21.15.63:0/2070689924 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c03eb20 con 0x7f5b7415e250 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.337+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b740b2c40 con 0x7f5b7415e250 2023-12-04T18:43:32.360 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.337+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b740b1990 con 0x7f5b7415e250 2023-12-04T18:43:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.340+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b740b3400 con 0x7f5b7415e250 2023-12-04T18:43:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.340+0000 7f5b5bfff640 1 -- 172.21.15.63:0/2070689924 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5b6c03b050 con 0x7f5b7415e250 2023-12-04T18:43:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.341+0000 7f5b5bfff640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5b6006ae40 0x7f5b6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.342+0000 7f5b5bfff640 1 -- 172.21.15.63:0/2070689924 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5b6c0ac030 con 0x7f5b7415e250 2023-12-04T18:43:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.342+0000 7f5b737fe640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5b6006ae40 0x7f5b6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.361 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.343+0000 7f5b737fe640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5b6006ae40 0x7f5b6006d300 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5b64005880 tx=0x7f5b64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:32.387 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.385+0000 7f5b5bfff640 1 -- 172.21.15.63:0/2070689924 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5b6c076ef0 con 0x7f5b7415e250 2023-12-04T18:43:32.639 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.637+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b74068710 con 0x7f5b7415e250 2023-12-04T18:43:32.641 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.639+0000 7f5b5bfff640 1 -- 172.21.15.63:0/2070689924 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16630 (secure 0 0 0) 0x7f5b6c07a510 con 0x7f5b7415e250 2023-12-04T18:43:32.642 INFO:teuthology.orchestra.run.smithi063.stdout: 2023-12-04T18:43:32.642 INFO:teuthology.orchestra.run.smithi063.stdout:{"epoch":47,"fsid":"41e9b14e-2141-4ea1-b0af-8533c9689063","created":"2023-12-04T10:43:32.927083+0000","modified":"2023-12-04T18:43:25.904398+0000","last_up_change":"2023-12-04T18:43:24.883773+0000","last_in_change":"2023-12-04T10:43:36.629767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-04T10:43:46.040684+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-04T10:45:31.631954+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"error_message":"pool 5 has some PGs where all OSDs are with primary_affinity 0 (at least pg 5.16), read balance score may not be reliable","score_acting":0,"score_stable":0}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-04T10:45:32.554948+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"41","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"error_message":"pool 6 has some PGs where all OSDs are with primary_affinity 0 (at least pg 6.7), read balance score may not be reliable","score_acting":0,"score_stable":0}}],"osds":[{"osd":0,"uuid":"bbdcdcbe-27d0-4fbe-a898-d8c49c7a2640","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6800","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6801","nonce":4130360804}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6802","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6804","nonce":4130360804}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6810","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6812","nonce":4130360804}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6806","nonce":4130360804},{"type":"v1","addr":"172.21.15.63:6808","nonce":4130360804}]},"public_addr":"172.21.15.63:6801/4130360804","cluster_addr":"172.21.15.63:6804/4130360804","heartbeat_back_addr":"172.21.15.63:6812/4130360804","heartbeat_front_addr":"172.21.15.63:6808/4130360804","state":["exists","up"]},{"osd":1,"uuid":"3c6891c1-c81c-4cd1-a1b8-2e14f05e9b3d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6820","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6822","nonce":1675466293}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6824","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6826","nonce":1675466293}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6830","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6831","nonce":1675466293}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6828","nonce":1675466293},{"type":"v1","addr":"172.21.15.63:6829","nonce":1675466293}]},"public_addr":"172.21.15.63:6822/1675466293","cluster_addr":"172.21.15.63:6826/1675466293","heartbeat_back_addr":"172.21.15.63:6831/1675466293","heartbeat_front_addr":"172.21.15.63:6829/1675466293","state":["exists","up"]},{"osd":2,"uuid":"135bb824-8a75-4b76-a657-a963288c2106","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6816","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6817","nonce":3751405759}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6818","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6819","nonce":3751405759}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6825","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6827","nonce":3751405759}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6821","nonce":3751405759},{"type":"v1","addr":"172.21.15.63:6823","nonce":3751405759}]},"public_addr":"172.21.15.63:6817/3751405759","cluster_addr":"172.21.15.63:6819/3751405759","heartbeat_back_addr":"172.21.15.63:6827/3751405759","heartbeat_front_addr":"172.21.15.63:6823/3751405759","state":["exists","up"]},{"osd":3,"uuid":"30168ef4-6572-4c1b-ac5b-5d6de73f7e78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":39,"down_at":44,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6803","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6805","nonce":2748907041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6807","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6809","nonce":2748907041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6814","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6815","nonce":2748907041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.63:6811","nonce":2748907041},{"type":"v1","addr":"172.21.15.63:6813","nonce":2748907041}]},"public_addr":"172.21.15.63:6805/2748907041","cluster_addr":"172.21.15.63:6809/2748907041","heartbeat_back_addr":"172.21.15.63:6815/2748907041","heartbeat_front_addr":"172.21.15.63:6813/2748907041","state":["exists"]},{"osd":4,"uuid":"d4080c3a-88e7-46a6-9e86-c2eca458c943","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6817","nonce":741643498}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6820","nonce":741643498}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6825","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6826","nonce":741643498}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":741643498},{"type":"v1","addr":"172.21.15.66:6823","nonce":741643498}]},"public_addr":"172.21.15.66:6817/741643498","cluster_addr":"172.21.15.66:6820/741643498","heartbeat_back_addr":"172.21.15.66:6826/741643498","heartbeat_front_addr":"172.21.15.66:6823/741643498","state":["exists","up"]},{"osd":5,"uuid":"101d8e54-ffcf-489f-8d1e-731204c166e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":44,"down_at":46,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6804","nonce":616399461}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6805","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6807","nonce":616399461}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6811","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6813","nonce":616399461}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":616399461},{"type":"v1","addr":"172.21.15.66:6810","nonce":616399461}]},"public_addr":"172.21.15.66:6804/616399461","cluster_addr":"172.21.15.66:6807/616399461","heartbeat_back_addr":"172.21.15.66:6813/616399461","heartbeat_front_addr":"172.21.15.66:6810/616399461","state":["exists"]},{"osd":6,"uuid":"24066ac9-70ea-4495-b31a-7b5487b36920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6819","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6821","nonce":176556265}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6827","nonce":176556265}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6831","nonce":176556265}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":176556265},{"type":"v1","addr":"172.21.15.66:6829","nonce":176556265}]},"public_addr":"172.21.15.66:6821/176556265","cluster_addr":"172.21.15.66:6827/176556265","heartbeat_back_addr":"172.21.15.66:6831/176556265","heartbeat_front_addr":"172.21.15.66:6829/176556265","state":["exists","up"]},{"osd":7,"uuid":"97512e73-0b5a-42e4-87a6-2b54302d79c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6801","nonce":3339722149}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6803","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6806","nonce":3339722149}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6815","nonce":3339722149}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6809","nonce":3339722149},{"type":"v1","addr":"172.21.15.66:6812","nonce":3339722149}]},"public_addr":"172.21.15.66:6801/3339722149","cluster_addr":"172.21.15.66:6806/3339722149","heartbeat_back_addr":"172.21.15.66:6815/3339722149","heartbeat_front_addr":"172.21.15.66:6812/3339722149","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.214612+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.477846+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:41.959658+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.181249+0000","dead_epoch":44},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:43.249594+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.238543+0000","dead_epoch":46},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.028511+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-04T10:43:42.212521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.1a","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-04T18:43:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5b6006ae40 msgr2=0x7f5b6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5b6006ae40 0x7f5b6006d300 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5b64005880 tx=0x7f5b64009040 comp rx=0 tx=0).stop 2023-12-04T18:43:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b7415e250 msgr2=0x7f5b740ce2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b7415e250 0x7f5b740ce2d0 secure :-1 s=READY pgs=3048 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c009eb0 tx=0x7f5b6c004a40 comp rx=0 tx=0).stop 2023-12-04T18:43:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 shutdown_connections 2023-12-04T18:43:32.644 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f5b6006ae40 0x7f5b6006d300 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f5b740cb110 0x7f5b740cdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f5b7415e250 0x7f5b740ce2d0 unknown :-1 s=CLOSED pgs=3048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 --2- 172.21.15.63:0/2070689924 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b740b0f00 0x7f5b741f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 >> 172.21.15.63:0/2070689924 conn(0x7f5b740cb9d0 msgr2=0x7f5b740cc970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:32.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 shutdown_connections 2023-12-04T18:43:32.645 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.642+0000 7f5b79b1f640 1 -- 172.21.15.63:0/2070689924 wait complete. 2023-12-04T18:43:32.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-04T10:43:46.040684+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-04T10:45:31.631954+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'error_message': 'pool 5 has some PGs where all OSDs are with primary_affinity 0 (at least pg 5.16), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-04T10:45:32.554948+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '41', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'error_message': 'pool 6 has some PGs where all OSDs are with primary_affinity 0 (at least pg 6.7), read balance score may not be reliable', 'score_acting': 0, 'score_stable': 0}}] 2023-12-04T18:43:32.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-04T18:43:32.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.868+0000 7fd716eec640 1 Processor -- start 2023-12-04T18:43:32.870 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.868+0000 7fd716eec640 1 -- start start 2023-12-04T18:43:32.871 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.869+0000 7fd716eec640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7100ce8e0 0x7fd7100d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.870+0000 7fd716eec640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100b2710 con 0x7fd71015d5d0 2023-12-04T18:43:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.870+0000 7fd716eec640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7100d4150 con 0x7fd7100d1de0 2023-12-04T18:43:32.872 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.870+0000 7fd716eec640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100d2290 con 0x7fd7100ce8e0 2023-12-04T18:43:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.870+0000 7fd714c88640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7fd71015d5d0 0x7fd7100d3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49166/0 (socket says 172.21.15.63:49166) 2023-12-04T18:43:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.870+0000 7fd714c88640 1 -- 172.21.15.63:0/4217446596 learned_addr learned my addr 172.21.15.63:0/4217446596 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T18:43:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.870+0000 7fd70ffff640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7100ce8e0 0x7fd7100d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.870+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 120610714 0 0) 0x7fd7100b2710 con 0x7fd71015d5d0 2023-12-04T18:43:32.873 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd700003520 con 0x7fd71015d5d0 2023-12-04T18:43:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1034463554 0 0) 0x7fd700003520 con 0x7fd71015d5d0 2023-12-04T18:43:32.874 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7100ce8e0 msgr2=0x7fd7100d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7100ce8e0 0x7fd7100d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 >> v1:172.21.15.66:6789/0 conn(0x7fd7100d1de0 legacy=0x7fd7100b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7100ced70 con 0x7fd71015d5d0 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7fd704001670 con 0x7fd71015d5d0 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 >> v1:172.21.15.63:6789/0 conn(0x7fd71015d5d0 legacy=0x7fd7100d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000039a0 0x7fd700003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7000047c0 0x7fd700004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd700005180 0x7fd70000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100d2290 con 0x7fd7000047c0 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd70000bec0 con 0x7fd7000039a0 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd70000c000 con 0x7fd700005180 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.871+0000 7fd70ffff640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7000047c0 0x7fd700004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.872+0000 7fd714c88640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000039a0 0x7fd700003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.875 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.872+0000 7fd70ffff640 1 -- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd700005180 msgr2=0x7fd70000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:32.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.872+0000 7fd70ffff640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd700005180 0x7fd70000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.872+0000 7fd70ffff640 1 -- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000039a0 msgr2=0x7fd700003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:32.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.872+0000 7fd70ffff640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000039a0 0x7fd700003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.872+0000 7fd70ffff640 1 -- 172.21.15.63:0/4217446596 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd700003520 con 0x7fd7000047c0 2023-12-04T18:43:32.876 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.872+0000 7fd714c88640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000039a0 0x7fd700003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.873+0000 7fd70ffff640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7000047c0 0x7fd700004c40 secure :-1 s=READY pgs=3050 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009ac0 tx=0x7fd7000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bea10929825cad8 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.873+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc02c6d0 con 0x7fd7000047c0 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.873+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc02c830 con 0x7fd7000047c0 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.873+0000 7fd70f7fe640 1 -- 172.21.15.63:0/4217446596 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc02cbc0 con 0x7fd7000047c0 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.874+0000 7fd716eec640 1 -- 172.21.15.63:0/4217446596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7000047c0 msgr2=0x7fd700004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.874+0000 7fd716eec640 1 --2- 172.21.15.63:0/4217446596 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7000047c0 0x7fd700004c40 secure :-1 s=READY pgs=3050 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc009ac0 tx=0x7fd7000057f0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.874+0000 7fd715489640 1 -- 172.21.15.63:0/4217446596 reap_dead start 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.874+0000 7fd716eec640 1 -- 172.21.15.63:0/4217446596 shutdown_connections 2023-12-04T18:43:32.877 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.874+0000 7fd716eec640 1 -- 172.21.15.63:0/4217446596 >> 172.21.15.63:0/4217446596 conn(0x7fd71009c600 msgr2=0x7fd7100d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.874+0000 7fd716eec640 1 -- 172.21.15.63:0/4217446596 shutdown_connections 2023-12-04T18:43:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.874+0000 7fd716eec640 1 -- 172.21.15.63:0/4217446596 wait complete. 2023-12-04T18:43:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.876+0000 7fd716eec640 1 Processor -- start 2023-12-04T18:43:32.878 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.876+0000 7fd716eec640 1 -- start start 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd716eec640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000047c0 0x7fd71015dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd716eec640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7100ca390 0x7fd710152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd716eec640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7100cc460 0x7fd7100cc8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd716eec640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7101609e0 con 0x7fd7100ca390 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd716eec640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7100cce10 con 0x7fd7000047c0 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd716eec640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd71015e220 con 0x7fd7100cc460 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7100ca390 0x7fd710152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd70ffff640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7100ca390 0x7fd710152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55098/0 (socket says 172.21.15.63:55098) 2023-12-04T18:43:32.880 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.877+0000 7fd70ffff640 1 -- 172.21.15.63:0/2026499291 learned_addr learned my addr 172.21.15.63:0/2026499291 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T18:43:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.878+0000 7fd714c88640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000047c0 0x7fd71015dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.878+0000 7fd70ffff640 1 -- 172.21.15.63:0/2026499291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7100cc460 msgr2=0x7fd7100cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.878+0000 7fd70ffff640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7100cc460 0x7fd7100cc8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.878+0000 7fd70ffff640 1 -- 172.21.15.63:0/2026499291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000047c0 msgr2=0x7fd71015dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.878+0000 7fd70ffff640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000047c0 0x7fd71015dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:32.881 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.878+0000 7fd70ffff640 1 -- 172.21.15.63:0/2026499291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd710160340 con 0x7fd7100ca390 2023-12-04T18:43:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.878+0000 7fd70ffff640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7100ca390 0x7fd710152e70 secure :-1 s=READY pgs=3051 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc037040 tx=0x7fd6fc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.879+0000 7fd70d7fa640 1 -- 172.21.15.63:0/2026499291 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc003810 con 0x7fd7100ca390 2023-12-04T18:43:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.879+0000 7fd70d7fa640 1 -- 172.21.15.63:0/2026499291 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6fc003970 con 0x7fd7100ca390 2023-12-04T18:43:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.879+0000 7fd70d7fa640 1 -- 172.21.15.63:0/2026499291 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6fc003ce0 con 0x7fd7100ca390 2023-12-04T18:43:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.879+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7100ca810 con 0x7fd7100ca390 2023-12-04T18:43:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.879+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7101539a0 con 0x7fd7100ca390 2023-12-04T18:43:32.882 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.880+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd710068710 con 0x7fd7100ca390 2023-12-04T18:43:32.883 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.881+0000 7fd70d7fa640 1 -- 172.21.15.63:0/2026499291 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd6fc034440 con 0x7fd7100ca390 2023-12-04T18:43:32.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.882+0000 7fd70d7fa640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd6f406ae40 0x7fd6f406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:32.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.882+0000 7fd70d7fa640 1 -- 172.21.15.63:0/2026499291 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd6fc0ab6c0 con 0x7fd7100ca390 2023-12-04T18:43:32.884 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.882+0000 7fd714c88640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd6f406ae40 0x7fd6f406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:32.885 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.883+0000 7fd714c88640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd6f406ae40 0x7fd6f406d300 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd704001200 tx=0x7fd704009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:32.889 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:32.887+0000 7fd70d7fa640 1 -- 172.21.15.63:0/2026499291 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd6fc0767e0 con 0x7fd7100ca390 2023-12-04T18:43:33.086 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.084+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd71015c1f0 con 0x7fd7100ca390 2023-12-04T18:43:33.087 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.085+0000 7fd70d7fa640 1 -- 172.21.15.63:0/2026499291 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6fc0044e0 con 0x7fd7100ca390 2023-12-04T18:43:33.087 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 1 2023-12-04T18:43:33.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd6f406ae40 msgr2=0x7fd6f406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.089 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd6f406ae40 0x7fd6f406d300 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fd704001200 tx=0x7fd704009040 comp rx=0 tx=0).stop 2023-12-04T18:43:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7100ca390 msgr2=0x7fd710152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7100ca390 0x7fd710152e70 secure :-1 s=READY pgs=3051 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc037040 tx=0x7fd6fc004730 comp rx=0 tx=0).stop 2023-12-04T18:43:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 shutdown_connections 2023-12-04T18:43:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fd6f406ae40 0x7fd6f406d300 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fd7100cc460 0x7fd7100cc8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fd7100ca390 0x7fd710152e70 unknown :-1 s=CLOSED pgs=3051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 --2- 172.21.15.63:0/2026499291 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd7000047c0 0x7fd71015dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.090 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.087+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 >> 172.21.15.63:0/2026499291 conn(0x7fd71009c600 msgr2=0x7fd710155690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.089+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 shutdown_connections 2023-12-04T18:43:33.091 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.089+0000 7fd716eec640 1 -- 172.21.15.63:0/2026499291 wait complete. 2023-12-04T18:43:33.109 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-04T18:43:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.305+0000 7eff6b6db640 1 Processor -- start 2023-12-04T18:43:33.307 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.305+0000 7eff6b6db640 1 -- start start 2023-12-04T18:43:33.309 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.307+0000 7eff6b6db640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 0x7eff640c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.307+0000 7eff6b6db640 1 -- --> v1:172.21.15.63:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff640c4ec0 con 0x7eff640c64a0 2023-12-04T18:43:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.307+0000 7eff6b6db640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff640c51a0 con 0x7eff640711c0 2023-12-04T18:43:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.307+0000 7eff6b6db640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff64144030 con 0x7eff64143c50 2023-12-04T18:43:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.307+0000 7eff68c76640 1 --1- >> v1:172.21.15.63:6789/0 conn(0x7eff640c64a0 0x7eff640ce1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.63:6789/0 says I am v1:172.21.15.63:49180/0 (socket says 172.21.15.63:49180) 2023-12-04T18:43:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.307+0000 7eff68c76640 1 -- 172.21.15.63:0/2348106080 learned_addr learned my addr 172.21.15.63:0/2348106080 (peer_addr_for_me v1:172.21.15.63:0/0) 2023-12-04T18:43:33.310 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.308+0000 7eff69477640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 0x7eff640c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.308+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 <== mon.0 v1:172.21.15.63:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2338009025 0 0) 0x7eff640c4ec0 con 0x7eff640c64a0 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.308+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 --> v1:172.21.15.63:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff50003520 con 0x7eff640c64a0 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.308+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 <== mon.0 v1:172.21.15.63:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2968092818 0 0) 0x7eff50003520 con 0x7eff640c64a0 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 msgr2=0x7eff640c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 0x7eff640c5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 >> v1:172.21.15.66:6789/0 conn(0x7eff640711c0 legacy=0x7eff640715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 --> v1:172.21.15.63:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff640c5480 con 0x7eff640c64a0 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 <== mon.0 v1:172.21.15.63:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3631685964 0 0) 0x7eff54001670 con 0x7eff640c64a0 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 >> v1:172.21.15.63:6789/0 conn(0x7eff640c64a0 legacy=0x7eff640ce1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.312 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff500039a0 0x7eff50003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 0x7eff500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff50004d00 0x7eff50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64144030 con 0x7eff50004d00 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5000fe40 con 0x7eff500039a0 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff50010000 con 0x7eff64143c50 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff69c78640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff50004d00 0x7eff50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.309+0000 7eff69477640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff500039a0 0x7eff50003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.310+0000 7eff68c76640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 0x7eff500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.310+0000 7eff69c78640 1 -- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 msgr2=0x7eff500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.310+0000 7eff69c78640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 0x7eff500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.310+0000 7eff69c78640 1 -- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff500039a0 msgr2=0x7eff50003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.310+0000 7eff69c78640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff500039a0 0x7eff50003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.310+0000 7eff69c78640 1 -- 172.21.15.63:0/2348106080 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff50003520 con 0x7eff50004d00 2023-12-04T18:43:33.313 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.310+0000 7eff68c76640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff64143c50 0x7eff500047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.311+0000 7eff69c78640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff50004d00 0x7eff50005180 secure :-1 s=READY pgs=3053 cs=0 l=1 rev1=1 crypto rx=0x7eff5c001e00 tx=0x7eff500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0055c04ffa59821 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.311+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c003b70 con 0x7eff50004d00 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.311+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c003cf0 con 0x7eff50004d00 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.311+0000 7eff5bfff640 1 -- 172.21.15.63:0/2348106080 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c005310 con 0x7eff50004d00 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.312+0000 7eff6b6db640 1 -- 172.21.15.63:0/2348106080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff50004d00 msgr2=0x7eff50005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.312+0000 7eff6b6db640 1 --2- 172.21.15.63:0/2348106080 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff50004d00 0x7eff50005180 secure :-1 s=READY pgs=3053 cs=0 l=1 rev1=1 crypto rx=0x7eff5c001e00 tx=0x7eff500057f0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.312+0000 7eff69c78640 1 -- 172.21.15.63:0/2348106080 reap_dead start 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.312+0000 7eff6b6db640 1 -- 172.21.15.63:0/2348106080 shutdown_connections 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.312+0000 7eff6b6db640 1 -- 172.21.15.63:0/2348106080 >> 172.21.15.63:0/2348106080 conn(0x7eff640b1bb0 msgr2=0x7eff640b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.312+0000 7eff6b6db640 1 -- 172.21.15.63:0/2348106080 shutdown_connections 2023-12-04T18:43:33.315 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.312+0000 7eff6b6db640 1 -- 172.21.15.63:0/2348106080 wait complete. 2023-12-04T18:43:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.314+0000 7eff6b6db640 1 Processor -- start 2023-12-04T18:43:33.316 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.314+0000 7eff6b6db640 1 -- start start 2023-12-04T18:43:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff6b6db640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff50004d00 0x7eff64159b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff6b6db640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff6415b8f0 0x7eff6413f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff6b6db640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff64142360 0x7eff641427e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff6b6db640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff64142d20 con 0x7eff64142360 2023-12-04T18:43:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff6b6db640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff6413ec20 con 0x7eff50004d00 2023-12-04T18:43:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff6b6db640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff6415bd80 con 0x7eff6415b8f0 2023-12-04T18:43:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff69c78640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff64142360 0x7eff641427e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.318 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff69c78640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff64142360 0x7eff641427e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55108/0 (socket says 172.21.15.63:55108) 2023-12-04T18:43:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.315+0000 7eff69c78640 1 -- 172.21.15.63:0/1515858961 learned_addr learned my addr 172.21.15.63:0/1515858961 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T18:43:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.316+0000 7eff69477640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff50004d00 0x7eff64159b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.316+0000 7eff68c76640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff6415b8f0 0x7eff6413f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.316+0000 7eff69c78640 1 -- 172.21.15.63:0/1515858961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff6415b8f0 msgr2=0x7eff6413f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.316+0000 7eff69c78640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff6415b8f0 0x7eff6413f880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.316+0000 7eff69c78640 1 -- 172.21.15.63:0/1515858961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff50004d00 msgr2=0x7eff64159b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.316+0000 7eff69c78640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff50004d00 0x7eff64159b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.319 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.316+0000 7eff69c78640 1 -- 172.21.15.63:0/1515858961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff6415c060 con 0x7eff64142360 2023-12-04T18:43:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.316+0000 7eff69c78640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff64142360 0x7eff641427e0 secure :-1 s=READY pgs=3054 cs=0 l=1 rev1=1 crypto rx=0x7eff5c02c020 tx=0x7eff5c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.317+0000 7eff59ffb640 1 -- 172.21.15.63:0/1515858961 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c006d50 con 0x7eff64142360 2023-12-04T18:43:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.317+0000 7eff59ffb640 1 -- 172.21.15.63:0/1515858961 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff5c003b80 con 0x7eff64142360 2023-12-04T18:43:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.317+0000 7eff59ffb640 1 -- 172.21.15.63:0/1515858961 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff5c007230 con 0x7eff64142360 2023-12-04T18:43:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.317+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff6415c340 con 0x7eff64142360 2023-12-04T18:43:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.317+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff6415c900 con 0x7eff64142360 2023-12-04T18:43:33.320 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.318+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff64068710 con 0x7eff64142360 2023-12-04T18:43:33.321 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.319+0000 7eff59ffb640 1 -- 172.21.15.63:0/1515858961 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff5c007390 con 0x7eff64142360 2023-12-04T18:43:33.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.320+0000 7eff59ffb640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7eff4806ae40 0x7eff4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.322 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.320+0000 7eff59ffb640 1 -- 172.21.15.63:0/1515858961 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7eff5c0aadf0 con 0x7eff64142360 2023-12-04T18:43:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.321+0000 7eff69477640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7eff4806ae40 0x7eff4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.323 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.321+0000 7eff69477640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7eff4806ae40 0x7eff4806d300 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7eff60009a10 tx=0x7eff60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:33.327 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.325+0000 7eff59ffb640 1 -- 172.21.15.63:0/1515858961 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff5c075cb0 con 0x7eff64142360 2023-12-04T18:43:33.525 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.523+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff640af7b0 con 0x7eff64142360 2023-12-04T18:43:33.526 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.524+0000 7eff59ffb640 1 -- 172.21.15.63:0/1515858961 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v47) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff5c008040 con 0x7eff64142360 2023-12-04T18:43:33.526 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 32 2023-12-04T18:43:33.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7eff4806ae40 msgr2=0x7eff4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7eff4806ae40 0x7eff4806d300 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7eff60009a10 tx=0x7eff60008040 comp rx=0 tx=0).stop 2023-12-04T18:43:33.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff64142360 msgr2=0x7eff641427e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.528 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff64142360 0x7eff641427e0 secure :-1 s=READY pgs=3054 cs=0 l=1 rev1=1 crypto rx=0x7eff5c02c020 tx=0x7eff5c0014a0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 shutdown_connections 2023-12-04T18:43:33.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7eff4806ae40 0x7eff4806d300 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7eff6415b8f0 0x7eff6413f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7eff64142360 0x7eff641427e0 unknown :-1 s=CLOSED pgs=3054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.529 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 --2- 172.21.15.63:0/1515858961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7eff50004d00 0x7eff64159b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.526+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 >> 172.21.15.63:0/1515858961 conn(0x7eff640b1bb0 msgr2=0x7eff640cb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:33.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.527+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 shutdown_connections 2023-12-04T18:43:33.530 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.527+0000 7eff6b6db640 1 -- 172.21.15.63:0/1515858961 wait complete. 2023-12-04T18:43:33.548 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-04T18:43:33.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.742+0000 7f583759e640 1 Processor -- start 2023-12-04T18:43:33.744 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.742+0000 7f583759e640 1 -- start start 2023-12-04T18:43:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.744+0000 7f583759e640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f58380b36b0 0x7f58380707a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.744+0000 7f583759e640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7f58380acd20 0x7f58380ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.744+0000 7f583759e640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58380ac890 con 0x7f583815d0c0 2023-12-04T18:43:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.744+0000 7f583759e640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380b2b60 con 0x7f58380acd20 2023-12-04T18:43:33.746 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.744+0000 7f583759e640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58380b2e40 con 0x7f58380b36b0 2023-12-04T18:43:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.744+0000 7f5835d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f58380b36b0 0x7f58380707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.745+0000 7f5835d9b640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f58380b36b0 0x7f58380707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.63:44806/0 (socket says 172.21.15.63:44806) 2023-12-04T18:43:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.745+0000 7f5835d9b640 1 -- 172.21.15.63:0/3511713728 learned_addr learned my addr 172.21.15.63:0/3511713728 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T18:43:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.745+0000 7f5836d9d640 1 --2- 172.21.15.63:0/3511713728 >> v2:172.21.15.63:3300/0 conn(0x7f58380acd20 0x7f58380ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.747 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.745+0000 7f5835d9b640 1 -- 172.21.15.63:0/3511713728 >> v2:172.21.15.63:3300/0 conn(0x7f58380acd20 msgr2=0x7f58380ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:33.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.745+0000 7f5835d9b640 1 --2- 172.21.15.63:0/3511713728 >> v2:172.21.15.63:3300/0 conn(0x7f58380acd20 0x7f58380ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.745+0000 7f5835d9b640 1 -- 172.21.15.63:0/3511713728 >> v1:172.21.15.66:6789/0 conn(0x7f583815d0c0 legacy=0x7f5838070090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.748 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.745+0000 7f5835d9b640 1 -- 172.21.15.63:0/3511713728 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58380b3120 con 0x7f58380b36b0 2023-12-04T18:43:33.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.747+0000 7f5835d9b640 1 --2- 172.21.15.63:0/3511713728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58380b36b0 0x7f58380707a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5838071f30 tx=0x7f582c02b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c2b1bd873b79db1 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:33.749 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.747+0000 7f583559a640 1 -- 172.21.15.63:0/3511713728 <== mon.1 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c004230 con 0x7f58380b36b0 2023-12-04T18:43:33.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.747+0000 7f583559a640 1 -- 172.21.15.63:0/3511713728 <== mon.1 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c004390 con 0x7f58380b36b0 2023-12-04T18:43:33.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.747+0000 7f583559a640 1 -- 172.21.15.63:0/3511713728 <== mon.1 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f582c030840 con 0x7f58380b36b0 2023-12-04T18:43:33.750 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.748+0000 7f583759e640 1 -- 172.21.15.63:0/3511713728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58380b36b0 msgr2=0x7f58380707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.748+0000 7f583759e640 1 --2- 172.21.15.63:0/3511713728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58380b36b0 0x7f58380707a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f5838071f30 tx=0x7f582c02b980 comp rx=0 tx=0).stop 2023-12-04T18:43:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.748+0000 7f583759e640 1 -- 172.21.15.63:0/3511713728 shutdown_connections 2023-12-04T18:43:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.748+0000 7f583759e640 1 --2- 172.21.15.63:0/3511713728 >> v2:172.21.15.63:3300/0 conn(0x7f58380acd20 0x7f58380ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.748+0000 7f583759e640 1 --2- 172.21.15.63:0/3511713728 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58380b36b0 0x7f58380707a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.748+0000 7f583759e640 1 -- 172.21.15.63:0/3511713728 >> 172.21.15.63:0/3511713728 conn(0x7f58380b0860 msgr2=0x7f58380b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.748+0000 7f583759e640 1 -- 172.21.15.63:0/3511713728 shutdown_connections 2023-12-04T18:43:33.751 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.748+0000 7f583759e640 1 -- 172.21.15.63:0/3511713728 wait complete. 2023-12-04T18:43:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.750+0000 7f583759e640 1 Processor -- start 2023-12-04T18:43:33.752 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.750+0000 7f583759e640 1 -- start start 2023-12-04T18:43:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583759e640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58380acd20 0x7f58381568d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583759e640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58380b36b0 0x7f58380cc070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.753 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583759e640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f583815d0c0 0x7f58380cc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583759e640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380cd7f0 con 0x7f58380acd20 2023-12-04T18:43:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583759e640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58380ccbe0 con 0x7f58380b36b0 2023-12-04T18:43:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583759e640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58380ccec0 con 0x7f583815d0c0 2023-12-04T18:43:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58380acd20 0x7f58381568d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583659c640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58380acd20 0x7f58381568d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:55120/0 (socket says 172.21.15.63:55120) 2023-12-04T18:43:33.754 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.751+0000 7f583659c640 1 -- 172.21.15.63:0/1792928548 learned_addr learned my addr 172.21.15.63:0/1792928548 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T18:43:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f583659c640 1 -- 172.21.15.63:0/1792928548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f583815d0c0 msgr2=0x7f58380cc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f583659c640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f583815d0c0 0x7f58380cc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f583659c640 1 -- 172.21.15.63:0/1792928548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58380b36b0 msgr2=0x7f58380cc070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f583659c640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58380b36b0 0x7f58380cc070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f583659c640 1 -- 172.21.15.63:0/1792928548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c009460 con 0x7f58380acd20 2023-12-04T18:43:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f583659c640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58380acd20 0x7f58381568d0 secure :-1 s=READY pgs=3055 cs=0 l=1 rev1=1 crypto rx=0x7f582800c400 tx=0x7f582800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f5826ffd640 1 -- 172.21.15.63:0/1792928548 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280052d0 con 0x7f58380acd20 2023-12-04T18:43:33.755 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f5826ffd640 1 -- 172.21.15.63:0/1792928548 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5828005430 con 0x7f58380acd20 2023-12-04T18:43:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.752+0000 7f5826ffd640 1 -- 172.21.15.63:0/1792928548 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5828003830 con 0x7f58380acd20 2023-12-04T18:43:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.753+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58380cd1a0 con 0x7f58380acd20 2023-12-04T18:43:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.753+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f583815f830 con 0x7f58380acd20 2023-12-04T18:43:33.756 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.754+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583804e840 con 0x7f58380acd20 2023-12-04T18:43:33.757 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.755+0000 7f5826ffd640 1 -- 172.21.15.63:0/1792928548 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5828003990 con 0x7f58380acd20 2023-12-04T18:43:33.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.756+0000 7f5826ffd640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f581806ae90 0x7f581806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:33.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.756+0000 7f5826ffd640 1 -- 172.21.15.63:0/1792928548 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5828088c00 con 0x7f58380acd20 2023-12-04T18:43:33.758 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.756+0000 7f5835d9b640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f581806ae90 0x7f581806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:33.759 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.757+0000 7f5835d9b640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f581806ae90 0x7f581806d350 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f582c035000 tx=0x7f582c030000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:33.763 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.761+0000 7f5826ffd640 1 -- 172.21.15.63:0/1792928548 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5828053c40 con 0x7f58380acd20 2023-12-04T18:43:33.958 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.956+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f583806e3b0 con 0x7f58380acd20 2023-12-04T18:43:33.960 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.956+0000 7f5826ffd640 1 -- 172.21.15.63:0/1792928548 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v47) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58280170a0 con 0x7f58380acd20 2023-12-04T18:43:33.960 INFO:teuthology.orchestra.run.smithi063.stdout:pg_num: 64 2023-12-04T18:43:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.959+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f581806ae90 msgr2=0x7f581806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.959+0000 7f583759e640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f581806ae90 0x7f581806d350 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f582c035000 tx=0x7f582c030000 comp rx=0 tx=0).stop 2023-12-04T18:43:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.959+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58380acd20 msgr2=0x7f58381568d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.959+0000 7f583759e640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58380acd20 0x7f58381568d0 secure :-1 s=READY pgs=3055 cs=0 l=1 rev1=1 crypto rx=0x7f582800c400 tx=0x7f582800c8c0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.960+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 shutdown_connections 2023-12-04T18:43:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.960+0000 7f583759e640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7f581806ae90 0x7f581806d350 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.960+0000 7f583759e640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7f583815d0c0 0x7f58380cc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.962 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.960+0000 7f583759e640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f58380b36b0 0x7f58380cc070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.960+0000 7f583759e640 1 --2- 172.21.15.63:0/1792928548 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7f58380acd20 0x7f58381568d0 unknown :-1 s=CLOSED pgs=3055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.960+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 >> 172.21.15.63:0/1792928548 conn(0x7f58380b0860 msgr2=0x7f58380661f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.960+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 shutdown_connections 2023-12-04T18:43:33.963 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:33.960+0000 7f583759e640 1 -- 172.21.15.63:0/1792928548 wait complete. 2023-12-04T18:43:33.981 DEBUG:teuthology.orchestra.run.smithi063:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-04T18:43:34.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.179+0000 7fe0f34dd640 1 Processor -- start 2023-12-04T18:43:34.181 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.179+0000 7fe0f34dd640 1 -- start start 2023-12-04T18:43:34.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f34dd640 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fe0ec15e620 0x7fe0ec0b2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:34.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f34dd640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0ec0cf9a0 0x7fe0ec0cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:34.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f34dd640 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec0b4280 con 0x7fe0ec0cdce0 2023-12-04T18:43:34.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f34dd640 1 -- --> v2:172.21.15.63:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0ce800 con 0x7fe0ec0cf9a0 2023-12-04T18:43:34.183 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f34dd640 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec0d0350 con 0x7fe0ec15e620 2023-12-04T18:43:34.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f1cda640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0ec0cf9a0 0x7fe0ec0cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:34.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f1cda640 1 --2- >> v2:172.21.15.63:3300/0 conn(0x7fe0ec0cf9a0 0x7fe0ec0cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33578/0 (socket says 172.21.15.63:33578) 2023-12-04T18:43:34.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f1cda640 1 -- 172.21.15.63:0/3355288652 learned_addr learned my addr 172.21.15.63:0/3355288652 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T18:43:34.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.181+0000 7fe0f24db640 1 --2- 172.21.15.63:0/3355288652 >> v2:172.21.15.66:3300/0 conn(0x7fe0ec15e620 0x7fe0ec0b2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:34.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.182+0000 7fe0f1cda640 1 -- 172.21.15.63:0/3355288652 >> v2:172.21.15.66:3300/0 conn(0x7fe0ec15e620 msgr2=0x7fe0ec0b2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:34.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.182+0000 7fe0f1cda640 1 --2- 172.21.15.63:0/3355288652 >> v2:172.21.15.66:3300/0 conn(0x7fe0ec15e620 0x7fe0ec0b2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.182+0000 7fe0f1cda640 1 -- 172.21.15.63:0/3355288652 >> v1:172.21.15.66:6789/0 conn(0x7fe0ec0cdce0 legacy=0x7fe0ec0ce0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-04T18:43:34.184 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.182+0000 7fe0f1cda640 1 -- 172.21.15.63:0/3355288652 --> v2:172.21.15.63:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0d0ff0 con 0x7fe0ec0cf9a0 2023-12-04T18:43:34.185 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.183+0000 7fe0f1cda640 1 --2- 172.21.15.63:0/3355288652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec0cf9a0 0x7fe0ec0cfe10 secure :-1 s=READY pgs=3056 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec08ca10 tx=0x7fe0dc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6c884d8120d6c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:34.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.184+0000 7fe0f14d9640 1 -- 172.21.15.63:0/3355288652 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc030860 con 0x7fe0ec0cf9a0 2023-12-04T18:43:34.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.184+0000 7fe0f14d9640 1 -- 172.21.15.63:0/3355288652 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0dc0309c0 con 0x7fe0ec0cf9a0 2023-12-04T18:43:34.186 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.184+0000 7fe0f14d9640 1 -- 172.21.15.63:0/3355288652 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0dc030d50 con 0x7fe0ec0cf9a0 2023-12-04T18:43:34.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.184+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3355288652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec0cf9a0 msgr2=0x7fe0ec0cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:34.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.184+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3355288652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec0cf9a0 0x7fe0ec0cfe10 secure :-1 s=READY pgs=3056 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec08ca10 tx=0x7fe0dc02b9a0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.185+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3355288652 shutdown_connections 2023-12-04T18:43:34.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.185+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3355288652 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec0cf9a0 0x7fe0ec0cfe10 unknown :-1 s=CLOSED pgs=3056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.185+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3355288652 >> v2:172.21.15.66:3300/0 conn(0x7fe0ec15e620 0x7fe0ec0b2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.185+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3355288652 >> 172.21.15.63:0/3355288652 conn(0x7fe0ec09c3a0 msgr2=0x7fe0ec0d30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:34.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.185+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3355288652 shutdown_connections 2023-12-04T18:43:34.187 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.186+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3355288652 wait complete. 2023-12-04T18:43:34.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.187+0000 7fe0f34dd640 1 Processor -- start 2023-12-04T18:43:34.189 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.187+0000 7fe0f34dd640 1 -- start start 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.188+0000 7fe0f34dd640 1 --2- >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0ec0cdce0 0x7fe0ec156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.188+0000 7fe0f34dd640 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0ec0cf9a0 0x7fe0ec0ca5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.188+0000 7fe0f34dd640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec15e620 0x7fe0ec0c9120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.188+0000 7fe0f34dd640 1 -- --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec156670 con 0x7fe0ec15e620 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.188+0000 7fe0f34dd640 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0b6fd0 con 0x7fe0ec0cf9a0 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.188+0000 7fe0f34dd640 1 -- --> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec0cab20 con 0x7fe0ec0cdce0 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f2cdc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec15e620 0x7fe0ec0c9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f2cdc640 1 --2- >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec15e620 0x7fe0ec0c9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.63:3300/0 says I am v2:172.21.15.63:33588/0 (socket says 172.21.15.63:33588) 2023-12-04T18:43:34.191 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f2cdc640 1 -- 172.21.15.63:0/3542999721 learned_addr learned my addr 172.21.15.63:0/3542999721 (peer_addr_for_me v2:172.21.15.63:0/0) 2023-12-04T18:43:34.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f24db640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0ec0cdce0 0x7fe0ec156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:34.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f2cdc640 1 -- 172.21.15.63:0/3542999721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0ec0cdce0 msgr2=0x7fe0ec156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:34.192 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f2cdc640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0ec0cdce0 0x7fe0ec156130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f2cdc640 1 -- 172.21.15.63:0/3542999721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0ec0cf9a0 msgr2=0x7fe0ec0ca5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f2cdc640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0ec0cf9a0 0x7fe0ec0ca5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.189+0000 7fe0f2cdc640 1 -- 172.21.15.63:0/3542999721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0dc0094d0 con 0x7fe0ec15e620 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.190+0000 7fe0f2cdc640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec15e620 0x7fe0ec0c9120 secure :-1 s=READY pgs=3057 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400c730 tx=0x7fe0e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.190+0000 7fe0e2ffd640 1 -- 172.21.15.63:0/3542999721 <== mon.0 v2:172.21.15.63:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4003b90 con 0x7fe0ec15e620 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.190+0000 7fe0e2ffd640 1 -- 172.21.15.63:0/3542999721 <== mon.0 v2:172.21.15.63:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e4003cf0 con 0x7fe0ec15e620 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.190+0000 7fe0e2ffd640 1 -- 172.21.15.63:0/3542999721 <== mon.0 v2:172.21.15.63:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e4003ea0 con 0x7fe0ec15e620 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.190+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec0cc830 con 0x7fe0ec15e620 2023-12-04T18:43:34.193 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.190+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec0b6c60 con 0x7fe0ec15e620 2023-12-04T18:43:34.194 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.192+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec0b7140 con 0x7fe0ec15e620 2023-12-04T18:43:34.195 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.193+0000 7fe0e2ffd640 1 -- 172.21.15.63:0/3542999721 <== mon.0 v2:172.21.15.63:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe0e400aa70 con 0x7fe0ec15e620 2023-12-04T18:43:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.194+0000 7fe0e2ffd640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe0d006ae40 0x7fe0d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-04T18:43:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.194+0000 7fe0e2ffd640 1 -- 172.21.15.63:0/3542999721 <== mon.0 v2:172.21.15.63:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe0e4089610 con 0x7fe0ec15e620 2023-12-04T18:43:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.195+0000 7fe0f24db640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe0d006ae40 0x7fe0d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-04T18:43:34.197 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.195+0000 7fe0f24db640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe0d006ae40 0x7fe0d006d300 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009970 tx=0x7fe0e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-04T18:43:34.201 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.199+0000 7fe0e2ffd640 1 -- 172.21.15.63:0/3542999721 <== mon.0 v2:172.21.15.63:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe0e40544c0 con 0x7fe0ec15e620 2023-12-04T18:43:34.408 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.406+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 --> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0ec04e840 con 0x7fe0ec15e620 2023-12-04T18:43:34.409 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.407+0000 7fe0e2ffd640 1 -- 172.21.15.63:0/3542999721 <== mon.0 v2:172.21.15.63:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v47) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe0e4057ae0 con 0x7fe0ec15e620 2023-12-04T18:43:34.409 INFO:teuthology.orchestra.run.smithi063.stderr:listed 0 entries 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.409+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe0d006ae40 msgr2=0x7fe0d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.409+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe0d006ae40 0x7fe0d006d300 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009970 tx=0x7fe0e8008040 comp rx=0 tx=0).stop 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.409+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec15e620 msgr2=0x7fe0ec0c9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.409+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec15e620 0x7fe0ec0c9120 secure :-1 s=READY pgs=3057 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400c730 tx=0x7fe0e400cbf0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.410+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 shutdown_connections 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.410+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:6832/2779630096,v1:172.21.15.63:6833/2779630096] conn(0x7fe0d006ae40 0x7fe0d006d300 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.410+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.63:3300/0,v1:172.21.15.63:6789/0] conn(0x7fe0ec15e620 0x7fe0ec0c9120 unknown :-1 s=CLOSED pgs=3057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.410+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fe0ec0cf9a0 0x7fe0ec0ca5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.410+0000 7fe0f34dd640 1 --2- 172.21.15.63:0/3542999721 >> [v2:172.21.15.66:3301/0,v1:172.21.15.66:6790/0] conn(0x7fe0ec0cdce0 0x7fe0ec156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-04T18:43:34.412 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.410+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 >> 172.21.15.63:0/3542999721 conn(0x7fe0ec09c3a0 msgr2=0x7fe0ec06c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-04T18:43:34.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.410+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 shutdown_connections 2023-12-04T18:43:34.413 INFO:teuthology.orchestra.run.smithi063.stderr:2023-12-04T18:43:34.410+0000 7fe0f34dd640 1 -- 172.21.15.63:0/3542999721 wait complete. 2023-12-04T18:43:34.430 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-04T18:43:34.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T18:43:34.430 DEBUG:teuthology.orchestra.run.smithi063:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-04T18:43:34.518 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T18:43:34.519 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T18:43:34.519 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-04T18:43:34.581 DEBUG:teuthology.orchestra.run.smithi063:> set -ex 2023-12-04T18:43:34.581 DEBUG:teuthology.orchestra.run.smithi063:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T18:43:34.622 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054305,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249416k,nr_inodes=812354,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498836k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.63:6789:/test /tmp/tmp.kMUSrf2Uhytest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=41e9b14e-2141-4ea1-b0af-8533c9689063,acl 0 0 2023-12-04T18:43:34.622 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi063.front.sepia.ceph.com 2023-12-04T18:43:34.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T18:43:34.622 DEBUG:teuthology.orchestra.run.smithi063:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-04T18:43:34.706 INFO:teuthology.orchestra.run.smithi063.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-04T18:43:34.707 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T18:43:34.707 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T18:43:34.707 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T18:43:34.835 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-04T18:43:34.835 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T18:43:34.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T18:43:34.835 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-04T18:43:35.005 INFO:teuthology.orchestra.run.smithi066.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-04T18:43:35.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T18:43:35.007 DEBUG:teuthology.orchestra.run.smithi066:> set -ex 2023-12-04T18:43:35.008 DEBUG:teuthology.orchestra.run.smithi066:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-04T18:43:35.071 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054283,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249396k,nr_inodes=812349,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498800k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-04T18:43:35.071 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi066.front.sepia.ceph.com 2023-12-04T18:43:35.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-04T18:43:35.072 DEBUG:teuthology.orchestra.run.smithi066:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-04T18:43:35.129 INFO:teuthology.orchestra.run.smithi066.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-04T18:43:35.129 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-04T18:43:35.207 INFO:tasks.ceph.osd.5.smithi066.stderr:daemon-helper: command crashed with signal 6 2023-12-04T18:43:36.640 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-04T18:43:36.640 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-04T18:43:36.641 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-04T18:43:36.641 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-04T18:43:36.641 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-04T18:43:36.641 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-04T18:43:36.641 INFO:tasks.ceph.mds.a:Sent signal 15 2023-12-04T18:43:36.642 INFO:tasks.ceph.mds.c:Sent signal 15 2023-12-04T18:43:36.642 INFO:tasks.ceph.mds.b:Sent signal 15 2023-12-04T18:43:36.642 INFO:tasks.ceph.mds.d:Sent signal 15 2023-12-04T18:43:36.642 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-04T18:43:36.642 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-04T18:43:36.643 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-04T18:43:36.643 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-04T18:43:36.643 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-04T18:43:36.644 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T18:43:36.641+0000 7f113ab9e640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 88570) UID: 0 2023-12-04T18:43:36.644 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T18:43:36.641+0000 7f113ab9e640 -1 osd.4 47 *** Got signal Terminated *** 2023-12-04T18:43:36.644 INFO:tasks.ceph.osd.4.smithi066.stderr:2023-12-04T18:43:36.641+0000 7f113ab9e640 -1 osd.4 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-04T18:43:36.644 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T18:43:36.639+0000 7fa501c84640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 88341) UID: 0 2023-12-04T18:43:36.644 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T18:43:36.639+0000 7fa501c84640 -1 osd.0 47 *** Got signal Terminated *** 2023-12-04T18:43:36.644 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T18:43:36.641+0000 7feca2544640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 88576) UID: 0 2023-12-04T18:43:36.644 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T18:43:36.641+0000 7feca2544640 -1 osd.6 47 *** Got signal Terminated *** 2023-12-04T18:43:36.644 INFO:tasks.ceph.osd.6.smithi066.stderr:2023-12-04T18:43:36.641+0000 7feca2544640 -1 osd.6 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-04T18:43:36.645 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T18:43:36.640+0000 7faa95261640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 88342) UID: 0 2023-12-04T18:43:36.645 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T18:43:36.640+0000 7faa95261640 -1 osd.1 47 *** Got signal Terminated *** 2023-12-04T18:43:36.645 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T18:43:36.641+0000 7fdcb8c4a640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 88574) UID: 0 2023-12-04T18:43:36.645 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T18:43:36.641+0000 7fdcb8c4a640 -1 osd.7 47 *** Got signal Terminated *** 2023-12-04T18:43:36.645 INFO:tasks.ceph.osd.7.smithi066.stderr:2023-12-04T18:43:36.641+0000 7fdcb8c4a640 -1 osd.7 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-04T18:43:36.645 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T18:43:36.640+0000 7f6ff4a79640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 88343) UID: 0 2023-12-04T18:43:36.646 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T18:43:36.640+0000 7f6ff4a79640 -1 osd.2 47 *** Got signal Terminated *** 2023-12-04T18:43:36.646 INFO:tasks.ceph.mon.b.smithi066.stderr:2023-12-04T18:43:36.642+0000 7fe61a268640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 88001) UID: 0 2023-12-04T18:43:36.646 INFO:tasks.ceph.mon.b.smithi066.stderr:2023-12-04T18:43:36.642+0000 7fe61a268640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-04T18:43:36.646 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T18:43:36.640+0000 7effea0e4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 101030) UID: 0 2023-12-04T18:43:36.646 INFO:tasks.ceph.mds.a.smithi063.stderr:2023-12-04T18:43:36.640+0000 7effea0e4640 -1 mds.a *** got signal Terminated *** 2023-12-04T18:43:36.646 INFO:tasks.ceph.mon.c.smithi066.stderr:2023-12-04T18:43:36.642+0000 7ffb3b096640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 88003) UID: 0 2023-12-04T18:43:36.647 INFO:tasks.ceph.mon.c.smithi066.stderr:2023-12-04T18:43:36.642+0000 7ffb3b096640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-04T18:43:36.647 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T18:43:36.641+0000 7f8f22038640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 101032) UID: 0 2023-12-04T18:43:36.647 INFO:tasks.ceph.mds.c.smithi063.stderr:2023-12-04T18:43:36.641+0000 7f8f22038640 -1 mds.c *** got signal Terminated *** 2023-12-04T18:43:36.647 INFO:tasks.ceph.mon.a.smithi063.stderr:2023-12-04T18:43:36.642+0000 7ff170511640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 88092) UID: 0 2023-12-04T18:43:36.653 INFO:tasks.ceph.osd.0.smithi063.stderr:2023-12-04T18:43:36.651+0000 7fa501c84640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-04T18:43:36.654 INFO:tasks.ceph.osd.1.smithi063.stderr:2023-12-04T18:43:36.651+0000 7faa95261640 -1 osd.1 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-04T18:43:36.654 INFO:tasks.ceph.osd.2.smithi063.stderr:2023-12-04T18:43:36.651+0000 7f6ff4a79640 -1 osd.2 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-04T18:43:36.670 INFO:tasks.ceph.mon.a.smithi063.stderr:2023-12-04T18:43:36.667+0000 7ff170511640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-04T18:43:36.671 INFO:tasks.ceph.mds.b.smithi066.stderr:2023-12-04T18:43:36.663+0000 7f2bf112c640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 94308) UID: 0 2023-12-04T18:43:36.671 INFO:tasks.ceph.mds.d.smithi066.stderr:2023-12-04T18:43:36.663+0000 7f8b9eae4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 94306) UID: 0 2023-12-04T18:43:36.671 INFO:tasks.ceph.mds.b.smithi066.stderr:2023-12-04T18:43:36.669+0000 7f2bf112c640 -1 mds.b *** got signal Terminated *** 2023-12-04T18:43:36.672 INFO:tasks.ceph.mds.d.smithi066.stderr:2023-12-04T18:43:36.669+0000 7f8b9eae4640 -1 mds.d *** got signal Terminated *** 2023-12-04T18:43:36.684 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T18:43:36.656+0000 7f226cfe7640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 88096) UID: 0 2023-12-04T18:43:36.684 INFO:tasks.ceph.mgr.y.smithi063.stderr:2023-12-04T18:43:36.682+0000 7f226cfe7640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-04T18:43:36.700 INFO:tasks.ceph.mon.a.smithi063.stderr:2023-12-04T18:43:36.698+0000 7ff16ad06640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-04T18:43:36.846 INFO:tasks.ceph.mgr.x.smithi066.stderr:daemon-helper: command crashed with signal 15 2023-12-04T18:44:57.430 INFO:teuthology.orchestra.run.smithi063.stderr:ceph-osd: no process found 2023-12-04T18:47:57.258 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:47:57.267 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:48:27.422 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:48:27.431 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:48:57.584 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:48:57.595 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:49:27.757 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:49:27.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:49:57.910 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:49:57.920 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:50:28.069 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:50:28.081 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:50:58.230 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:50:58.240 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:51:28.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:51:28.404 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:51:58.549 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:51:58.559 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:52:28.715 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:52:28.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:52:58.876 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:52:58.887 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:53:29.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:53:29.051 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:53:59.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:53:59.340 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:54:29.500 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:54:29.511 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:54:59.655 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:54:59.666 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:55:29.819 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:55:29.829 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:55:59.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:55:59.993 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:56:30.155 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:56:30.166 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:57:00.309 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:57:00.319 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:57:30.472 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:57:30.483 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:58:00.628 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:58:00.640 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:58:30.800 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:58:30.811 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:59:00.956 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:59:00.968 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:59:31.129 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T18:59:31.139 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:00:01.383 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:00:01.396 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:00:31.562 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:00:31.573 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:01:01.717 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:01:01.725 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:01:31.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:01:31.892 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:02:02.034 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:02:02.044 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:02:32.191 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:02:32.205 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:03:02.365 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:03:02.375 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:03:32.534 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:03:32.544 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:04:02.690 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:04:02.704 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:04:32.861 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:04:32.872 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:05:03.016 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:05:03.029 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:05:33.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:05:33.200 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:06:03.352 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:06:03.362 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:06:33.524 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:06:33.534 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:07:03.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:07:03.689 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:07:33.843 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:07:33.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:08:03.987 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:08:03.997 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:08:34.144 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:08:34.155 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:09:04.299 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:09:04.309 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:09:34.470 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:09:34.484 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:10:04.643 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:10:04.653 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:10:34.815 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:10:34.825 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:11:04.970 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:11:04.980 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:11:35.155 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:11:35.165 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:12:05.321 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:12:05.331 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:12:35.502 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:12:35.512 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:13:05.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:13:05.684 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:13:35.912 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:13:35.922 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:14:06.075 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:14:06.085 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:14:36.222 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:14:36.232 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:15:06.376 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:15:06.387 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:15:36.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:15:36.551 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:16:06.695 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:16:06.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:16:36.868 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:16:36.878 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:17:07.023 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:17:07.033 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:17:37.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:17:37.204 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:18:07.348 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:18:07.358 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:18:37.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:18:37.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:19:07.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:19:07.678 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:19:37.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:19:37.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:20:08.011 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:20:08.021 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:20:38.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:20:38.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:21:08.346 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:21:08.362 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:21:38.526 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:21:38.537 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:22:08.689 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:22:08.702 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:22:38.862 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:22:38.870 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:23:09.008 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:23:09.019 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:23:39.172 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:23:39.182 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:24:09.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:24:09.346 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:24:39.507 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:24:39.517 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:25:09.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:25:09.673 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:25:39.833 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:25:39.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:26:09.988 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:26:09.998 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:26:40.160 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:26:40.170 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:27:10.315 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:27:10.326 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:27:40.495 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:27:40.506 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:28:10.651 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:28:10.661 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:28:40.822 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:28:40.832 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:29:10.977 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:29:10.987 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:29:41.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:29:41.151 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:30:11.330 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:30:11.340 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:30:41.495 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:30:41.505 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:31:11.639 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:31:11.650 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:31:41.811 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:31:41.822 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:32:11.958 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:32:11.969 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:32:42.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:32:42.113 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:33:12.260 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:33:12.270 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:33:42.432 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:33:42.443 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:34:12.595 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:34:12.605 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:34:42.767 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:34:42.777 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:35:12.921 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:35:12.932 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:35:43.085 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:35:43.096 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:36:13.338 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:36:13.348 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:36:43.513 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:36:43.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:37:13.668 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:37:13.678 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:37:43.823 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:37:43.835 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:38:13.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:38:13.986 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:38:44.141 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:38:44.154 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:39:14.305 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:39:14.317 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:39:44.477 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:39:44.486 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:40:14.674 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:40:14.683 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:40:44.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:40:44.855 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:41:15.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:41:15.020 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:41:45.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:41:45.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:42:15.335 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:42:15.345 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:42:45.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:42:45.510 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:43:15.648 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:43:15.659 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:43:45.817 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:43:45.827 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:44:15.973 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:44:15.983 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:44:46.136 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:44:46.146 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:45:16.388 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:45:16.398 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:45:46.554 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:45:46.572 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:46:16.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:46:16.737 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:46:47.015 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:46:47.026 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:47:17.171 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:47:17.181 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:47:47.342 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:47:47.352 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:48:17.496 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:48:17.507 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:48:47.686 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:48:47.696 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:49:17.849 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:49:17.859 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:49:48.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:49:48.024 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:50:18.185 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:50:18.196 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:50:48.356 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:50:48.366 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:51:18.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:51:18.520 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:51:48.687 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:51:48.697 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:52:18.855 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:52:18.866 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:52:49.027 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:52:49.037 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:53:19.190 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:53:19.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:53:49.362 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:53:49.372 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:54:19.660 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:54:19.670 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:54:49.831 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:54:49.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:55:19.994 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:55:20.005 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:55:50.174 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:55:50.185 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:56:20.337 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:56:20.347 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:56:50.501 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:56:50.511 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:57:20.664 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:57:20.674 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:57:50.828 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:57:50.837 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:58:20.995 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:58:21.005 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:58:51.163 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:58:51.173 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:59:21.327 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:59:21.334 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:59:51.489 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T19:59:51.499 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:00:21.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:00:21.672 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:00:51.833 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:00:51.843 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:01:21.996 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:01:22.006 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:01:52.169 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:01:52.179 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:02:22.348 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:02:22.358 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:02:52.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:02:52.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:03:22.675 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:03:22.685 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:03:52.840 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:03:52.851 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:04:23.003 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:04:23.013 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:04:53.183 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:04:53.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:05:23.347 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:05:23.357 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:05:53.519 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:05:53.529 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:06:23.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:06:23.683 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:06:53.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:06:53.856 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:07:24.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:07:24.027 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:07:54.187 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:07:54.197 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:08:24.343 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:08:24.353 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:08:54.515 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:08:54.525 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:09:24.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:09:24.689 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:09:54.859 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:09:54.870 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:10:25.030 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:10:25.040 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:10:55.203 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:10:55.214 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:11:25.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:11:25.368 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:11:55.529 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:11:55.542 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:12:25.693 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:12:25.703 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:12:55.864 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:12:55.874 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:13:26.018 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:13:26.029 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:13:56.182 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:13:56.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:14:26.355 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:14:26.365 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:14:56.543 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:14:56.553 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:15:26.707 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:15:26.718 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:15:56.878 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:15:56.888 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:16:27.043 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:16:27.053 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:16:57.205 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:16:57.216 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:17:27.361 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:17:27.371 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:17:57.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:17:57.551 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:18:27.696 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:18:27.706 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:18:57.867 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:18:57.877 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:19:28.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:19:28.032 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:19:58.194 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:19:58.204 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:20:28.357 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:20:28.367 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:20:58.512 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:20:58.523 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:21:28.667 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:21:28.677 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:21:58.840 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:21:58.849 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:22:29.074 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:22:29.085 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:22:59.242 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:22:59.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:23:29.387 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:23:29.397 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:23:59.552 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:23:59.562 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:24:29.727 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:24:29.737 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:24:59.895 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:24:59.905 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:25:30.050 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:25:30.060 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:26:00.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:26:00.223 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:26:30.369 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:26:30.379 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:27:00.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:27:00.551 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:27:30.694 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:27:30.704 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:28:00.859 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:28:00.871 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:28:31.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:28:31.033 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:29:01.193 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:29:01.203 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:29:31.358 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:29:31.369 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:30:01.521 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:30:01.532 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:30:31.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:30:31.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:31:01.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:31:01.867 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:31:32.013 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:31:32.023 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:32:02.183 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:32:02.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:32:32.341 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:32:32.351 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:33:02.518 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:33:02.528 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:33:32.682 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:33:32.692 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:34:02.853 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:34:02.865 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:34:33.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:34:33.028 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:35:03.189 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:35:03.199 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:35:33.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:35:33.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:36:03.506 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:36:03.516 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:36:33.663 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:36:33.673 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:37:03.951 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:37:03.962 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:37:34.104 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:37:34.116 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:38:04.277 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:38:04.289 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:38:34.433 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:38:34.443 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:39:04.605 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:39:04.615 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:39:34.760 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:39:34.767 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:40:04.950 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:40:04.961 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:40:35.111 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:40:35.122 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:41:05.284 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:41:05.294 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:41:35.438 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:41:35.450 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:42:05.611 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:42:05.624 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:42:35.773 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:42:35.783 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:43:05.937 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:43:05.948 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:43:36.092 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:43:36.104 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:44:06.255 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:44:06.266 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:44:36.409 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:44:36.419 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:45:06.584 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:45:06.595 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:45:36.747 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:45:36.756 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:46:06.918 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:46:06.928 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:46:37.081 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:46:37.091 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:47:07.245 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:47:07.256 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:47:37.407 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:47:37.417 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:48:07.572 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:48:07.582 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:48:37.807 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:48:37.817 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:49:08.063 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:49:08.075 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:49:38.220 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:49:38.230 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:50:08.392 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:50:08.402 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:50:38.545 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:50:38.555 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:51:08.719 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:51:08.730 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:51:38.874 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:51:38.884 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:52:09.062 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:52:09.072 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:52:39.216 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:52:39.226 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:53:09.389 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:53:09.400 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:53:39.544 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:53:39.554 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:54:09.724 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:54:09.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:54:39.894 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:54:39.904 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:55:10.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:55:10.071 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:55:40.217 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:55:40.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:56:10.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:56:10.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:56:40.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:56:40.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:57:10.722 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:57:10.733 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:57:40.885 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:57:40.896 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:58:11.056 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:58:11.066 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:58:41.211 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:58:41.222 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:59:11.383 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:59:11.394 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:59:41.537 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T20:59:41.548 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:00:11.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:00:11.719 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:00:41.871 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:00:41.881 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:01:12.036 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:01:12.046 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:01:42.191 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:01:42.201 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:02:12.355 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:02:12.365 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:02:42.510 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:02:42.519 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:03:12.683 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:03:12.694 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:03:42.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:03:42.856 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:04:13.009 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:04:13.019 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:04:43.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:04:43.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:05:13.353 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:05:13.364 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:05:43.506 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:05:43.517 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:06:13.679 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:06:13.690 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:06:43.842 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:06:43.852 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:07:14.055 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:07:14.064 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:07:44.211 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:07:44.221 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:08:14.391 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:08:14.401 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:08:44.627 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:08:44.637 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:09:14.882 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:09:14.892 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:09:45.047 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:09:45.058 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:10:15.219 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:10:15.229 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:10:45.373 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:10:45.384 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:11:15.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:11:15.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:11:45.709 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:11:45.719 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:12:15.907 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:12:15.918 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:12:46.060 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:12:46.070 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:13:16.234 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:13:16.244 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:13:46.396 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:13:46.407 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:14:16.568 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:14:16.578 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:14:46.732 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:14:46.743 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:15:16.903 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:15:16.914 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:15:47.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:15:47.086 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:16:17.252 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:16:17.262 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:16:47.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:16:47.429 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:17:17.582 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:17:17.595 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:17:47.754 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:17:47.764 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:18:17.925 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:18:17.935 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:18:48.079 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:18:48.089 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:19:18.243 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:19:18.253 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:19:48.400 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:19:48.410 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:20:18.553 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:20:18.564 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:20:48.710 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:20:48.720 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:21:18.880 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:21:18.890 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:21:49.036 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:21:49.046 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:22:19.208 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:22:19.218 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:22:49.372 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:22:49.382 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:23:19.546 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:23:19.556 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:23:49.698 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:23:49.708 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:24:19.870 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:24:19.880 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:24:50.033 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:24:50.043 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:25:20.213 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:25:20.224 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:25:50.369 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:25:50.380 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:26:20.540 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:26:20.549 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:26:50.703 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:26:50.713 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:27:20.875 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:27:20.885 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:27:51.022 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:27:51.029 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:28:21.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:28:21.193 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:28:51.340 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:28:51.350 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:29:21.520 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:29:21.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:29:51.677 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:29:51.686 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:30:21.849 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:30:21.859 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:30:52.011 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:30:52.022 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:31:22.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:31:22.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:31:52.348 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:31:52.358 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:32:22.511 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:32:22.520 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:32:52.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:32:52.676 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:33:22.839 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:33:22.849 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:33:52.992 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:33:53.003 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:34:23.148 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:34:23.158 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:34:53.292 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:34:53.302 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:35:23.458 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:35:23.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:35:53.605 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:35:53.620 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:36:23.785 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:36:23.795 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:36:53.949 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:36:53.959 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:37:24.120 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:37:24.130 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:37:54.275 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:37:54.286 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:38:24.455 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:38:24.465 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:38:54.619 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:38:54.630 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:39:24.782 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:39:24.792 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:39:54.930 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:39:54.940 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:40:25.102 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:40:25.112 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:40:55.255 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:40:55.265 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:41:25.419 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:41:25.430 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:41:55.659 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:41:55.669 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:42:25.821 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:42:25.831 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:42:55.976 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:42:55.987 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:43:26.148 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:43:26.158 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:43:56.311 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:43:56.321 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:44:26.508 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:44:26.518 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:44:56.673 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:44:56.684 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:45:26.852 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:45:26.864 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:45:57.007 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:45:57.019 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:46:27.162 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:46:27.171 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:46:57.328 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:46:57.337 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:47:27.488 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:47:27.498 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:47:57.644 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:47:57.654 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:48:27.816 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:48:27.826 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:48:57.969 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:48:57.979 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:49:28.152 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:49:28.167 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:49:58.320 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:49:58.337 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:50:28.503 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:50:28.514 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:50:58.658 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:50:58.668 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:51:28.830 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:51:28.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:51:59.002 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:51:59.013 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:52:29.173 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:52:29.184 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:52:59.329 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:52:59.341 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:53:29.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:53:29.509 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:53:59.646 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:53:59.656 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:54:29.827 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:54:29.839 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:54:59.983 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:54:59.993 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:55:30.154 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:55:30.164 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:56:00.308 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:56:00.322 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:56:30.481 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:56:30.493 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:57:00.653 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:57:00.662 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:57:30.828 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:57:30.841 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:58:00.998 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:58:01.008 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:58:31.169 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:58:31.176 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:59:01.323 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:59:01.333 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:59:31.495 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T21:59:31.505 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:00:01.666 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:00:01.675 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:00:31.836 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:00:31.846 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:01:01.985 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:01:01.995 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:01:32.149 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:01:32.160 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:02:02.304 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:02:02.316 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:02:32.475 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:02:32.488 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:03:02.630 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:03:02.640 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:03:32.793 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:03:32.803 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:04:02.938 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:04:02.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:04:33.097 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:04:33.108 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:05:03.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:05:03.269 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:05:33.432 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:05:33.439 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:06:03.587 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:06:03.597 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:06:33.758 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:06:33.769 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:07:03.912 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:07:03.923 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:07:34.084 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:07:34.094 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:08:04.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:08:04.243 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:08:34.394 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:08:34.405 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:09:04.550 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:09:04.560 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:09:34.704 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:09:34.715 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:10:04.868 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:10:04.878 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:10:35.040 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:10:35.048 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:11:05.186 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:11:05.197 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:11:35.367 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:11:35.377 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:12:05.529 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:12:05.539 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:12:35.701 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:12:35.711 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:13:05.856 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:13:05.867 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:13:36.029 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:13:36.039 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:14:06.184 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:14:06.194 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:14:36.364 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:14:36.373 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:15:06.519 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:15:06.530 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:15:36.691 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:15:36.701 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:16:06.845 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:16:06.856 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:16:37.017 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:16:37.027 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:17:07.181 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:17:07.192 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:17:37.344 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:17:37.354 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:18:07.499 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:18:07.509 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:18:37.662 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:18:37.673 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:19:07.818 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:19:07.828 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:19:38.084 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:19:38.095 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:20:08.287 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:20:08.297 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:20:38.458 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:20:38.468 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:21:08.621 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:21:08.631 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:21:38.786 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:21:38.795 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:22:08.940 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:22:08.949 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:22:39.103 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:22:39.113 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:23:09.257 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:23:09.269 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:23:39.430 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:23:39.441 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:24:09.585 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:24:09.595 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:24:39.756 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:24:39.766 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:25:09.913 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:25:09.923 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:25:40.076 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:25:40.086 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:26:10.231 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:26:10.241 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:26:40.403 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:26:40.413 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:27:10.558 DEBUG:teuthology.orchestra.run.smithi063:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:27:10.568 DEBUG:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-04T22:27:13.728 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-12-04T22:27:13.729 DEBUG:teuthology.task.console_log:Killing console logger for smithi063 2023-12-04T22:27:13.729 DEBUG:teuthology.task.console_log:Killing console logger for smithi066 2023-12-04T22:27:13.730 DEBUG:teuthology.exit:Finished running handlers